Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support Gemini (Google Generative AI) Platform #275

Closed
8 tasks done
enricoros opened this issue Dec 13, 2023 · 5 comments
Closed
8 tasks done

Support Gemini (Google Generative AI) Platform #275

enricoros opened this issue Dec 13, 2023 · 5 comments
Labels
feature-cool Distinctive features new-vendor
Milestone
1.8.0

Comments

@enricoros
Copy link
Owner

enricoros commented Dec 13, 2023 •
edited
Loading

Support the Google generative AI platform and the Gemini models, as documented here:

  • docs: ..
  • login: ...

Requirements:

  • Add Gemini Vendor
  • Add Gemini vector icon
  • Implement Setup and (transport) Access
  • Implement Transport
  • Implement Model List mapping (tokens, name, description, etc)
  • Implement Streaming endpoint
  • Test
  • Ship 🚀
@david-strejc
Copy link

Support the Google generative AI platform and the Gemini models, as documented here:

  • docs: ..
  • login: ...

Requirements:

  • Add Gemini Vendor
  • Add Gemini vector icon
  • Implement Setup and (transport) Access
  • Implement Transport
  • Implement Model List mapping (tokens, name, description, etc)
  • Implement Streaming endpoint
  • Test
  • Ship 🚀

When will be first version ready?

@enricoros
Copy link
Owner Author

@david-strejc This week, ideally tomorrow, at least with the basic features.

@enricoros enricoros added this to the 1.8.0 milestone Dec 18, 2023
@david-strejc
Copy link

@david-strejc This week, ideally tomorrow, at least with the basic features.

Many MANY thanks. We are curious what we can do with Gemini.

@enricoros
Copy link
Owner Author

enricoros commented Dec 19, 2023 •
edited
Loading

Support almost complete. Will finish tomorrow.

  • list models; ✅
  • immediate generation: ✅
  • streaming generation: will be done next
  • image/multi-part input: not ready yet, needs to change all LLM providers - prob preview late this week
  • function calling: very experimental, nowhere near OpenAI

Note that Gemini models:

  • does not support system prompts well (they do not have the concept of system prompts)
  • ... more quirks? ...

image

@github-project-automation github-project-automation bot moved this from In Progress to Ready in big-AGI build-in-public roadmap Dec 20, 2023
@enricoros
Copy link
Owner Author

Code landed for a very good implementation of Gemini.

  • includes streaming, non-streaming, list models
  • includes changeable safety settings
  • includes multipart text conversation building

Next up:

@enricoros enricoros mentioned this issue Dec 20, 2023
Closed
20 tasks
@enricoros enricoros moved this from Ready to To Promote in big-AGI build-in-public roadmap Dec 20, 2023
@enricoros enricoros added the feature-cool Distinctive features label Dec 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature-cool Distinctive features new-vendor
Projects
big-AGI build-in-public roadmap
Status: To Promote
Milestone
1.8.0
Development

No branches or pull requests
2 participants
@enricoros @david-strejc