Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: ai assistant #261

Draft
wants to merge 20 commits into
base: develop
Choose a base branch
from
Draft

feat: ai assistant #261

wants to merge 20 commits into from

Conversation

RaunoT
Copy link
Owner

@RaunoT RaunoT commented Oct 7, 2024

A few things still need working out

  1. Caching doesn't seem to work properly, as I'm getting hit with limit errors after just a few requests.
 ⨯ GoogleGenerativeAIFetchError: [GoogleGenerativeAI Error]: Error fetching from https://generativelanguage.googleapis.com/v1beta/cachedContents: [429 Too Many Requests] TotalCachedContentStorageTokensPerModelFreeTier limit exceeded for model gemini-1.5-flash: limit=1000000, requested=1251312

{
  status: 429,
  statusText: 'Too Many Requests',
  errorDetails: undefined
}
  1. The maximum token count for Gemini cache is 1,000,000 but we also need to consider the minimum, which is 32,768. Should we just send histories with the request message every time in those cases? What are the best practices here?
⨯ GoogleGenerativeAIFetchError: [GoogleGenerativeAI Error]: Error fetching from https://generativelanguage.googleapis.com/v1beta/cachedContents: [400 Bad Request] Cached content is too small. total_token_count=6690, min_total_token_count=32768
  1. The history.csv file isn't always being properly overridden when saving Chat settings.

@RaunoT RaunoT added the help wanted Extra attention is needed label Oct 7, 2024
@RaunoT RaunoT self-assigned this Oct 7, 2024
@RaunoT RaunoT added the never-stale Will not be marked as stale label Oct 7, 2024
@RaunoT RaunoT marked this pull request as draft October 17, 2024 14:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed never-stale Will not be marked as stale
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant