Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Anthropic prompt caching #3372

Closed
1 task done
khromov opened this issue Aug 15, 2024 · 2 comments
Closed
1 task done

feat: Anthropic prompt caching #3372

khromov opened this issue Aug 15, 2024 · 2 comments
Labels
type: feature request A new feature

Comments

@khromov
Copy link

khromov commented Aug 15, 2024

  • I have searched the existing issues

Is your feature request related to a problem? Please describe it

Describe the solution

By using Anthropic prompt caching, longer chats with a lot of context are substantially cheaper:
https://www.anthropic.com/news/prompt-caching

Teachability, documentation, adoption, migration strategy

No response

What is the motivation / use case for changing the behavior?
@khromov khromov added the type: feature request A new feature label Aug 15, 2024
@louis-menlo
Copy link
Contributor

DUP: janhq/cortex.cpp#1570

@imtuyethan imtuyethan removed the status in Menlo Aug 28, 2024
@imtuyethan
Copy link
Contributor

Close as duplicated with janhq/cortex.cpp#1570

@imtuyethan imtuyethan closed this as not planned Won't fix, can't repro, duplicate, stale Sep 2, 2024
@github-project-automation github-project-automation bot moved this to Completed in Menlo Sep 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type: feature request A new feature
Projects
Menlo
Archived in project
Milestone
No milestone
Development

No branches or pull requests
3 participants
@khromov @imtuyethan @louis-menlo