Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

内置提示词压缩功能 #2029

Open
5 tasks done
chinese-wzq opened this issue Jan 11, 2025 · 0 comments
Open
5 tasks done

内置提示词压缩功能 #2029

chinese-wzq opened this issue Jan 11, 2025 · 0 comments
Labels
enhancement New feature or request

Comments

@chinese-wzq
Copy link

chinese-wzq commented Jan 11, 2025

例行检查

  • 我已确认目前没有类似 issue
  • 我已确认我已升级到最新版本
  • 我已完整查看过项目 README,已确定现有版本无法满足需求
  • 我理解并愿意跟进此 issue,协助测试和提供反馈
  • 我理解并认可上述内容,并理解项目维护者精力有限,不遵循规则的 issue 可能会被无视或直接关闭

功能描述
参考openrouter的提示词压缩技术,可以为指定的令牌设置使用提示词压缩功能,通过该令牌发送的所有请求都将被压缩提示词。选择这样做而不是在请求体里增加一个标记,是因为可以保持和大部分应用的兼容性。

应用场景
当用户需要节省token时非常实用,并且因为该功能目前只有openrouter提供,因此在one api里实现是具有相当重要的意义的。

@chinese-wzq chinese-wzq added the enhancement New feature or request label Jan 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant