-
Notifications
You must be signed in to change notification settings - Fork 15.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Quote tool names #11463
Quote tool names #11463
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎ 1 Ignored Deployment
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
hmmm this might be a bit problematic because it changes a good amount of prompts (which we're hesitant to do to an extent because it could have unanticipated effects)
Most open source LLMs does not work without this PR. How worse it could be if we merge this PR? |
Apologies for the slow review! Pr has some merge conflicts, happy to re-review if you'd like to resolve |
closing due to inactivity and merge conflicts |
{llm_output}
") #1477 ValueError: Could not parse LLM output: #1358The original prompt template is ambiguous because it does not tell whether the tool names should be quoted or not. This PR makes it clear that the tool names should be quoted. It fixes #1358 for Nous-Hermes-Llama2-13b according to my tests.