Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate OpenAI assistant cancellation reason: max_prompt_tokens #1200

Open
SmittieC opened this issue Feb 18, 2025 · 1 comment
Open

Comments

@SmittieC
Copy link
Contributor

SmittieC commented Feb 18, 2025

See this trace. OpenAI cancelled the run due to max_prompt_tokens. Is this something we can tweak? Maybe we'll have to use another truncation strategy?

We also need to give the user a better error message when this happens. From JJ:

(anytime we're confused like this, lets make part of the resulotion better clarity of the error to the end user)

@snopoke
Copy link
Contributor

snopoke commented Feb 18, 2025

It can be changed (https://platform.openai.com/docs/api-reference/runs/createRun#runs-createrun-max_prompt_tokens) though since we don't provide one at all I wonder why it's still happening.

Some more info here: https://platform.openai.com/docs/assistants/deep-dive#max-completion-and-max-prompt-tokens

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: No status
Development

No branches or pull requests

2 participants