Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(docs) add examples on how to use autoevals.llm #30

Open
ishaan-jaff opened this issue Nov 10, 2023 · 3 comments
Open

(docs) add examples on how to use autoevals.llm #30

ishaan-jaff opened this issue Nov 10, 2023 · 3 comments

Comments

@ishaan-jaff
Copy link

It's unclear how to use the different types of autoevals, can you add example usage and supported input params

Screenshot 2023-11-09 at 4 02 55 PM

@ishaan-jaff
Copy link
Author

also showing expected output would be useful

@ankrgyl
Copy link
Contributor

ankrgyl commented Nov 10, 2023

Thanks for the idea! We definitely have some work to do on the docs here. Would you be interested in contributing? Happy to work through a few ideas on how to do it in an automated way.

@ishaan-jaff
Copy link
Author

yeah open to helping here - I actually just added docs on how to use auto evals with litellm and wanted to add more details there: https://docs.litellm.ai/docs/tutorials/eval_suites#using-litellm-with-autoeval

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants