New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

评测脚本 #2

Open

blmdxiao opened this issue Dec 20, 2023 · 1 comment

blmdxiao commented Dec 20, 2023

评测脚本是否可以分享呢？

Collaborator

Aprilahhhh commented Mar 21, 2024 •

edited

Loading

我们使用AlpacaEval中的评测脚本，请参考：https://github.com/tatsu-lab/alpaca_eval
用GPT-4计算胜率使用的prompt已更新https://github.com/blcuicall/OMGEval/tree/main/evaluator_prompts/gpt4_template
供参考

Aprilahhhh closed this as completed

Aprilahhhh reopened this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment