Skip to content

METR/task-template

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

METR Task Template

This is a template you can use to develop tasks for the METR Task Standard.

Note: If you store your task code on GitHub, please set the repository to "private" so it does not end up in training data for future AI models.

Development process

  1. Implement your task in my_task/my_task.py (rename it with the name of your task)
  2. Write tests in my_task/my_task_test.py (rename it with the name of your task)
  3. Use the workbench to run your task and tests
  4. Have someone do a QA run and document it in my_task/meta/qa
  5. Finish documenting your task in my_task/meta/summary.md, my_task/meta/detail.md, and my_task/meta/eval_info.json

Resources

Contact us

If you run into technical issues or have questions about task development, you can email us at [email protected]

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published