Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Publish evals from Taskcluster #519

Closed
Tracked by #164
eu9ene opened this issue Apr 9, 2024 · 2 comments · Fixed by #598
Closed
Tracked by #164

Publish evals from Taskcluster #519

eu9ene opened this issue Apr 9, 2024 · 2 comments · Fixed by #598
Labels
weights and biases Intergration with Weights and Biases

Comments

@eu9ene
Copy link
Collaborator

eu9ene commented Apr 9, 2024

No description provided.

@eu9ene eu9ene mentioned this issue Apr 9, 2024
Closed
@eu9ene eu9ene added the weights and biases Intergration with Weights and Biases label Apr 9, 2024
@La0
Copy link
Collaborator

La0 commented Apr 29, 2024

@eu9ene Could you link here all the Taskcluster kind files you want to track ?

@eu9ene
Copy link
Collaborator Author

eu9ene commented Apr 29, 2024

Everything that starts from "evaluate":
https://github.com/mozilla/firefox-translations-training/blob/main/taskcluster/kinds/evaluate-quantized/kind.yml
https://github.com/mozilla/firefox-translations-training/blob/main/taskcluster/kinds/evaluate-teacher-ensemble/kind.yml
https://github.com/mozilla/firefox-translations-training/blob/main/taskcluster/kinds/evaluate/kind.yml

The goal is to integrate everything we had in the offline publisher.

Also, we should reuse the code from the offline publisher that maps the task label to the training steps to keep the naming consistent.

@La0 La0 mentioned this issue May 2, 2024
Closed
This was referenced May 13, 2024
Merged
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
weights and biases Intergration with Weights and Biases
Projects
None yet
Milestone
No milestone
2 participants
@La0 @eu9ene