Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parse stalled validation data #637

Merged
merged 9 commits into from
May 30, 2024
Merged

Parse stalled validation data #637

merged 9 commits into from
May 30, 2024

Conversation

vrigal
Copy link
Contributor

@vrigal vrigal commented May 27, 2024

Closes #534

Publication example: https://wandb.ai/teklia/534-lt-en

Note:

  • I added support for perplexity_stalled.
  • train/words_per_second is already handled but named rate on Weight & Biases. It can be renamed easily in case it is confusing.

@vrigal
Copy link
Contributor Author

vrigal commented May 28, 2024

I added support for Learning rate, as discussed during the meeting. Results updated on https://wandb.ai/teklia/534-lt-en.

@eu9ene eu9ene merged commit b20c624 into mozilla:main May 30, 2024
4 checks passed
gabrielBusta pushed a commit that referenced this pull request Jun 13, 2024
* Add missing validation metrics

* Allow validation entries missing stalled value

* Update tests

* Support learning rate

* Update test fixtures for W&B

* Suggestion

---------

Co-authored-by: Evgeny Pavlov <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support extra metrics from Tensorboard
2 participants