-
Notifications
You must be signed in to change notification settings - Fork 266
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
TPU training colab is not working for me #224
Comments
Hi, tried this TPU training colab today, and it fails with this error:
|
Hi @erwincoumans! I'm not able to reproduce the issue, which jax version are you using? |
I'm just running the public colab, following the links on the github front page. Did you try training it using a public TPU runtime? The other public colab (training using PyTorch) is also still broken, see the other issue. https://colab.research.google.com/github/google/brax/blob/main/notebooks/training.ipynb Just tried it again, here is the output:
|
Ok thanks for the pointer! It turns out that jax>=0.4.6 is incompatible with public colab TPU runtimes (see https://stackoverflow.com/a/75734517). We're pinning the jax/jaxlib versions to >=0.4.6 now, so it's best to run in a GPU runtime for the time being until the colab issue is fixed |
TPU training colab stopped working for me after one of the updates in recent months. It stalls when comes to the training cell it shows that some work is going on but it never finishes, and no plots and trained policies are produced.
The text was updated successfully, but these errors were encountered: