Visualising Multiple Episodes

[cemlyn007]

Hey 👋,

In the above picture, I am visualising multiple episodes as if it was a single episode so that I can see how my agent performs as it went through training. Is this something you would like to see more of?

I take a single environment, multiple episodes and merge all of the episodes into a single episode by merging the QPs together and duplicating the environment brax.Config.

Note that my implementation has been tested with the io.image and io.html modules.

Attached is a link to a html version: view.

[erikfrey]

This is awesome! We are going to soon release a significant update to brax along with some new visualizer code, but it doesn't include this functionality. I'm going to leave this discussion open and check back in with you after the release. We'd love to support something like this.