[Feature Request] Pass all gym Environments in this repo through the env checkers during testing

[tlpss]

🚀 Feature

Both the Gym repo and this repo have an env_checker but currently the environments in this repo (most of them are for testing purposes) are not checked against these checkers. This would help catch faulty implementations of changes in the gym API (e.g. the new render API).

I realise this is actually a test on 'test code' but I think it would help maintaining the tests.

Motivation

No response

Pitch

No response

Alternatives

No response

Additional context

No response

Checklist

• I have checked that there is no similar issue in the repo

[qgallouedec]

I would tend to agree with you.
Have you tested these environments by the way? Are there any bad surprises?
Your contribution is welcome :)

[ReHoss]

Remarks:

• Version of gym used in sb3 is not the latest one.
• sb3 env_checker is more restrictive than the one from gym.

[araffin]

Version of gym used in sb3 is not the latest one.
This would help catch faulty implementations of changes in the gym API (e.g. the new render API).

I think it would make sense to include that in #780
but not before (the gym env checker was derived from SB3 one).

[qgallouedec]

I think it would make sense to include that in #780

If you want to contribute, you can therefore create a PR on this branch https://github.com/carlosluis/stable-baselines3/tree/fix_tests.
I've added it to the check list