Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement Gymnasium-compliant PPO script #320

Merged
merged 43 commits into from
Dec 13, 2022
Merged
Changes from 2 commits
Commits
Show all changes
43 commits
Select commit Hold shift + click to select a range
be6da79
Add Gymnasium and dependencies
dtch1997 Nov 15, 2022
d098870
Implement Gymnasium-compliant PPO script
dtch1997 Nov 15, 2022
aa9ac0c
Ensure pre-commit passes
dtch1997 Nov 15, 2022
cb08637
Fix CI, add a `gymnasium_support` folder
vwxyzjn Nov 15, 2022
5818d7d
update lock files
vwxyzjn Nov 15, 2022
51a7128
add dependencies
vwxyzjn Nov 15, 2022
363b48e
update requirements.txt; fix pre-commit
vwxyzjn Nov 15, 2022
e3174ca
update poetry files
vwxyzjn Nov 15, 2022
8da5f7b
Support dm control action spaces
vwxyzjn Nov 21, 2022
0544fcb
add dm_control support
vwxyzjn Nov 21, 2022
d30f3cf
Enable num_envs>1
dtch1997 Nov 28, 2022
99f7789
Enable auto-install of torch based on CUDA version
dtch1997 Nov 28, 2022
cbd83f6
Fix pre-commit
dtch1997 Nov 28, 2022
8cf18e3
bump torch version
vwxyzjn Dec 10, 2022
fe81b99
bump wandb version
vwxyzjn Dec 10, 2022
dd80937
change key for mujoco_py installation
vwxyzjn Dec 10, 2022
c46f700
update CI
vwxyzjn Dec 10, 2022
0d3a5e1
update docs
vwxyzjn Dec 10, 2022
fa73a60
Merge branch 'gymnasium_ppo' of https://github.com/vwxyzjn/cleanrl in…
vwxyzjn Dec 10, 2022
0381d7a
downgrade torch
vwxyzjn Dec 11, 2022
6582fab
update docs
vwxyzjn Dec 11, 2022
b3f19fd
update teset cases
vwxyzjn Dec 11, 2022
1e904a3
set default env = HalfCheetah-v4
vwxyzjn Dec 11, 2022
3cd9917
directly replace `ppo_continuous_action.py`
vwxyzjn Dec 11, 2022
08f9744
deprecate pybullet dependency in ppo
vwxyzjn Dec 11, 2022
b81d207
remove pybullet test case
vwxyzjn Dec 11, 2022
de3f410
support video recording to wandb
vwxyzjn Dec 11, 2022
1b01a4f
update docs
vwxyzjn Dec 11, 2022
73c0caf
update depdency for test cases
vwxyzjn Dec 11, 2022
3df239a
update test cases and add dm_control tests
vwxyzjn Dec 11, 2022
8a9a467
update docs
vwxyzjn Dec 11, 2022
b56fe05
update mkdocs base
vwxyzjn Dec 11, 2022
7660199
revert doc changes
vwxyzjn Dec 11, 2022
8fd5657
fix dm_control test cases
vwxyzjn Dec 11, 2022
a140a3e
quick docs
vwxyzjn Dec 11, 2022
708cfad
fix tests on CI
vwxyzjn Dec 11, 2022
6a41003
fix test case
vwxyzjn Dec 11, 2022
3efbc24
fix CI
vwxyzjn Dec 12, 2022
0e8df6f
Fix CI
vwxyzjn Dec 12, 2022
19d08d5
update mujoco dependency
vwxyzjn Dec 12, 2022
55f2209
Fix CI
vwxyzjn Dec 12, 2022
7ef728c
fix CI
vwxyzjn Dec 12, 2022
d2b0a79
remote unused seed
vwxyzjn Dec 12, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 7 additions & 7 deletions .github/workflows/tests.yaml
Original file line number Diff line number Diff line change
@@ -134,7 +134,7 @@ jobs:
run: poetry run pytest tests/test_procgen.py


test-mujoco-envs:
test-mujoco_py-envs:
strategy:
fail-fast: false
matrix:
@@ -152,26 +152,26 @@ jobs:
with:
poetry-version: ${{ matrix.poetry-version }}

# mujoco tests
# mujoco_py tests
- name: Install core dependencies
run: poetry install --with pytest
- name: Install pybullet dependencies
run: poetry install --with pybullet
- name: Install mujoco dependencies
run: poetry install --with mujoco
- name: Install mujoco_py dependencies
run: poetry install --with mujoco_py
- name: Install jax dependencies
run: poetry install --with jax
- name: Downgrade setuptools
run: poetry run pip install setuptools==59.5.0
- name: install mujoco dependencies
- name: install mujoco_py dependencies
run: |
sudo apt-get update && sudo apt-get -y install wget unzip software-properties-common \
libgl1-mesa-dev \
libgl1-mesa-glx \
libglew-dev \
libosmesa6-dev patchelf
- name: Run mujoco tests
run: poetry run pytest tests/test_mujoco.py
- name: Run mujoco_py tests
run: poetry run pytest tests/test_mujoco_py.py

test-envpool-envs:
strategy: