Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to reproduce results of Antmaze in Table 8 #4

Open
Penguin0007 opened this issue Sep 5, 2024 · 0 comments
Open

Unable to reproduce results of Antmaze in Table 8 #4

Penguin0007 opened this issue Sep 5, 2024 · 0 comments

Comments

@Penguin0007
Copy link

Hi! I have the same question as a previously closed issue. I wasn't able to reproduce results for Antmaze tasks in Table 8. I made the following adjustments in run_experiments.sh, 1. change envs to Antmaze; 2. make normalize False. The .sh file looks like this:

envs=("antmaze-umaze-v0"
"antmaze-umaze-diverse-v0"......)
for ((i=0;i<5;i+=1))
do
for env in ${envs[*]}
do
python main.py
--env $env
--normalize False
--seed $i
done
done

But the normalized scores for last final 10 evaluations and 5 seeds are much lower than the numbers provided in Table 8 inl paper. What's going wrong here? Is there other places I should modify? It would be great to provide how to reproduce Antmaze results. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant