Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Proposal] Add support for multi-agent environments #235

Open
pseudo-rnd-thoughts opened this issue Sep 10, 2022 · 5 comments
Open

[Proposal] Add support for multi-agent environments #235

pseudo-rnd-thoughts opened this issue Sep 10, 2022 · 5 comments

Comments

@pseudo-rnd-thoughts
Copy link
Member

It would be nice to add gridworld based multi-agent environments.
These are could be used for reserach into RL safety, explainability, emergent communication, etc

If there is anyone who has already create MA environments or is interested in working on this problem then please respond

@ygrayson
Copy link

Check out this: #37

@pseudo-rnd-thoughts
Copy link
Member Author

Wow, thanks for pointing that out.
As the project is Apache 2.0, we should be able to move the code to Minigrid to allow more users to use it.
I haven't looked at the code but we might want to shift the project to use PettingZoo rather than Gym/Gymnasium as it is multi-agent rather than single agent.

@ini
Copy link

ini commented Jun 9, 2023

Here's a fork with multi-agent support: https://github.com/ini/multigrid

It follows the RLlib MultiAgent / PettingZoo ParallelEnv API.

@pseudo-rnd-thoughts
Copy link
Member Author

Amazing, thanks for doing that.
Could you be interested in merging this into minigrid itself?

@ini
Copy link

ini commented Jun 9, 2023

I'm not sure how simple that would be. While the external interface is supposed to be the same as minigrid, there are some significant changes under the hood for speed optimizations (i.e WorldObj and Grid are represented with numpy arrays, and the partial observation logic uses numba.)

Also, it only supports Python 3.9+.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants