Keeping agents in osm map during episode

[nicofirst1]

Feature Description

I'm currently using flow to train a MAS system with MADDPG algorithm (here). During the sampling I get this error which is due to the RL agents being removed during the episode.
Since I'm using an imported OSM map neither the MinicityRouter nor the _reroute_if_final_edge are working to prevent the Agents to be deleted from the map.

It would be nice to have a method for doing this on OSM maps too.

[eugenevinitsky]

Hi @nicofirst1, in terms of a quick fix, would it work to have an inflow of vehicles in your system or do you need there to be a fixed number of vehicles in your system at all times? If the latter, we can push a fix to add such an option to OSM maps.

[nicofirst1]

Unfortunately I need to have a fixed number of RL vehicles during the episode.

[eugenevinitsky]

I see. Would it be sufficient to just check if the edge is the final edge in your list of routes and return it to the first element in the route?

[nicofirst1]

Yes, as long as I have a constant number of agents during the episode.

[nicofirst1]

Any update on this?

[eugenevinitsky]

Yep! It'll take a bit longer to get it merged in (need to write unit tests for it) but I've opened a PR #759 that gives an example of how you might do this. Hope that helps!

[eugenevinitsky]

Hi, I'm closing this for now. Hoping your project got finished up alright!