Code

Network update#953

Code

Merged

eugenevinitsky merged 99 commits intoi210_devflow-project/flow:i210_devfrom network_updateflow-project/flow:network_updateCopy head branch name to clipboardMay 28, 2020

+7,550-284

Commits

Commits on Mar 28, 2020

• Added QMIX but its hella slow right now

  eugenevinitsky

  committed
  2c85838

• Speedup

  eugenevinitsky

  committed
  ea470a3

• Replace QMIX reward w global reward

  eugenevinitsky

  committed
  58f357c

• Disable RNN

  eugenevinitsky

  committed
  99f6c09

Commits on Mar 29, 2020

• Add an option for a local reward that just computes speed of the AV and its follower

  eugenevinitsky

  committed
  942fe56

• Merge branch 'i210_dev_fix' into i210_qmix

  eugenevinitsky

  committed
  562bb0f

Commits on Apr 6, 2020

• Make speed square of rewards

  eugenevinitsky

  committed
  5c165fe

Commits on Apr 7, 2020

• Add QMIX and MADDPG

  eugenevinitsky

  committed
  29d16bb

• Turn on RNN

  eugenevinitsky

  committed
  0edfec6

• Increase inflow in i210 subnetwork

  eugenevinitsky

  committed
  9d6344f

Commits on Apr 9, 2020

• Merge pull request #880 from flow-project/time_space_fixes

  Show description for 7ed7377
  kjang96

  authored
  7ed7377

Commits on Apr 21, 2020

• moved imports under functions in train.py (#903)

  Show description for 95e63a8
  

  chendiw

  and

  AboudyKreidieh

  authored
  95e63a8

Commits on Apr 30, 2020

• Add option to reroute exiting vehicles back into the network

  eugenevinitsky

  committed
  f3e7ce8

• Change the position at which vehicles are rerouted so tall the vehicles are immediately put back

  eugenevinitsky

  committed
  3600357

Commits on May 2, 2020

• Bando / ghost edge (#917)

  Show description for 86761a6
  AboudyKreidieh

  authored
  86761a6

Commits on May 3, 2020

• Add single agent case

  eugenevinitsky

  committed
  fe05dcd

Commits on May 4, 2020

• Benchmark fix (#919)

  Show description for a26c9b7
  eugenevinitsky

  authored
  a26c9b7

Commits on May 8, 2020

• get not departed vehicles (#922)

  Show description for 50be2d0
  

  Yasharzf

  and

  AboudyKreidieh

  authored
  50be2d0

• Address comments

  eugenevinitsky

  committed
  72f8459

• Merge branch 'i210_dev' of github.com:flow-project/flow into rerouting

  eugenevinitsky

  committed
  304fcfc

• Pydoc style

  eugenevinitsky

  committed
  b80d441

Commits on May 9, 2020

• Merge branch 'i210_qmix' into flow_maddpg

  eugenevinitsky

  committed
  a93bf29

• changed _departed_ids, and _arrived_ids in the update function (#926)

  Show description for 7398f50
  Yasharzf

  authored
  7398f50

• MADDPG is running but not training

  eugenevinitsky

  committed
  6c1ef8a

Commits on May 10, 2020

• Minor

  eugenevinitsky

  committed
  73fe421

• But what if we just catch and ignore the exception

  eugenevinitsky

  committed
  ff2ca54

• Merge branch 'master' of github.com:flow-project/flow into flow_maddpg

  eugenevinitsky

  committed
  7d0dafa

• Minor change to AMI to get sUMO version 1.1.0

  eugenevinitsky

  committed
  adfde0e

• Add MPG reward

  eugenevinitsky

  committed
  0556175

• Commit for local reward tests

  eugenevinitsky

  committed
  1861051

Commits on May 11, 2020

• Add a centralized critic

  eugenevinitsky

  committed
  2cd6329

• Add curricula over speed and headway

  eugenevinitsky

  committed
  9a2a4a6

• add timing, remove adaptive KL from PPO

  eugenevinitsky

  committed
  f1abcfe

• Minor fixes to KL

  eugenevinitsky

  committed
  f9e573d

• switch back to old AMI for testing purposes

  eugenevinitsky

  committed
  5605ec2

• Disable custom PPO for a sec

  eugenevinitsky

  committed
  e5437d3

Commits on May 12, 2020

• Minor changes to centralized PPO to upgrade it to 0.9.0

  eugenevinitsky

  committed
  083aaee

• Visuallizer rllib fixes for centralized PPO

  eugenevinitsky

  committed
  ba3210f

• Add the ability to look back in the platoon for the MPG reward

  eugenevinitsky

  committed
  3f4da91

Commits on May 13, 2020

• Minor

  eugenevinitsky

  committed
  ad694c5

• Add MPG reward

  eugenevinitsky

  committed
  429df10

• Merge branch 'i210_dev' into mpg_reward2

  eugenevinitsky

  committed
  da5c054

• Flake8

  eugenevinitsky

  committed
  76707c1

• Minor

  eugenevinitsky

  committed
  4b615b4

Commits on May 14, 2020

• Minor

  eugenevinitsky

  committed
  ac8e206

• Flake8

  eugenevinitsky

  committed
  2f823d8

• Pydoc style

  eugenevinitsky

  committed
  91f1498

• Merge branch 'mpg_reward' into mpg_reward2

  eugenevinitsky

  committed
  c783b09

• Minor

  eugenevinitsky

  committed
  44d682c

• Fix none condition handling

  eugenevinitsky

  committed
  1b3172e

• Merge branch 'mpg_reward' into mpg_reward2

  eugenevinitsky

  committed
  01cf922

• Minor

  eugenevinitsky

  committed
  6d37f15

Commits on May 15, 2020

• Downgrade to 0.8.0

  eugenevinitsky

  committed
  12c0f36

• Merge branch 'mpg_reward2' into flow_maddpg

  eugenevinitsky

  committed
  d3e45b0

Commits on May 16, 2020

• removed sweep

  AboudyKreidieh

  committed
  de4b21d

• added updated single lane highway network config

  AboudyKreidieh

  committed
  62afe9c

• added i210 xml files with downstream edge

  AboudyKreidieh

  committed
  b52d90a

• added I210Router

  AboudyKreidieh

  committed
  c370460

• added updated i210 features

  AboudyKreidieh

  committed
  4525a7a

• minor cleanup

  AboudyKreidieh

  committed
  ed8506a

Commits on May 18, 2020

• better parameters based on when congestion propagates

  AboudyKreidieh

  committed
  6c90517

• bug fixes

  AboudyKreidieh

  committed
  be0eb25

• bug fixes

  AboudyKreidieh

  committed
  bdcfb96

• Merge branch 'i210-highway-updated' of https://github.com/flow-project/flow into i210-highway-updated

  AboudyKreidieh

  committed
  34acd0b

• more bug fixes

  AboudyKreidieh

  committed
  2892a80

• Add MPG reward (#931)

  Show description for 3154f26
  eugenevinitsky

  authored
  3154f26

• Fix gain on MPG

  eugenevinitsky

  committed
  c7567b6

Commits on May 19, 2020

• Merge straight road changes to multiagent straight road

  eugenevinitsky

  committed
  ba892f3

• Merge branch 'i210_dev' of github.com:flow-project/flow into ev_i210_highway_updated

  eugenevinitsky

  committed
  20c24ed

• Merge branch 'ev_i210_highway_updated' into flow_maddpg

  eugenevinitsky

  committed
  c331817

Commits on May 20, 2020

• Add ability to control which lengths the control is applied on

  eugenevinitsky

  committed
  00f114c

Commits on May 21, 2020

• Move training iterations

  eugenevinitsky

  committed
  231f04f

• Turn off mpj reward

  eugenevinitsky

  committed
  c5a251e

• Minorg

  eugenevinitsky

  committed
  5fb28b8

• Updated ray_autoscale and requirements.txt

  kjang96

  committed
  a524f4d

• Reverted to original master's ray_autoscale.yaml and added 2 lines

  kjang96

  committed
  7f782b8

• MPG w/ curriculum test

  eugenevinitsky

  committed
  1895c4f

Commits on May 22, 2020

• Add stop penalty

  eugenevinitsky

  committed
  7772dfe

• Add accel_penalty

  eugenevinitsky

  committed
  5c79a8a

• Address MacOS Catalina SegFault issue when running sumo-gui (#938)

  cybermaster

  authored
  2232861

• Merge pull request #941 from flow-project/slowdown_master

  Show description for 1e211cb
  kjang96

  authored
  1e211cb

Commits on May 24, 2020

• Fix to space time diagram to update to new highway network

  eugenevinitsky

  committed
  45a8e0a

• Import georges I210 fixes

  eugenevinitsky

  committed
  cf579bf

• Merge branch 'ev/george_fixes' into flow_maddpg

  eugenevinitsky

  committed
  a43bf81

Commits on May 26, 2020

• Add ghost cell template with correct priorities

  eugenevinitsky

  committed
  9a5b532

• Update I210 to new model

  eugenevinitsky

  committed
  e6f7ef8

• Add missing file

  eugenevinitsky

  committed
  2dfffc6

Commits on May 27, 2020

• Merge branch 'master' of github.com:flow-project/flow into flow_maddpg

  eugenevinitsky

  committed
  ce5710f

• Add handling of too many vehicles trying to reroute at once

  eugenevinitsky

  committed
  e400a38

• Minor

  eugenevinitsky

  committed
  3d95f2d

• Shorten curriculum iters

  eugenevinitsky

  committed
  d4b76b1

• Put back long curriculum

  eugenevinitsky

  committed
  72eda14

• Remove MADDPG, QMIX

  eugenevinitsky

  committed
  ca6a567

• Merge branch 'i210_dev' into network_update

  eugenevinitsky

  authored
  82a29fc

Commits on May 28, 2020

• Address comments

  eugenevinitsky

  committed
  bbb16ff

• Merge branch 'network_update' of github.com:flow-project/flow into network_update

  eugenevinitsky

  committed
  c311bf5

• Remove clipping so failsafes can be applied

  eugenevinitsky

  committed
  bb37992

• Fix imports

  eugenevinitsky

  committed
  c6949bc

• Fix on-ramp code

  eugenevinitsky

  committed
  3dd87d0