Merge branch 'master' of https://github.com/alexis-jacq/Pytorch-DPPO

README.md

@@ -4,7 +4,7 @@ Using PPO with clip loss (from https://arxiv.org/pdf/1707.06347.pdf).
 
 I finally fixed what was wrong with the gradient descent step, using previous log-prob from rollout batches. At least ppo.py is fixed, the rest is going to be corrected as well very soon.
 
-On the following example I was not patient enough to wait for million iterations, I just wanted to check if the model is properly learning:
+In the following example I was not patient enough to wait for million iterations, I just wanted to check if the model is properly learning:
 
 Progress of single PPO:
 -----------------------