sigcomm camera ready

LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) [2017] [Pensieve]
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

README.md

@@ -0,0 +1,39 @@
+# Pensieve
+Pensieve is a system that generates adaptive bitrate algorithms using reinforcement learning.
+http://web.mit.edu/pensieve/
+
+### Prerequisites
+- Install prerequisites (tested with Ubuntu 16.04, Tensorflow v1.1.0, TFLearn v0.3.1 and Selenium v2.39.0)
+```
+python setup.py
+```
+
+### Training
+- To train a new model, put training data in `sim/cooked_traces` and testing data in `sim/cooked_test_traces`, then in `sim/` run `python get_video_sizes.py` and then run
+```
+python multi_agent.py
+```
+
+The reward signal and meta-setting of video can be modified in `multi_agent.py` and `env.py`. More details can be found in `sim/README.md`.
+
+### Testing
+- To test the trained model in simulated environment, first copy over the model to `test/models` and modify the `NN_MODEL` field of `test/rl_no_training.py` , and then in `test/` run `python get_video_sizes.py` and then run 
+```
+python rl_no_training.py
+```
+
+Similar testing can be performed for buffer-based approach (`bb.py`), mpc (`mpc.py`) and offline-optimal (`dp.cc`) in simulations. More details can be found in `test/README.md`.
+
+### Running experiments over Mahimahi
+- To run experiments over mahimahi emulated network, first copy over the trained model to `rl_server/results` and modify the `NN_MODEL` filed of `rl_server/rl_server_no_training.py`, and then in `run_exp/` run
+```
+python run_all_traces.py
+```
+This script will run all schemes (buffer-based, rate-based, Festive, BOLA, fastMPC, robustMPC and Pensieve) over all network traces stored in `cooked_traces/`. The results will be saved to `run_exp/results` folder. More details can be found in `run_exp/README.md`.
+
+### Real-world experiments
+- To run real-world experiments, first setup a server (`setup.py` automatically installs an apache server and put needed files in `/var/www/html`). Then, copy over the trained model to `rl_server/results` and modify the `NN_MODEL` filed of `rl_server/rl_server_no_training.py`. Next, modify the `url` field in `real_exp/run_video.py` to the server url. Finally, in `real_exp/` run
+```
+python run_exp.py
+```
+The results will be saved to `real_exp/results` folder. More details can be found in `real_exp/README.md`.

abr_browser_dir/chrome_data_dir/Default/Extension Rules/CURRENT

@@ -0,0 +1 @@
+MANIFEST-000001

abr_browser_dir/chrome_data_dir/Default/Extension Rules/LOG

@@ -0,0 +1 @@
+2016/12/28-14:37:23.971 2452 Reusing MANIFEST /home/hongzi/abr-dir/Default/Extension Rules/MANIFEST-000001

abr_browser_dir/chrome_data_dir/Default/Extension State/CURRENT

@@ -0,0 +1 @@
+MANIFEST-000001

abr_browser_dir/chrome_data_dir/Default/Extension State/LOG

@@ -0,0 +1 @@
+2016/12/28-14:37:22.570 2452 Reusing MANIFEST /home/hongzi/abr-dir/Default/Extension State/MANIFEST-000001

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/ar/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "إنشاء عروض تقديمية وتحريرها"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "عروض Google التقديمية"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/bg/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Създавайте и редактирайте презентации"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Google Презентации"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/ca/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Creeu i editeu presentacions"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Presentacions de Google "
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/cs/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Vytvářejte a upravujte prezentace"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Prezentace Google"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/da/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Opret og rediger præsentationer"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Google Præsentation"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/de/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Präsentationen erstellen und bearbeiten"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Google Präsentationen"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/el/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Δημιουργία και επεξεργασία παρουσιάσεων"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Διαφάνειες Google"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/en_GB/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Create and edit presentations"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Google Slides"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/en_US/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Create and edit presentations "
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Google Slides"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/es/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Crea y edita presentaciones"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Presentaciones de Google"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/es_419/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Crea y edita presentaciones"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Diapositivas de Google"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/et/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Looge ja muutke esitlusi"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Google'i esitlused"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/fi/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Luo ja muokkaa esityksiä"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Google-presentaatiot"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/fil/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Lumikha at mag-edit ng mga presentation"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Google Slides"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/fr/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Créez et modifiez des présentations"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Google Slides"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/he/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "יצירת מצגות ועריכתן"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Google מצגות"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/hi/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "प्रस्तुतियां बनाएं और संपादित करें"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Google स्लाइड"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/hu/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Prezentációk létrehozása és szerkesztése"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Google Diák"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/id/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Buat dan edit presentasi"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Google Slide"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/it/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Crea e modifica presentazioni"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Presentazioni Google"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/ja/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "プレゼンテーションの作成と編集"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Google スライド"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/ko/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "프리젠테이션 만들기 및 수정"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Google 슬라이드"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/lt/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Kurkite ir redaguokite pristatymus"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "„Google“ skaidrės"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/lv/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Veidojiet un rediģējiet prezentācijas"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Google prezentācijas"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/ms/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Buat dan edit pembentangan"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Slaid Google"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/nl/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Presentaties maken en bewerken"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Google Presentaties"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/no/messages.json

@@ -0,0 +1,10 @@
+{
+  "appName": {
+    "message": "Google Presentasjoner",
+    "description": "App name."
+  },
+  "appDesc": {
+    "message": "Opprett og rediger presentasjoner",
+    "description": "App description."
+  }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/pl/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Twórz i edytuj prezentacje"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Prezentacje Google"
+   }
+}

abr_browser_dir/chrome_data_dir/Default/Extensions/aapocclcgogkmnckokdopfmhonfmgoek/0.9_0/_locales/pt_BR/messages.json

@@ -0,0 +1,10 @@
+{
+   "appDesc": {
+      "description": "App description.",
+      "message": "Crie e edite apresentações"
+   },
+   "appName": {
+      "description": "App name.",
+      "message": "Google Apresentações"
+   }
+}