Code

Improve experiment stats#1038

Code

Merged

bouthilx merged 43 commits intoEpistimio:developEpistimio/orion:developfrom notoraptor:experiment-progress-bar-backendnotoraptor/orion:experiment-progress-bar-backendCopy head branch name to clipboardDec 19, 2022

+717-41

Commits

Commits on Dec 2, 2022

• Add web api entry to get experiment status.

  notoraptor

  committed
  0f4f079

  Copy full SHA for 0f4f079

• Add a new component ExperimentStatusBar.

  notoraptor

  committed
  066739c

  Copy full SHA for 066739c

• [web api] return trial status in /trial

  notoraptor

  committed
  3b3fabf

  Copy full SHA for 3b3fabf

• [dashboard] Display trial status

  notoraptor

  committed
  5ea026c

  Copy full SHA for 5ea026c

• Fix typo in frontend

  notoraptor

  committed
  15aa04f

  Copy full SHA for 15aa04f

• Reformat code

  notoraptor

  committed
  d091ce3

  Copy full SHA for d091ce3

• Use only executed trials to compute current execution time and whole clock time.

  notoraptor

  committed
  585eb6a

  Copy full SHA for 585eb6a

• Re-use experiment status bar in experiments nav bar

  Show description for c1c722c
  notoraptor

  committed
  c1c722c

  Copy full SHA for c1c722c

• Web API:

  Show description for 88400db
  notoraptor

  committed
  88400db

  Copy full SHA for 88400db

• Add a copy of test DB to be extended with uncompleted experiment.

  notoraptor

  committed
  e43c344

  Copy full SHA for e43c344

• Add uncompleted experiment into new test database.

  notoraptor

  committed
  c762498

  Copy full SHA for c762498

• Rename info

  Show description for a9bea8f
  notoraptor

  committed
  a9bea8f

  Copy full SHA for a9bea8f

• Update script add_uncompleted_experiment:

  Show description for 7f3cd1f
  notoraptor

  committed
  7f3cd1f

  Copy full SHA for 7f3cd1f

• Make bar clickable

  Show description for 401d30a
  notoraptor

  committed
  401d30a

  Copy full SHA for 401d30a

• In script add_uncompleted_experiment, generate experiment UNCOMPLETED_EXPERIMENT from experiment 2-dim-shape-exp.1 read from db_dashboard_full.pkl

  notoraptor

  committed
  3ba9c0d

  Copy full SHA for 3ba9c0d

• [dashboard] In progress bar:

  Show description for fcabfa6
  notoraptor

  committed
  fcabfa6

  Copy full SHA for fcabfa6

• - Add trial.execution_interval to get earliest and latest time of trial execution

  Show description for 2c4e01b
  notoraptor

  committed
  2c4e01b

  Copy full SHA for 2c4e01b

• [dashboard] Display both ETA (esimated remaining duration) and estimated end date.

  Show description for 7c01198
  notoraptor

  committed
  7c01198

  Copy full SHA for 7c01198

• - Add more uncompleted experiments for corner cases related to max_trials

  Show description for 0db2c34
  notoraptor

  committed
  0db2c34

  Copy full SHA for 0db2c34

• Add a color legend for progress bar in database page

  notoraptor

  committed
  216e254

  Copy full SHA for 216e254

Commits on Dec 6, 2022

• [dashboard]

  Show description for 3b84803
  notoraptor

  committed
  3b84803

  Copy full SHA for 3b84803

• Add max_trials and documentation to experiment stats.

  notoraptor

  committed
  041b7a8

  Copy full SHA for 041b7a8

• Handle infinite max_trials in experiment stats

  notoraptor

  committed
  588527a

  Copy full SHA for 588527a

• [dashboard] Display max_trials and additional experiment stats above progress bar

  notoraptor

  committed
  b07db38

  Copy full SHA for b07db38

• Compute progress part and progress using max(nb_trials, max_trials) instead of just nb_trials

  Show description for a79eed5
  notoraptor

  committed
  a79eed5

  Copy full SHA for a79eed5

• Make sure to completely reload experiments pages when selected experiment changes.

  Show description for 5eb5829
  notoraptor

  committed
  5eb5829

  Copy full SHA for 5eb5829

Commits on Dec 8, 2022

• [dashboard] Fix ancien tests.

  notoraptor

  committed
  f45cc84

  Copy full SHA for f45cc84

• Add documentation for new endpoint.

  Show description for e3d513f
  notoraptor

  committed
  e3d513f

  Copy full SHA for e3d513f

• Test new web API entry /experiments/status

  notoraptor

  committed
  077619b

  Copy full SHA for 077619b

• Test that trial status is well returned in web API endpoint /trials/:experiment_name/:trial_id

  notoraptor

  committed
  2ef1dac

  Copy full SHA for 2ef1dac

• Test experiment.stats

  notoraptor

  committed
  64ff509

  Copy full SHA for 64ff509

• Test trial properties execution_time and duration

  notoraptor

  committed
  d09ead9

  Copy full SHA for d09ead9

• Fix pylint

  notoraptor

  committed
  d553a52

  Copy full SHA for d553a52

• Recreate new test DB with uncompleted experiments.

  notoraptor

  committed
  61b89a2

  Copy full SHA for 61b89a2

• Revert dashboard related changes.

  notoraptor

  committed
  bb042f5

  Copy full SHA for bb042f5

• Pass start to sum() as positional argument instead of keyword, to make it work with Python 3.7

  notoraptor

  committed
  ef660f1

  Copy full SHA for ef660f1

• Replace boolean stats check with boolean stats.trials_completed check

  notoraptor

  committed
  8d125df

  Copy full SHA for 8d125df

Commits on Dec 9, 2022

• Add pylint exception too-many-branches to Experiment.stats only.

  Show description for f9f4e8d
  notoraptor

  committed
  f9f4e8d

  Copy full SHA for f9f4e8d

• In ExperimentStats, rename duration -> elapsed_time and whole_clock_time -> sum_of_trials_time

  notoraptor

  committed
  eab42e6

  Copy full SHA for eab42e6

• Move experiment progress in a specific property.

  notoraptor

  committed
  ea16bb6

  Copy full SHA for ea16bb6

• Fix test_coverage_of_access_tests

  notoraptor

  committed
  da60151

  Copy full SHA for da60151

• Do not count broken trials when computing experiment progress.

  notoraptor

  committed
  a28c66b

  Copy full SHA for a28c66b

• Test Trial.duration when end_time is None and heartbeat is available

  notoraptor

  committed
  babbf8b

  Copy full SHA for babbf8b