From f19b5123223dde2aed0c2da5d3baaf95279c754e Mon Sep 17 00:00:00 2001 From: David de la Iglesia Castro Date: Mon, 25 Oct 2021 22:12:08 +0200 Subject: [PATCH 1/8] Added `--only-changed` option --- content/docs/command-reference/exp/show.md | 19 +++++++++++++++++++ 1 file changed, 19 insertions(+) diff --git a/content/docs/command-reference/exp/show.md b/content/docs/command-reference/exp/show.md index 14489cc70a..b9f60de037 100644 --- a/content/docs/command-reference/exp/show.md +++ b/content/docs/command-reference/exp/show.md @@ -15,6 +15,7 @@ usage: dvc exp show [-h] [-q | -v] [-a] [-T] [-A] [-n ] [--sort-by ] [--sort-order {asc,desc}] [--no-timestamp] [--sha] [--json] [--csv] [--md] [--precision ] + [--only-changed] ``` ## Description @@ -73,6 +74,9 @@ metric or param. - `--param-deps` - include only parameters that are stage dependencies. +- `--only-changed` - Only show metrics/params with values varying across + the selected experiments. + - `--include-params ` - show the specified `dvc params` in the table only. Accepts a comma-separated `list` of param names. Shell style wildcards supported: `*`, `?`, `[seq]`, `[!seq]`, and `**` If a `path:` prefix is @@ -171,6 +175,21 @@ $ dvc exp show --include-params=featurize └───────────────────────┴──────────────┴─────────┴────────────────────────┴──────────────────┘ ``` +You can also filter out the metrics and parameters that didn't change: + +```dvc +$ dvc exp show --only-changed +┏━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━┓ +┃ Experiment ┃ Created ┃ auc ┃ featurize.max_features ┃ +┡━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━┩ +│ workspace │ - │ 0.61314 │ 1500 │ +│ 10-bigrams-experiment │ Jun 20, 2020 │ 0.61314 │ 1500 │ +│ ├── exp-e6c97 │ Oct 21, 2020 │ 0.61314 │ 1500 │ +│ ├── exp-1dad0 │ Oct 09, 2020 │ 0.57756 │ 2000 │ +│ └── exp-1df77 │ Oct 09, 2020 │ 0.51676 │ 500 │ +└───────────────────────┴──────────────┴─────────┴────────────────────────┘ +``` + Sort experiments by the `auc` metric, in ascending order: ```dvc From eedf0ef5aefe3738460359d2bd1380e95e60a544 Mon Sep 17 00:00:00 2001 From: David de la Iglesia Castro Date: Mon, 25 Oct 2021 22:12:18 +0200 Subject: [PATCH 2/8] format --- content/docs/command-reference/exp/show.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/content/docs/command-reference/exp/show.md b/content/docs/command-reference/exp/show.md index b9f60de037..706f4b49d4 100644 --- a/content/docs/command-reference/exp/show.md +++ b/content/docs/command-reference/exp/show.md @@ -74,8 +74,8 @@ metric or param. - `--param-deps` - include only parameters that are stage dependencies. -- `--only-changed` - Only show metrics/params with values varying across - the selected experiments. +- `--only-changed` - Only show metrics/params with values varying across the + selected experiments. - `--include-params ` - show the specified `dvc params` in the table only. Accepts a comma-separated `list` of param names. Shell style wildcards From 61650c7c075e332196899985c60eaffc2c218165 Mon Sep 17 00:00:00 2001 From: David de la Iglesia Castro Date: Wed, 27 Oct 2021 14:55:59 +0200 Subject: [PATCH 3/8] Update content/docs/command-reference/exp/show.md Co-authored-by: Dave Berenbaum --- content/docs/command-reference/exp/show.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/content/docs/command-reference/exp/show.md b/content/docs/command-reference/exp/show.md index 706f4b49d4..25078cd364 100644 --- a/content/docs/command-reference/exp/show.md +++ b/content/docs/command-reference/exp/show.md @@ -175,7 +175,8 @@ $ dvc exp show --include-params=featurize └───────────────────────┴──────────────┴─────────┴────────────────────────┴──────────────────┘ ``` -You can also filter out the metrics and parameters that didn't change: +You can also filter out the metrics and parameters that are the same +across the shown experiments: ```dvc $ dvc exp show --only-changed From a82101de91815d25592a0b8572fbc3a85a8a8ca6 Mon Sep 17 00:00:00 2001 From: "restyled-io[bot]" <32688539+restyled-io[bot]@users.noreply.github.com> Date: Wed, 27 Oct 2021 14:56:48 +0200 Subject: [PATCH 4/8] Restyled by prettier (#2976) Co-authored-by: Restyled.io --- content/docs/command-reference/exp/show.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/content/docs/command-reference/exp/show.md b/content/docs/command-reference/exp/show.md index 25078cd364..36954c9308 100644 --- a/content/docs/command-reference/exp/show.md +++ b/content/docs/command-reference/exp/show.md @@ -175,8 +175,8 @@ $ dvc exp show --include-params=featurize └───────────────────────┴──────────────┴─────────┴────────────────────────┴──────────────────┘ ``` -You can also filter out the metrics and parameters that are the same -across the shown experiments: +You can also filter out the metrics and parameters that are the same across the +shown experiments: ```dvc $ dvc exp show --only-changed From 2b62cd2a1d58a96914c83058f6525e13ef988ca5 Mon Sep 17 00:00:00 2001 From: David de la Iglesia Castro Date: Wed, 27 Oct 2021 19:35:46 +0200 Subject: [PATCH 5/8] Added note about `--include` interaction --- content/docs/command-reference/exp/show.md | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/content/docs/command-reference/exp/show.md b/content/docs/command-reference/exp/show.md index 36954c9308..571de9c391 100644 --- a/content/docs/command-reference/exp/show.md +++ b/content/docs/command-reference/exp/show.md @@ -75,7 +75,11 @@ metric or param. - `--param-deps` - include only parameters that are stage dependencies. - `--only-changed` - Only show metrics/params with values varying across the - selected experiments. + selected experiments. When used along with + `--include-params`/`--include-metrics`, this option prevails over the specific + values passed to those options. For example, given + `--only-changed --include-params=foo`, if `foo` doesn't vary across the + selected experiments, it won't be shown in the final table. - `--include-params ` - show the specified `dvc params` in the table only. Accepts a comma-separated `list` of param names. Shell style wildcards From aff4eb045ab19707f19a4267aa3d46f593990ae8 Mon Sep 17 00:00:00 2001 From: David de la Iglesia Castro Date: Wed, 27 Oct 2021 19:38:24 +0200 Subject: [PATCH 6/8] Added specific names --- content/docs/command-reference/exp/show.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/content/docs/command-reference/exp/show.md b/content/docs/command-reference/exp/show.md index 571de9c391..09ce966c32 100644 --- a/content/docs/command-reference/exp/show.md +++ b/content/docs/command-reference/exp/show.md @@ -76,8 +76,8 @@ metric or param. - `--only-changed` - Only show metrics/params with values varying across the selected experiments. When used along with - `--include-params`/`--include-metrics`, this option prevails over the specific - values passed to those options. For example, given + `--include-params`/`--include-metrics`, `--only-changed` prevails over the + specific values passed to `--include`. For example, given `--only-changed --include-params=foo`, if `foo` doesn't vary across the selected experiments, it won't be shown in the final table. From 28a240fc523a504a20d9d6c3e9661d5e29a573aa Mon Sep 17 00:00:00 2001 From: David de la Iglesia Castro Date: Wed, 3 Nov 2021 09:33:30 +0100 Subject: [PATCH 7/8] Apply suggestions from code review Co-authored-by: Jorge Orpinel --- content/docs/command-reference/exp/show.md | 13 ++++++------- 1 file changed, 6 insertions(+), 7 deletions(-) diff --git a/content/docs/command-reference/exp/show.md b/content/docs/command-reference/exp/show.md index 09ce966c32..8164f49ae5 100644 --- a/content/docs/command-reference/exp/show.md +++ b/content/docs/command-reference/exp/show.md @@ -74,12 +74,11 @@ metric or param. - `--param-deps` - include only parameters that are stage dependencies. -- `--only-changed` - Only show metrics/params with values varying across the - selected experiments. When used along with - `--include-params`/`--include-metrics`, `--only-changed` prevails over the - specific values passed to `--include`. For example, given - `--only-changed --include-params=foo`, if `foo` doesn't vary across the - selected experiments, it won't be shown in the final table. +- `--only-changed` - show only parameters and metrics with values that vary + across experiments. Note that this option takes precedence over + `--include-params` and `--include-metrics`, for example given + `--include-params=foo --only-changed`, param `foo` would still be hidden + if its value is the same in all experiments. - `--include-params ` - show the specified `dvc params` in the table only. Accepts a comma-separated `list` of param names. Shell style wildcards @@ -179,7 +178,7 @@ $ dvc exp show --include-params=featurize └───────────────────────┴──────────────┴─────────┴────────────────────────┴──────────────────┘ ``` -You can also filter out the metrics and parameters that are the same across the +You can also filter out any metrics and parameters that do not change across the shown experiments: ```dvc From 5f5502acadd53a5c24b96d23bda70a05a61564e1 Mon Sep 17 00:00:00 2001 From: "restyled-io[bot]" <32688539+restyled-io[bot]@users.noreply.github.com> Date: Wed, 3 Nov 2021 09:34:28 +0100 Subject: [PATCH 8/8] Restyled by prettier (#2996) Co-authored-by: Restyled.io --- content/docs/command-reference/exp/show.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/content/docs/command-reference/exp/show.md b/content/docs/command-reference/exp/show.md index 8164f49ae5..b8935095cb 100644 --- a/content/docs/command-reference/exp/show.md +++ b/content/docs/command-reference/exp/show.md @@ -77,8 +77,8 @@ metric or param. - `--only-changed` - show only parameters and metrics with values that vary across experiments. Note that this option takes precedence over `--include-params` and `--include-metrics`, for example given - `--include-params=foo --only-changed`, param `foo` would still be hidden - if its value is the same in all experiments. + `--include-params=foo --only-changed`, param `foo` would still be hidden if + its value is the same in all experiments. - `--include-params ` - show the specified `dvc params` in the table only. Accepts a comma-separated `list` of param names. Shell style wildcards