Skip to content

Commit

Permalink
Upgrading docs
Browse files Browse the repository at this point in the history
Signed-off-by: Alan Clucas <[email protected]>
  • Loading branch information
Joibel committed Jun 24, 2024
1 parent 41efbd7 commit 7107b2c
Show file tree
Hide file tree
Showing 5 changed files with 60 additions and 60 deletions.
1 change: 1 addition & 0 deletions .spelling
Original file line number Diff line number Diff line change
Expand Up @@ -205,6 +205,7 @@ sandboxed
shortcodes
stateful
stderr
temporality
triaged
un-reconciled
v1
Expand Down
58 changes: 0 additions & 58 deletions docs/metrics-3.6.md

This file was deleted.

2 changes: 1 addition & 1 deletion docs/metrics.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
> v2.7 and after
!!! Metrics changes in 3.6
Please read [this](metrics-3.6.md) short guide on what you must consider when upgrading to 3.6.
Please read [this short guide](upgrading.md#metrics_changes) on what you must consider when upgrading to 3.6.

## Introduction

Expand Down
58 changes: 58 additions & 0 deletions docs/upgrading.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,64 @@ Previously it was `--basehref` (no dash in between) and `ARGO_BASEHREF` (no unde
`ALLOWED_LINK_PROTOCOL` and `BASE_HREF` have been removed as redundant.
Use `ARGO_ALLOWED_LINK_PROTOCOL` and `ARGO_BASE_HREF` instead.

### Metrics changes

You can now retrieve metrics using the OpenTelemetry Protocol using the [OpenTelemetry collector](https://opentelemetry.io/docs/collector/), and this is the recommended mechanism.

These notes explain the differences in using the Prometheus `/metrics` endpoint to scrape metrics for a minimal effort upgrade. It is not recommended you follow this guide blindly, the new metrics have been introduced because they add value, and so they should be worth collecting and using.

#### New metrics

The following are new metrics:

* `build_info`
* `controller_build_info`
* `cronworkflows_triggered_total`
* `k8s_request_duration`
* `leader`
* `pods_total_count`
* `pod_pending_count`
* `queue_duration`
* `queue_longest_running`
* `queue_retries`
* `queue_unfinished_work`
* `total_count`
* `workflowtemplate_runtime`
* `workflowtemplate_triggered_total`

and can be disabled with

```yaml
metricsConfig: |
modifiers:
build_info:
disable: true
...
```

#### Renamed metrics

If you are using these metrics in your recording rules, dashboards, or alerts, you will need to update their names after the upgrade:

| Old name | New name |
|------------------------------------|------------------------------------|
| `argo_workflows_count` | `argo_workflows_gauge` |
| `argo_workflows_pods_count` | `argo_workflows_pods_gauge` |
| `argo_workflows_queue_depth_count` | `argo_workflows_queue_depth_gauge` |
| `log_messages` | `argo_workflows_log_messages` |

#### Custom metrics

Custom metric names and labels must be valid Prometheus and OpenTelemetry names now. This prevents the use of `:`, which was usable in earlier versions of workflows

Custom metrics, as defined by a workflow, could be defined as one type (say counter) in one workflow, and then as a histogram of the same name in a different workflow. This would work in 3.5 if the first usage of the metric had reached TTL and been deleted. This will no-longer work in 3.6, and custom metrics may not be redefined. It doesn't really make sense to change a metric in this way, and the OpenTelemetry SDK prevents you from doing so.

#### TLS

The Prometheus `/metrics` endpoint now has TLS enabled by default.

To disable this set `metricsConfig.secure` to `false`.

## Upgrading to v3.5

There are no known breaking changes in this release. Please file an issue if you encounter any unexpected problems after upgrading.
Expand Down
1 change: 0 additions & 1 deletion mkdocs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -248,7 +248,6 @@ nav:
- offloading-large-workflows.md
- workflow-archive.md
- metrics.md
- metrics-3.6.md
- workflow-executors.md
- workflow-restrictions.md
- sidecar-injection.md
Expand Down

0 comments on commit 7107b2c

Please sign in to comment.