Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Alerting: Clear alerting rule evaluation errors after intermittent failures #42386

Merged
merged 2 commits into from
Nov 26, 2021

Conversation

gotjosh
Copy link
Contributor

@gotjosh gotjosh commented Nov 26, 2021

When an alert transitioned in a way that alerting -> error -> (alerting|nodata), the error provided by the error state would never be cleared thus the API and UI would show the health as an error.

…ilures

When an alert transitioned in a way that `alerting -> error -> (alerting|nodata)`, the error provided by the `error` state would never be cleared thus the API and UI would show the health as an error.
@gotjosh gotjosh requested a review from a team as a code owner November 26, 2021 17:15
@gotjosh gotjosh requested review from JohnnyQQQQ, davidmparrott and santihernandezc and removed request for a team November 26, 2021 17:15
@gotjosh gotjosh added add to changelog backport v8.3.x Mark PR for automatic backport to v8.3.x type/bug labels Nov 26, 2021
@gotjosh gotjosh modified the milestones: 8.3.0-beta2, 8.3.0 Nov 26, 2021
@@ -118,6 +121,8 @@ func (a *State) resultError(alertRule *ngModels.AlertRule, result eval.Result) {
}

func (a *State) resultNoData(alertRule *ngModels.AlertRule, result eval.Result) {
a.Error = result.Error
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The issue was originally reported and found in the Alerting state but I realised that this would also happen when the data is noData.

Copy link
Member

@JohnnyQQQQ JohnnyQQQQ left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@gotjosh gotjosh merged commit dd5a2e5 into main Nov 26, 2021
@gotjosh gotjosh deleted the clear-errors-after-sucessful-eval branch November 26, 2021 17:58
grafanabot pushed a commit that referenced this pull request Nov 26, 2021
…ilures (#42386)

* Alerting: Clear alerting rule evaluation errors after intermittent failures

When an alert transitioned in a way that `alerting -> error -> (alerting|nodata)`, the error provided by the `error` state would never be cleared thus the API and UI would show the health as an error.

(cherry picked from commit dd5a2e5)
gotjosh added a commit that referenced this pull request Nov 26, 2021
…ilures (#42386) (#42391)

* Alerting: Clear alerting rule evaluation errors after intermittent failures

When an alert transitioned in a way that `alerting -> error -> (alerting|nodata)`, the error provided by the `error` state would never be cleared thus the API and UI would show the health as an error.

(cherry picked from commit dd5a2e5)

Co-authored-by: gotjosh <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants