-
Notifications
You must be signed in to change notification settings - Fork 2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add reason label to total_reload metric #1099
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@LorcanMcVeigh
Please see my comments and suggestions
Additionally, after you start the IC, until it gets reloaded, you will not get metrics for one or both labels. For "other" label, as the first reload happens quickly after the start, it is hard to notice its absence. However, for the "endpoints" label, you can see its absence. For example, here the IC was reloaded but no endpoints update happened yet:
# HELP nginx_ingress_controller_nginx_reloads_total Number of successful NGINX reloads
# TYPE nginx_ingress_controller_nginx_reloads_total counter
nginx_ingress_controller_nginx_reloads_total{class="nginx",reason="other"} 2
Note that the metric nginx_ingress_controller_nginx_reloads_total{class="nginx",reason="endpoint"} is not present here at all.
The solution is to initialize those labels before the IC starts. Could you add that?
could you possibly tell me how you achieved this? I haven't been able to replicate this |
yep. So just deploy an Ingress Controller. Without deploying any backends and Ingress/VS resources. |
Co-authored-by: Michael Pleshakov <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍
Proposed changes
Add a label
reason
to the prometheus metrictotal_reloads
which specifies if the reload was caused by a endpoint update or another reasonChecklist
Before creating a PR, run through this checklist and mark each as complete.