Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add timeout knob for monitoring server roles #17265

Merged

Conversation

jrafanie
Copy link
Member

@jrafanie jrafanie commented Apr 9, 2018

https://bugzilla.redhat.com/show_bug.cgi?id=1564567

Monitoring server roles as the master server is so important, it should
finish and not ever timeout. If it times out, servers will not be able
to gain roles. Previously, the default lock timeout of 1 minute is too
low in situations where the master server has higher than normal
latency to the database. We need to give it more time to finish before
timing it out.

Additionally, we can specify this value in advanced settings in the server
section if 5.minutes is still not enough or just a wrong value.

@carbonin
Copy link
Member

carbonin commented Apr 9, 2018

Shouldn't this be added to settings.yml?

https://bugzilla.redhat.com/show_bug.cgi?id=1564567

Monitoring server roles as the master server is so important, it should
finish and not ever timeout. If it times out, servers will not be able
to gain roles. Previously, the default lock timeout of 1 minute is too
low in situations where the master server has higher than normal
latency to the database.  We need to give it more time to finish before
timing it out.

Additionally, we can specify this value in advanced settings in the server
section if 5.minutes is still not enough or just a wrong value.
@jrafanie jrafanie force-pushed the increase_monitor_server_roles_timeout branch from e38ce72 to 1f564cd Compare April 10, 2018 12:18
@jrafanie
Copy link
Member Author

Shouldn't this be added to settings.yml?

Yeah, I wanted to not expose it but then we have the whole effort to externalize all hardcoded settings to the config file so yeah, I should have put it in settings.yml. Updated now.

@miq-bot
Copy link
Member

miq-bot commented Apr 10, 2018

Checked commit jrafanie@1f564cd with ruby 2.3.3, rubocop 0.52.1, haml-lint 0.20.0, and yamllint 1.10.0
1 file checked, 0 offenses detected
Everything looks fine. 🍪

@carbonin carbonin self-assigned this Apr 10, 2018
@carbonin carbonin merged commit 8b8d86c into ManageIQ:master Apr 10, 2018
@carbonin carbonin added this to the Sprint 84 Ending Apr 23, 2018 milestone Apr 10, 2018
@jrafanie jrafanie deleted the increase_monitor_server_roles_timeout branch April 10, 2018 15:04
simaishi pushed a commit that referenced this pull request Apr 16, 2018
…_timeout

Add timeout knob for monitoring server roles
(cherry picked from commit 8b8d86c)

https://bugzilla.redhat.com/show_bug.cgi?id=1568159
@simaishi
Copy link
Contributor

Fine backport details:

$ git log -1
commit 67b1c01eda57f2debc37fa9a4a431eb09be294b7
Author: Nick Carboni <[email protected]>
Date:   Tue Apr 10 09:28:29 2018 -0400

    Merge pull request #17265 from jrafanie/increase_monitor_server_roles_timeout
    
    Add timeout knob for monitoring server roles
    (cherry picked from commit 8b8d86cd3f5ee5c7fbed0781fade4716c6e35e9e)
    
    https://bugzilla.redhat.com/show_bug.cgi?id=1568159

simaishi pushed a commit that referenced this pull request Apr 18, 2018
…_timeout

Add timeout knob for monitoring server roles
(cherry picked from commit 8b8d86c)

https://bugzilla.redhat.com/show_bug.cgi?id=1568158
@simaishi
Copy link
Contributor

Gaprindashvili backport details:

$ git log -1
commit 5c5658a8cae27f2cadfd86d76edd4cc2b336837a
Author: Nick Carboni <[email protected]>
Date:   Tue Apr 10 09:28:29 2018 -0400

    Merge pull request #17265 from jrafanie/increase_monitor_server_roles_timeout
    
    Add timeout knob for monitoring server roles
    (cherry picked from commit 8b8d86cd3f5ee5c7fbed0781fade4716c6e35e9e)
    
    https://bugzilla.redhat.com/show_bug.cgi?id=1568158

d-m-u pushed a commit to d-m-u/manageiq that referenced this pull request Jun 6, 2018
…er_roles_timeout

Add timeout knob for monitoring server roles
(cherry picked from commit 8b8d86c)

https://bugzilla.redhat.com/show_bug.cgi?id=1568159
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants