Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add unique_set_size for servers and workers #139

Merged
merged 1 commit into from
Nov 30, 2017

Conversation

jrafanie
Copy link
Member

@jrafanie jrafanie commented Nov 30, 2017

Why? USS is a more reliable mechanism for tracking workers with runaway
memory growth. PSS is great, until the server process that forks new
processes grows large. As each new worker is forked, it inherits a share
of the large amount of the parent process' memory and therefore starts
with a large PSS, possibly exceeding our limits before doing any work.
USS only measures a process' private memory and is a better indicator
when a process is responsible for allocating too much memory without
freeing it.

This is needed for PR: ManageIQ/manageiq#16569

Why?  USS is a more reliable mechanism for tracking workers with runaway
memory growth.  PSS is great, until the server process that forks new
processes grows large. As each new worker is forked, it inherits a share
of the large amount of the parent process' memory and therefore starts
with a large PSS, possibly exceeding our limits before doing any work.
USS only measures a process' private memory and is a better indicator
when a process is responsible for allocating too much memory without
freeing it.
@jrafanie
Copy link
Member Author

@miq-bot add_label gaprindashvili/yes

@jrafanie
Copy link
Member Author

@miq-bot add_label enhancement

@jrafanie
Copy link
Member Author

@gtanzillo @Fryguy please review

@miq-bot
Copy link
Member

miq-bot commented Nov 30, 2017

Checked commit jrafanie@dfac144 with ruby 2.3.3, rubocop 0.47.1, haml-lint 0.20.0, and yamllint 1.10.0
1 file checked, 0 offenses detected
Everything looks fine. 🍪

@Fryguy Fryguy merged commit 7e36f4e into ManageIQ:master Nov 30, 2017
@Fryguy Fryguy added this to the Sprint 75 Ending Dec 11, 2017 milestone Nov 30, 2017
@jrafanie jrafanie deleted the add_uss_to_servers_workers branch November 30, 2017 21:38
simaishi pushed a commit that referenced this pull request Dec 1, 2017
Add unique_set_size for servers and workers
(cherry picked from commit 7e36f4e)
@simaishi
Copy link
Contributor

simaishi commented Dec 1, 2017

Gaprindashvili backport details:

$ git log -1
commit 01bee34572defab09ea534232d5e6185d9e1cba8
Author: Jason Frey <[email protected]>
Date:   Thu Nov 30 15:17:04 2017 -0500

    Merge pull request #139 from jrafanie/add_uss_to_servers_workers
    
    Add unique_set_size for servers and workers
    (cherry picked from commit 7e36f4ee26e3a5e9eb1af3c00ba144cce781ce66)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants