Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Get the unique_set_size with other process info #317

Merged
merged 3 commits into from
Nov 30, 2017

Conversation

jrafanie
Copy link
Member

@jrafanie jrafanie commented Nov 30, 2017

Why? USS is a more reliable mechanism for tracking workers with runaway
memory growth. PSS is great, until the server process that forks new
processes grows large. As each new worker is forked, it inherits a share
of the large amount of the parent process' memory and therefore starts
with a large PSS, possibly exceeding our limits before doing any work.
USS only measures a process' private memory and is a better indicator
when a process is responsible for allocating too much memory without
freeing it.

This is needed for PR: ManageIQ/manageiq#16569

Why?  USS is a more reliable mechanism for tracking workers with runaway
memory growth.  PSS is great, until the server process that forks new
processes grows large. As each new worker is forked, it inherits a share
of the large amount of the parent process' memory and therefore starts
with a large PSS, possibly exceeding our limits before doing any work.
USS only measures a process' private memory and is a better indicator
when a process is responsible for allocating too much memory without
freeing it.
@jrafanie
Copy link
Member Author

@miq-bot add_label gaprindashvili/yes
@miq-bot add_label enhancement

@jrafanie
Copy link
Member Author

Use https://github.com/ManageIQ/manageiq-gems-pending/pull/317/files?w=1 to ignore the whitespace changes.

@jrafanie jrafanie requested review from Fryguy and gtanzillo November 30, 2017 19:50
@miq-bot
Copy link
Member

miq-bot commented Nov 30, 2017

Checked commits jrafanie/manageiq-gems-pending@b823ac7~...c79e025 with ruby 2.3.3, rubocop 0.47.1, haml-lint 0.20.0, and yamllint 1.10.0
1 file checked, 1 offense detected

lib/gems/pending/util/miq-process.rb

@Fryguy Fryguy merged commit d5157dc into ManageIQ:master Nov 30, 2017
@Fryguy Fryguy added this to the Sprint 75 Ending Dec 11, 2017 milestone Nov 30, 2017
@jrafanie jrafanie deleted the add_uss_to_servers_workers branch November 30, 2017 21:38
simaishi pushed a commit that referenced this pull request Dec 1, 2017
 Get the unique_set_size with other process info
(cherry picked from commit d5157dc)
@simaishi
Copy link
Contributor

simaishi commented Dec 1, 2017

Gaprindashvili backport details:

$ git log -1
commit 87f4b8524547ac21948cb315b5050dc8031e063d
Author: Jason Frey <[email protected]>
Date:   Thu Nov 30 15:17:46 2017 -0500

    Merge pull request #317 from jrafanie/add_uss_to_servers_workers
    
     Get the unique_set_size with other process info
    (cherry picked from commit d5157dc9408470d5d35469f65b697a4d68634216)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants