Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace average response times with percentiles & min/max #753

Closed
ghost opened this issue Mar 21, 2018 · 7 comments
Closed

Replace average response times with percentiles & min/max #753

ghost opened this issue Mar 21, 2018 · 7 comments

Comments

@ghost
Copy link

ghost commented Mar 21, 2018

Web performance has high outliers making average response times misleading. Can we replace mean with percentiles? I propose p50 (median), p95, p99. I'd also add min and max.

@cgoldberg
Copy link
Member

cgoldberg commented Mar 23, 2018

exported stats already contain the following percentiles:
"50%","66%","75%","80%","90%","95%","98%","99%","100%"
as well as min/max.

@ghost
Copy link
Author

ghost commented Mar 23, 2018

Hi @cgoldberg Sorry, I wasn't really clear here. I was thinking about the WebUI. The charts plot average response times. Would different coloured lines representing percentiles be possible? Also in the stats we have average. My suggestion would be to a least replace that with p99. WDYT?

@daluu
Copy link

daluu commented Mar 23, 2018

I think mean could still be useful. Rather than replace, add on the missing desired stats. And/or perhaps make it configurable what to show, in case someone doesn't want to see the mean for example.

@cgoldberg
Copy link
Member

I think the Web UI is supposed to display an average over a moving window, not the overall average... see: #667

I'm not sure if a moving average is preferable to an overall percentile?

@ghost
Copy link
Author

ghost commented Mar 23, 2018

OK. I think some users may still want an average as @daluu suggests. I wonder if we can add moving percentiles in the charts and in the flat stats? I remember this data is available from a web API. Not sure how the UI currently reads the data. We probably also want to add some form of persistence, but I think that would be another ticket. Should agree on some additional percentiles and I can look into it?

@cyberw cyberw changed the title [feature request] Replace average response times with percentiles & min/max Replace average response times with percentiles & min/max Oct 30, 2019
@cyberw cyberw added the wontfix label Dec 30, 2019
@cyberw
Copy link
Collaborator

cyberw commented Dec 30, 2019

Closing due to lack of activity. Some improvements have been made in this area though...

@cyberw cyberw closed this as completed Dec 30, 2019
@alphaw1n
Copy link

Is it now possible to configure percentiles and the maximum value of response time on the graph? I want to see this on a chart so that I can understand at what point the short-term delays occur. I couldn't find this in the documentation, unfortunately...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants