-
Notifications
You must be signed in to change notification settings - Fork 3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Failure percentage being reported incorrectly #1006
Comments
I can also confirm this issue. |
I think this will fix this? #994 @cgoldberg we should probably cut a release of that, it's an annoying UI bug that has bothered me a while too. |
I verified latest code, still issue not resolved. It showing 50% |
This issue also happens on no-web mode, but only for each individual endpoint. The total error % shows the correct value. |
This will probably be fixed by #1075, once it gets merged. |
This should be fixed now. |
Description of issue
When running tests in locust 0.11.0, fails increment the total number of requests in addition to the number of fails. The percentage fails in the top right of the UI seems to use the old formula of:
Failure rate = (Number of fails/(Number of requests + number of fails))*100
This means that, when running a test that completely fails all requests (say a test that gets 400s exclusively), the failure percentage is just calculated completely wrong (50%).
I have such a test, that worked in version 0.9.0, and now, due to this functionality in 0.11.0, it is reporting an incorrect failure rate.
Expected behavior
The failure rate is calculated from the number of requests and number of fails alone, and does not add them (because failures are included in the request metrics now)
Actual behavior
Every fail is effectively treated as a successful request in the Failure rate in the top right, as well as a failure, making the failure rate seem much lower than it is
Environment settings
Steps to reproduce (for bug reports)
The above pseudocode is exactly what we are doing (with business-related endpoints etc replaced), and provides an accurate failure rate on 0.9.0, but an inaccurate one on 0.11.0. It aims to load test endpoints returning 400s.
The below screenshot shows what I mean; 116 fails come through as 116 fails and 116 requests, but the top right figure displays 50% failure rate rather than the correct 100%
I'm hoping this is simply a calculation fix for that bit of UI, and this erroneous calculation doesn't extend to other things, like counting fails twice in the RPS calculations or graphs.
The text was updated successfully, but these errors were encountered: