Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test_manager: ensure test independence #31364

Merged
merged 3 commits into from
Feb 8, 2024
Merged

Conversation

jnewb1
Copy link
Contributor

@jnewb1 jnewb1 commented Feb 8, 2024

if you run in a loop like this, the OP Prefix doesn't apply and can cause test independence issues, like:

https://jenkins.comma.life/blue/organizations/jenkins/openpilot/detail/master/98/pipeline/

@jnewb1
Copy link
Contributor Author

jnewb1 commented Feb 8, 2024

@adeebshihadeh any reason this needs to run 10x?

@adeebshihadeh
Copy link
Contributor

IIRC it's high variance

@jnewb1 jnewb1 merged commit c79d1e0 into master Feb 8, 2024
27 checks passed
@jnewb1 jnewb1 deleted the manager-ensure-independent branch February 8, 2024 04:52
Edison-CBS pushed a commit to Edison-CBS/openpilot that referenced this pull request Feb 8, 2024
* ensure independent

* still run 10- times

* need index

---------

Co-authored-by: Comma Device <[email protected]>
Edison-CBS pushed a commit to Edison-CBS/openpilot that referenced this pull request Feb 8, 2024
* ensure independent

* still run 10- times

* need index

---------

Co-authored-by: Comma Device <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants