Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: parallel timeout improvements #5859

Merged

Conversation

elasticspoon
Copy link
Collaborator

@elasticspoon elasticspoon commented Jun 25, 2024

Created an ENV variable TEST_MAX_DURATION. If set the max time each test can take will equal that max duration in seconds. If it takes longer the test will fail with an error.

Additionally docker will not fail fast in CI. That test suite is intended to be supplemental. If it is failing, we gain no additional insight compared to the regular RSpec suite.

@github-actions github-actions bot added ruby Pull requests that update Ruby code Tests! 🎉💖👏 labels Jun 25, 2024
@elasticspoon elasticspoon force-pushed the fix/improve-test-timeouts branch 2 times, most recently from ebc72a5 to 4e1f0bf Compare June 29, 2024 21:03
@elasticspoon elasticspoon force-pushed the fix/improve-test-timeouts branch 3 times, most recently from 15a5370 to 4f873d9 Compare July 5, 2024 04:42
@elasticspoon elasticspoon force-pushed the fix/improve-test-timeouts branch 2 times, most recently from 92bedd3 to fecd0c7 Compare July 5, 2024 20:13
@elasticspoon elasticspoon marked this pull request as ready for review July 5, 2024 20:13
@elasticspoon elasticspoon enabled auto-merge (squash) July 5, 2024 20:15
@elasticspoon elasticspoon disabled auto-merge July 5, 2024 23:44
@elasticspoon elasticspoon force-pushed the fix/improve-test-timeouts branch from 312106a to 1c82371 Compare July 6, 2024 01:13
add per test timeout based on ENV variable
- we have lots of issues with tests hanging but us being unsure which
  test hung. This will allow us to set a max time for test and get
  feedback on which ones are timing out.

fail fast docker ci
- docker is used mainly as a verification step. It should only give info
  about docker itself working or not. Might as well make it fail fast.

fix: change queue_adapter
- lots of failures seem to stem from background jobs, fixing the
  queue_adapter is a suggested step
@elasticspoon elasticspoon force-pushed the fix/improve-test-timeouts branch from 3364aae to 9dd27ba Compare July 6, 2024 17:20
@elasticspoon elasticspoon enabled auto-merge (squash) July 6, 2024 17:21
@elasticspoon elasticspoon merged commit d057a38 into rubyforgood:main Jul 6, 2024
18 checks passed
@elasticspoon elasticspoon deleted the fix/improve-test-timeouts branch July 6, 2024 17:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ruby Pull requests that update Ruby code Tests! 🎉💖👏
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants