Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set options.num_levels in db_stress_test_base #10732

Closed
wants to merge 2 commits into from

Conversation

hx235
Copy link
Contributor

@hx235 hx235 commented Sep 24, 2022

An add-on to #6818 to complete adding single-level universal compaction to stress/crash testing.

Test:

  • Locally run for 10 min python3 ./tools/db_crashtest.py whitebox --simple --compaction_style=1 --num_levels=1 -max_key=1000000 -value_size_mult=33 -write_buffer_size=524288 -target_file_size_base=524288 -max_bytes_for_level_base=2097152 --duration=120 --interval=10 --ops_per_thread=1000 --random_kill_odd=887
    • Check LOG to confirm single-level universal compaction is called
  • Manual testing and log checking to ensure destroy_db_initially=1 is correctly set across runs with different compaction styles (i.e, in the second half of whitebox testing).
  • [ongoing]CI jobs stress test

@facebook-github-bot
Copy link
Contributor

@hx235 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@hx235 hx235 requested a review from ajkr September 24, 2022 20:13
Copy link
Contributor

@ajkr ajkr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please confirm CI-like commands pass. The comment after the last PR landed (#6818 (comment)) suggested it wouldn't.

@facebook-github-bot
Copy link
Contributor

@hx235 has updated the pull request. You must reimport the pull request before landing.

@hx235
Copy link
Contributor Author

hx235 commented Sep 27, 2022

Please confirm CI-like commands pass. The comment after the last PR landed (#6818 (comment)) suggested it wouldn't.

Good call - I now run with CI like commands and initiated some jobs. Both seem fine so far. However, I think destroy_db_initially=1 is still a legit suggestion so I aded it here. Will run another overnight job to stress test the updated version before landing.

@facebook-github-bot
Copy link
Contributor

@hx235 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@hx235 hx235 requested review from ajkr September 27, 2022 00:33
Copy link
Contributor

@ajkr ajkr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please confirm CI-like commands pass. The comment after the last PR landed (#6818 (comment)) suggested it wouldn't.

Good call - I now run with CI like commands and initiated some jobs. Both seem fine so far. However, I think destroy_db_initially=1 is still a legit suggestion so I aded it here. Will run another overnight job to stress test the updated version before landing.

Yeah it probably already worked considering the DB dir is completely removed between runs. I just hadn't checked. Thanks for making sure it works.

@hx235 hx235 force-pushed the num_levels_in_stress branch from 20f805a to f56d841 Compare September 27, 2022 17:43
@facebook-github-bot
Copy link
Contributor

@hx235 has updated the pull request. You must reimport the pull request before landing.

@facebook-github-bot
Copy link
Contributor

@hx235 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot pushed a commit that referenced this pull request Sep 29, 2022
…#10743)

Summary:
**Context:**
#10732 (review)

Pull Request resolved: #10743

Test Plan:
- Locally run `python3 ./tools/db_crashtest.py whitebox --simple -max_key=1000000 -value_size_mult=33 -write_buffer_size=524288 -target_file_size_base=524288 -max_bytes_for_level_base=2097152 --duration=120 --interval=10 --ops_per_thread=1000 --random_kill_odd=887`
- CI jobs testing

Reviewed By: ajkr

Differential Revision: D39838733

Pulled By: ajkr

fbshipit-source-id: 9e819b66b0293dfc7a31a908a9d42c6baca4aeaa
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants