Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Split tests into unit and endtoend #5304

Merged
merged 1 commit into from
Oct 15, 2019

Conversation

deepthi
Copy link
Member

@deepthi deepthi commented Oct 15, 2019

  • Create new make targets e2e_test and e2e_test_race
  • Add scripts e2e_test_runner.sh and e2e_test_race.sh
  • Add endtoend and e2e_race tests to config.json
  • Filter out endtoend tests in unit_test_runner.sh and unit_test_race.sh
  • make unit_test_race will exclude endtoend tests
  • make unit_test continues to run all tests (this is not used by Travis CI).

Also speed up backup test.

Signed-off-by: deepthi [email protected]

@deepthi deepthi requested a review from sougou as a code owner October 15, 2019 05:07
@deepthi deepthi requested a review from enisoc October 15, 2019 05:09
packages_with_tests=$(go list -f '{{if len .TestGoFiles}}{{.ImportPath}} {{join .TestGoFiles " "}}{{end}}' ./go/.../endtoend/... | sort)

# endtoend tests should be in a directory called endtoend
all_e2e_tests=$(echo "$packages_with_tests" | cut -d" " -f1)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

did you mean to filter for only endtoend here? I would expect a grep somewhere

Copy link
Member Author

@deepthi deepthi Oct 15, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the path in the previous line ./go/.../endtoend/... takes care of that. I think the comment is misleading, we can fix that in another PR.

@systay systay merged commit edd5d18 into vitessio:master Oct 15, 2019
@systay
Copy link
Collaborator

systay commented Oct 15, 2019

This is important to get other PRs to pass, so I'm merging it pronto. If anyone else reviews this and finds things we should fix, let's do that in a separate PR.

@enisoc enisoc deleted the ds-split-tests branch October 15, 2019 17:13
@deepthi
Copy link
Member Author

deepthi commented Oct 15, 2019

This is still a stop gap. As we add more tests (especially as we move python tests to go), we will need a framework to group tests so that each group fits into the 8 minute limit.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants