Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduce redundancy of decimal testing [databricks] #4823

Merged
merged 2 commits into from
Feb 22, 2022

Conversation

jlowe
Copy link
Contributor

@jlowe jlowe commented Feb 18, 2022

Relates to #4538

Reduces the number of decimal types being tested for most tests that aren't really focused on decimal semantics. Now most tests that test across types will test only three decimal combinations, a 32-bit decimal, a 64-bit decimal, and a 128-bit decimal. In addition the following notable changes were made:

  • decimal_gens now includes 128-bit decimals.
  • all_gen now includes 128-bit decimals

@jlowe jlowe added the test Only impacts tests label Feb 18, 2022
@jlowe jlowe added this to the Feb 14 - Feb 25 milestone Feb 18, 2022
@jlowe jlowe self-assigned this Feb 18, 2022
@jlowe
Copy link
Contributor Author

jlowe commented Feb 18, 2022

build

revans2
revans2 previously approved these changes Feb 18, 2022
@jlowe
Copy link
Contributor Author

jlowe commented Feb 18, 2022

The cache failures on Databricks 9.1 were because the cache tests (which only run on Spark 3.1+) failed on the added DECIMAL128 inputs. Filed #4826 and excluded those from the cache test types.

@jlowe
Copy link
Contributor Author

jlowe commented Feb 18, 2022

build

@jlowe
Copy link
Contributor Author

jlowe commented Feb 18, 2022

Note that this PR appears to reduce the overall python tests count during premerge by about 2000 tests, from 16550 down to 14494.

@jlowe jlowe merged commit 9767748 into NVIDIA:branch-22.04 Feb 22, 2022
@jlowe jlowe deleted the trim-decimal-tests branch February 22, 2022 15:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
test Only impacts tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants