Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Minor: consolidate datafusion_substrait tests into substrait_integration to save builder space and build time #6685 #6686

Merged
merged 1 commit into from
Jun 16, 2023

Conversation

alamb
Copy link
Contributor

@alamb alamb commented Jun 15, 2023

Which issue does this PR close?

Part of #6676

Rationale for this change

This is the same pattern applied in #6682

Basically, each test binary has about 125MB of overhead (the size of the datafusion code that is linked in). Thus I estimate this PR to save 2 * ~125 MB of builder space as it reduces the number of test binaries created by 2

What changes are included in this PR?

consolidate repartition test into substrait_integration to save builder space and build time

Are these changes tested?

Yes

Are there any user-facing changes?

no

@@ -0,0 +1,697 @@
// Licensed to the Apache Software Foundation (ASF) under one
Copy link
Contributor Author

@alamb alamb Jun 15, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I moved these files and then removed a level of indenting as

#[cfg(test)]
mod tests {

is not necessary for integration tests

. I did not change any of the tests

@alamb alamb added the development-process Related to development process of DataFusion label Jun 15, 2023
Copy link
Member

@waynexia waynexia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TIL

cargo clean has been my daily job until I bought a new 2T disk 😵‍💫

@alamb alamb merged commit 31c96a7 into apache:main Jun 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
development-process Related to development process of DataFusion substrait
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants