Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: reduce test data size #10487

Merged
merged 1 commit into from
Aug 3, 2020

Conversation

bkyryliuk
Copy link
Member

@bkyryliuk bkyryliuk commented Jul 31, 2020

Doing some test setup cleanup. This PR is needed to be able to add presto to the CI bkyryliuk#13, presto inserts are fairly slow and takes forever to finish.

The ultimate state is to move off the load examples & leverage the fixtures instead. This step is more intermediate and just reduces the data size loaded into the test databases.

@bkyryliuk bkyryliuk marked this pull request as draft July 31, 2020 01:10
@bkyryliuk bkyryliuk changed the title refactore: reduce test data size [WIP] refactor: reduce test data size [WIP] Jul 31, 2020
@bkyryliuk bkyryliuk force-pushed the bogdan/sample_data_for_Tests branch 8 times, most recently from e43664a to 8fe0200 Compare July 31, 2020 23:11
@pull-request-size pull-request-size bot added size/L and removed size/M labels Jul 31, 2020
@codecov-commenter
Copy link

Codecov Report

Merging #10487 into master will decrease coverage by 10.90%.
The diff coverage is n/a.

Impacted file tree graph

@@             Coverage Diff             @@
##           master   #10487       +/-   ##
===========================================
- Coverage   70.84%   59.94%   -10.91%     
===========================================
  Files         605      409      -196     
  Lines       32428    13355    -19073     
  Branches     3423     3423               
===========================================
- Hits        22975     8006    -14969     
+ Misses       9341     5161     -4180     
- Partials      112      188       +76     
Flag Coverage Δ
#cypress ?
#javascript 59.94% <ø> (ø)
#python ?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
superset-frontend/src/SqlLab/App.jsx 0.00% <0.00%> (-100.00%) ⬇️
superset-frontend/src/explore/App.jsx 0.00% <0.00%> (-100.00%) ⬇️
superset-frontend/src/dashboard/App.jsx 0.00% <0.00%> (-100.00%) ⬇️
superset-frontend/src/explore/index.jsx 0.00% <0.00%> (-100.00%) ⬇️
superset-frontend/src/dashboard/index.jsx 0.00% <0.00%> (-100.00%) ⬇️
superset-frontend/src/setup/setupColors.js 0.00% <0.00%> (-100.00%) ⬇️
superset-frontend/src/chart/ChartContainer.jsx 0.00% <0.00%> (-100.00%) ⬇️
superset-frontend/src/setup/setupFormatters.js 0.00% <0.00%> (-100.00%) ⬇️
superset-frontend/src/explore/reducers/index.js 0.00% <0.00%> (-100.00%) ⬇️
superset-frontend/src/setup/setupPluginsExtra.js 0.00% <0.00%> (-100.00%) ⬇️
... and 333 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ce10e13...8fe0200. Read the comment docs.

@bkyryliuk bkyryliuk force-pushed the bogdan/sample_data_for_Tests branch from 8fe0200 to 80372f9 Compare July 31, 2020 23:36
@pull-request-size pull-request-size bot added size/M and removed size/L labels Jul 31, 2020
@bkyryliuk bkyryliuk force-pushed the bogdan/sample_data_for_Tests branch from 80372f9 to 4fa4c5c Compare July 31, 2020 23:58
@bkyryliuk bkyryliuk force-pushed the bogdan/sample_data_for_Tests branch from 4fa4c5c to 9b15c4e Compare August 1, 2020 00:09
@@ -264,13 +264,30 @@ def cannonicalize_df(df):
return ret

df1 = self.query_with_expr_helper(is_timeseries=True, inner_join=True)
name_list1 = cannonicalize_df(df1).name.values.tolist()
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

made the test deterministic

@bkyryliuk bkyryliuk changed the title refactor: reduce test data size [WIP] refactor: reduce test data size Aug 1, 2020
@bkyryliuk bkyryliuk marked this pull request as ready for review August 1, 2020 01:07
Copy link
Member

@ktmud ktmud left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm!

@bkyryliuk bkyryliuk merged commit ab404ea into apache:master Aug 3, 2020
Ofeknielsen pushed a commit to ofekisr/incubator-superset that referenced this pull request Oct 5, 2020
Co-authored-by: bogdan kyryliuk <[email protected]>
auxten pushed a commit to auxten/incubator-superset that referenced this pull request Nov 20, 2020
@mistercrunch mistercrunch added 🏷️ bot A label used by `supersetbot` to keep track of which PR where auto-tagged with release labels 🚢 0.38.0 labels Mar 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🏷️ bot A label used by `supersetbot` to keep track of which PR where auto-tagged with release labels size/M 🚢 0.38.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants