Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update dask version #448

Merged
merged 5 commits into from
Oct 12, 2024
Merged

Update dask version #448

merged 5 commits into from
Oct 12, 2024

Conversation

rettigl
Copy link
Member

@rettigl rettigl commented Jun 24, 2024

The changes to the dfops in #411 allow to pass the tests with dask2024.6.2, however there are random failures during binning (see dask/dask#11200). This requires further inspection.

@coveralls
Copy link
Collaborator

coveralls commented Jun 24, 2024

Pull Request Test Coverage Report for Build 9651968197

Details

  • 106 of 118 (89.83%) changed or added relevant lines in 5 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage increased (+0.05%) to 91.908%

Changes Missing Coverage Covered Lines Changed/Added Lines %
sed/core/processor.py 7 9 77.78%
sed/loader/mpes/loader.py 70 80 87.5%
Totals Coverage Status
Change from base Build 9636700237: 0.05%
Covered Lines: 6463
Relevant Lines: 7032

💛 - Coveralls

@rettigl rettigl mentioned this pull request Jun 24, 2024
12 tasks
@rettigl rettigl force-pushed the update_dask_version branch from 5c55f95 to 6f123a9 Compare June 24, 2024 21:05
@coveralls
Copy link
Collaborator

coveralls commented Jun 24, 2024

Pull Request Test Coverage Report for Build 9652411782

Details

  • 106 of 118 (89.83%) changed or added relevant lines in 5 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage increased (+0.09%) to 91.911%

Changes Missing Coverage Covered Lines Changed/Added Lines %
sed/core/processor.py 7 9 77.78%
sed/loader/mpes/loader.py 70 80 87.5%
Totals Coverage Status
Change from base Build 9652390026: 0.09%
Covered Lines: 6465
Relevant Lines: 7034

💛 - Coveralls

@coveralls
Copy link
Collaborator

coveralls commented Jun 24, 2024

Pull Request Test Coverage Report for Build 9652821299

Details

  • 106 of 118 (89.83%) changed or added relevant lines in 5 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage increased (+0.05%) to 91.868%

Changes Missing Coverage Covered Lines Changed/Added Lines %
sed/core/processor.py 7 9 77.78%
sed/loader/mpes/loader.py 70 80 87.5%
Totals Coverage Status
Change from base Build 9652390026: 0.05%
Covered Lines: 6462
Relevant Lines: 7034

💛 - Coveralls

@zain-sohail
Copy link
Member

I saw some threads on xarray about ffill algorithms and maybe they help in not using map_overlap. Putting it here because it's related
pydata/xarray#6997
pydata/xarray#6118

@zain-sohail zain-sohail mentioned this pull request Jul 2, 2024
11 tasks
@zain-sohail
Copy link
Member

Generally I find the error occuring in the current v1 branch as well

@rettigl
Copy link
Member Author

rettigl commented Jul 3, 2024

It depends on the dask version, not our code. Did you check the dask version you were using?

@zain-sohail
Copy link
Member

It depends on the dask version, not our code. Did you check the dask version you were using?

Yes you are right. The 2024 version seems to cause this. Would be great to use the new optimizer they have but seems we have to figure things on our side.

@rettigl rettigl force-pushed the update_dask_version branch from a2ba530 to 3ea7dcc Compare September 11, 2024 19:35
@coveralls
Copy link
Collaborator

coveralls commented Sep 11, 2024

Pull Request Test Coverage Report for Build 11300006146

Details

  • 3 of 3 (100.0%) changed or added relevant lines in 1 file are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage increased (+0.002%) to 92.524%

Totals Coverage Status
Change from base Build 10949056106: 0.002%
Covered Lines: 7240
Relevant Lines: 7825

💛 - Coveralls

@rettigl rettigl force-pushed the update_dask_version branch from 3ea7dcc to 1aa4a83 Compare October 11, 2024 22:09
@rettigl
Copy link
Member Author

rettigl commented Oct 11, 2024

Disabled dataframe.query-planning for now as workaround, to not have to limit the python version anymore.

@rettigl rettigl requested a review from zain-sohail October 11, 2024 22:39
Copy link
Member

@zain-sohail zain-sohail left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That seems like the best workaround for now. LGTM

@rettigl rettigl merged commit d56d6d9 into v1_feature_branch Oct 12, 2024
9 checks passed
@rettigl rettigl deleted the update_dask_version branch October 12, 2024 18:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants