Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pandas 2.0 Support #94

Merged
merged 41 commits into from
Sep 29, 2023
Merged

Pandas 2.0 Support #94

Changes from 1 commit
Commits
Show all changes
41 commits
Select commit Hold shift + click to select a range
a43c8ed
Avoid pandas 2.1.0 due to timestamp bug
IzerOnadimQC Sep 8, 2023
f2ea716
Coerce timestamps to nanoseconds when converting to pandas
IzerOnadimQC Sep 14, 2023
fa15a47
Prevent dask from converting objects to strings
IzerOnadimQC Sep 18, 2023
c182ffb
Avoid dask 2023.9.2 due to failing tests
IzerOnadimQC Sep 18, 2023
8b1e0af
Cast metadata bytes to object to get around pandas bug
IzerOnadimQC Sep 18, 2023
d35b3e0
Generate arrow-compat reference data for 13.0.0
IzerOnadimQC Sep 19, 2023
5715758
Change package version in docs to match environment.yml
IzerOnadimQC Sep 19, 2023
1dbe229
Only use coerce timestamps arg on pyarrow>=13
IzerOnadimQC Sep 19, 2023
062f283
Remove pyarrow<8 tests from ci.yml
IzerOnadimQC Sep 20, 2023
f909ffe
Generate arrow-compat reference data for 12.0.0
IzerOnadimQC Sep 20, 2023
f0f0662
Avoid pandas 2.1.0 in numfocus nightly ci test
IzerOnadimQC Sep 20, 2023
3c56634
Avoid pandas 2.1.0.* in numfocus_nightly pip install
IzerOnadimQC Sep 20, 2023
60079ee
Add changelog entry and update setup.cfg
IzerOnadimQC Sep 20, 2023
2ccb2fe
Shrink PR
IzerOnadimQC Sep 20, 2023
d52f76c
Add dask tests for lines marked as uncovered by codecov
IzerOnadimQC Sep 20, 2023
fae951d
Check conda env before verbose import
IzerOnadimQC Sep 21, 2023
91ecebf
Use micromamba instead of mamba
IzerOnadimQC Sep 21, 2023
6248192
Pin pandas<2.1.0 due to bug in 2.1.0 and 2.1.1
IzerOnadimQC Sep 21, 2023
807650c
Check if adding pyarrow 13 tests improves coverage
IzerOnadimQC Sep 25, 2023
d45d160
Fix yaml error
IzerOnadimQC Sep 25, 2023
fdcecc3
Fix pyarrow install command and re-add removed tests
IzerOnadimQC Sep 25, 2023
0414b78
Experiment with tests for backwards compatibility
IzerOnadimQC Sep 25, 2023
1c2352d
Allow install of specific pandas version
IzerOnadimQC Sep 26, 2023
84cdbdb
Fix yaml error
IzerOnadimQC Sep 26, 2023
c14edda
Update changelog and re-add pyarrow 4.0.1 to ci.yml
IzerOnadimQC Sep 26, 2023
2c80c10
Remove test for pyarrow==3.0.0 as incompatible with pandas 2
IzerOnadimQC Sep 26, 2023
657704a
asv no longer supports dev, use run instead
IzerOnadimQC Sep 26, 2023
1f97207
Add environment arg to asv run
IzerOnadimQC Sep 26, 2023
c0218c3
Use astype when seting Series type due to change in pandas behaviour
IzerOnadimQC Sep 26, 2023
efb827f
Pin dask<2023.9.2
IzerOnadimQC Sep 26, 2023
61feb74
Add no-py-pin to pandas downgrade step
IzerOnadimQC Sep 26, 2023
ff4793f
Return to !=2023.9.2 due to broken CI
IzerOnadimQC Sep 26, 2023
f2d4a64
Switch CI operation order
IzerOnadimQC Sep 26, 2023
d088f3a
Test whether <2023.9.2 breaks CI
IzerOnadimQC Sep 26, 2023
db65092
Pin asv<0.6 due to API change
IzerOnadimQC Sep 27, 2023
7a7d1b3
Pin pyarrow>=4 due to pandas 2 incompatibility
IzerOnadimQC Sep 27, 2023
9b627d2
Pin asv during micromamba install
IzerOnadimQC Sep 27, 2023
5c1b49f
Remove square bracket notation from environment-docs.yml
IzerOnadimQC Sep 28, 2023
66bae06
Remove square bracket notation for dask in setup.cfg
IzerOnadimQC Sep 28, 2023
d27900d
Refactor PYARROW_LT_13 condition to remove repeated code
IzerOnadimQC Sep 28, 2023
41509b2
Add square brackets back to setup.cfg
IzerOnadimQC Sep 28, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion setup.cfg
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ classifiers =
[options]
include_package_data = true
install_requires =
dask[dataframe]!=2021.5.1,!=2021.6.0,<2023.9.2 # gh475 - 2021.5.1 and 2021.6.0 broke ci, omit those versions
dask!=2021.5.1,!=2021.6.0,<2023.9.2 # gh475 - 2021.5.1 and 2021.6.0 broke ci, omit those versions
IzerOnadimQC marked this conversation as resolved.
Show resolved Hide resolved
decorator
msgpack>=0.5.2
# Currently dask and numpy==1.16.0 clash
Expand Down