Add tests for grib idx & reinflate

[emfdavid]

Add chunky test files and copy over unit test approach.

Builds on #523

TODO:

• Get tests working by editing fixtures/code
• Modify to use pytest instead of unittest
• Squash commits to avoid extra git blobs

[martindurant]

Well that's a lot .... :)

[emfdavid]

Well that's a lot .... :)

All part of my plan to become top contributor...

[emfdavid]

@martindurant These errors in the CI system are really strange... These typically only happen when using an old version of numpy/pandas that has a different default time type.
The last one, the sync error... that seems like maybe I need to convert from unittest subtest to pytest?

[martindurant]

It claims to have numpy 2.2.0, but there is this:

RuntimeWarning: numpy.ndarray size changed, may indicate binary incompatibility. Expected 16 from C header, got 96 from PyObject

which suggests maybe there is a conda-forge/defaults/pip crossover? We do have nodefaults in the environment spec.

[emfdavid]

It claims to have numpy 2.2.0, but there is this:

RuntimeWarning: numpy.ndarray size changed, may indicate binary incompatibility. Expected 16 from C header, got 96 from PyObject

which suggests maybe there is a conda-forge/defaults/pip crossover? We do have nodefaults in the environment spec.

Welp - I dumped as much version info as I can think to and I don't see any smoking gun
https://github.com/fsspec/kerchunk/actions/runs/12385105383/job/34570789000?pr=528#step:5:532

[emfdavid]

Okay - I can repro locally now after installing anaconda python.
I will debug tomorrow.

[emfdavid]

Okay - fixed the dtype on the step column.
It is an issue with reading the parquet files - I had to set engine='fastparquet' on the pd.read_parquet calls in my test.
Otherwise the timedelta64 step column does not decode properly.
This only happens in the anaconda environment. I can't repro the issue when I use a python 3.12 virtual env.

I am not sure what the remaining sync error is. I can't reproduce that one locally yet. Could it be a version skew problem?