Upgrade nvcomp to 4.1.0.6

[bdice]

This updates cudf to use nvcomp 4.1.0.6.

The version is updated in rapids-cmake in rapidsai/rapids-cmake#709.

[jameslamb]

Looks to me like this is not ready yet. From wheel tests:

Module 'kvikio.zarr' was found, but when imported by pytest it raised:
ImportError('/pyenv/versions/3.10.15/lib/python3.10/site-packages/kvikio/_lib/libnvcomp.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN6nvcomp14BitcompManagerC1EmRK30nvcompBatchedBitcompFormatOptsP11CUstream_stiNS_14ChecksumPolicyENS_13BitstreamKindE')

(build link)

[jameslamb]

Maybe libkvikio also needs a runtime dependency on the nvidia-nvcomp wheels, similar to what was done with libcudf` in rapidsai/cudf#16946?

https://github.com/rapidsai/cudf/blob/5ee7d7caaf459e7d30597e6ea2dd1904c50d12fc/python/libcudf/pyproject.toml#L40-L42

[bdice]

@jameslamb Sorry for my lack of communication here. This is only failing now because I reverted rapids-cmake testing changes in 62265bb. The tests passed in 45e7389. I am going to rerun CI after merging the rapids-cmake PR, but you can review the CI run from the previous commit.

[bdice]

Also: We have the nvcomp wheel dependency we need here:

kvikio/python/kvikio/pyproject.toml

Line 25 in 62265bb

"nvidia-nvcomp==4.1.0.6",

libkvikio is header-only, and the nvcomp dependency is really in kvikio (Cython), not libkvikio C++, so we don't need this nvcomp wheel dependency in the libkvikio wheel.

[jameslamb]

Ah ok got it, I misunderstood what was happening there. Thanks for the explanation.

[bdice]

/merge