-
Notifications
You must be signed in to change notification settings - Fork 58
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature] Compression via Nvcomp #23
Comments
Looking at cuDFs means for installing nvcomp, it installs it locally only as a cudf build dependency. I'm not sure how to proceed, either |
@madsbk I did find the |
Implemented in #24 |
…i#23) Fixes: rapidsai/cudf#14218 This PR disallows assigning NaT to non-datetime/timedelta columns. Pandas allows this by changing the column to object dtype, which we cannot support.
Hi! We've been talking about adding
nvcomp
tokvikio
. I'm looking to add python bindings for Snappy, Cascaded, and Lz4 algorithms fromnvcomp
. In order to do so, we'll need to add the python bindingsnvcomp.pyx
andnvcomp.pxd
tokvikio/python/kvikio/_lib
and a wrapper for them,nvcomp.py
. Once this is done I'll write tests.A CMakeFlag
-DUSE_NVCOMP=True
will be added, disabled by default.We're planning on using the nvcomp headers that are installed by cudf, which can be installed via conda, right?
I'm also looking into adding
kvikio
as another library option for https://github.com/trxcllnt/rapids-compose, which will make maintenance and development quite easy.The text was updated successfully, but these errors were encountered: