Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add conda recipe for cudf-polars #17037

Merged
merged 9 commits into from
Oct 17, 2024

Conversation

bdice
Copy link
Contributor

@bdice bdice commented Oct 9, 2024

Description

This PR adds conda recipes for cudf-polars. This is needed to get cudf-polars into RAPIDS Docker containers and the rapids metapackage.

Closes #16816.

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@bdice bdice assigned bdice and unassigned bdice Oct 9, 2024
@bdice bdice added the feature request New feature or request label Oct 9, 2024
@bdice bdice self-assigned this Oct 9, 2024
@bdice bdice added the non-breaking Non-breaking change label Oct 9, 2024
@github-actions github-actions bot added Python Affects Python cuDF API. cudf.polars Issues specific to cudf.polars labels Oct 16, 2024
Copy link
Contributor

@wence- wence- left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Bradley!

Can we move the configuration of coverage? Otherwise looks good to me, will let others chime in on the packaging side of things.

Comment on lines 1 to 3
# Configuration file for Python coverage tests
[run]
source = cudf_polars
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We already do some configuration of coverage in pyproject.toml. Can this configuration also go there (I suppose in a [tool.coverage.run] section?

Copy link
Contributor Author

@bdice bdice Oct 16, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We may not even need a separate section for this. I pushed 1a2be0d to try using pyproject.toml without defining the [tool.coverage.run] source.

@@ -96,7 +96,7 @@ def test_bool_agg(agg, request):
assert_gpu_result_equal(q, check_exact=False)


@pytest.mark.parametrize("cum_agg", expr.UnaryFunction._supported_cum_aggs)
@pytest.mark.parametrize("cum_agg", sorted(expr.UnaryFunction._supported_cum_aggs))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, good spot!

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For reference, this was necessary to make multi-worker testing operate correctly. The frozenset had a different order on each worker, so pytest failed because the test collection didn't agree across all workers.

@bdice bdice marked this pull request as ready for review October 16, 2024 18:40
@bdice bdice requested review from a team as code owners October 16, 2024 18:40
Copy link
Contributor

@Matt711 Matt711 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, approving the python changes. And I had some non-blocking questions on the ci changes.

ci/test_python_other.sh Show resolved Hide resolved
ci/test_python_other.sh Show resolved Hide resolved
ci/test_python_other.sh Show resolved Hide resolved
conda/recipes/cudf-polars/meta.yaml Outdated Show resolved Hide resolved
@bdice bdice requested a review from wence- October 16, 2024 21:14
Copy link
Member

@jameslamb jameslamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No other comments from me, looks good.

@bdice
Copy link
Contributor Author

bdice commented Oct 17, 2024

I confirmed that coverage is working:

---------- coverage: platform linux, python 3.12.7-final-0 -----------
Name                                         Stmts   Miss  Cover
----------------------------------------------------------------
cudf_polars/__init__.py                          8      0   100%
cudf_polars/_version.py                          8      0   100%
cudf_polars/callback.py                         54      0   100%
cudf_polars/containers/__init__.py               4      0   100%
cudf_polars/containers/column.py                70      0   100%
cudf_polars/containers/dataframe.py             89      0   100%
cudf_polars/dsl/__init__.py                      2      0   100%
cudf_polars/dsl/expr.py                         14      0   100%
cudf_polars/dsl/expressions/__init__.py          2      0   100%
cudf_polars/dsl/expressions/aggregation.py      97      0   100%
cudf_polars/dsl/expressions/base.py             93      0   100%
cudf_polars/dsl/expressions/binaryop.py         39      0   100%
cudf_polars/dsl/expressions/boolean.py          88      0   100%
cudf_polars/dsl/expressions/datetime.py         39      0   100%
cudf_polars/dsl/expressions/literal.py          36      0   100%
cudf_polars/dsl/expressions/rolling.py          22      0   100%
cudf_polars/dsl/expressions/selection.py        40      0   100%
cudf_polars/dsl/expressions/sorting.py          38      0   100%
cudf_polars/dsl/expressions/string.py          130      0   100%
cudf_polars/dsl/expressions/ternary.py          18      0   100%
cudf_polars/dsl/expressions/unary.py           122      0   100%
cudf_polars/dsl/ir.py                          527      0   100%
cudf_polars/dsl/translate.py                   225      0   100%
cudf_polars/testing/__init__.py                  2      0   100%
cudf_polars/testing/asserts.py                  45      0   100%
cudf_polars/typing/__init__.py                   9      0   100%
cudf_polars/utils/__init__.py                    2      0   100%
cudf_polars/utils/dtypes.py                     66      0   100%
cudf_polars/utils/sorting.py                    18      0   100%
cudf_polars/utils/versions.py                    7      0   100%
----------------------------------------------------------------
TOTAL                                         1914      0   100%
Coverage XML written to file /__w/cudf/cudf/coverage-results/cudf-polars-coverage.xml

@bdice
Copy link
Contributor Author

bdice commented Oct 17, 2024

/merge

@rapids-bot rapids-bot bot merged commit 9980997 into rapidsai:branch-24.12 Oct 17, 2024
105 checks passed
rapids-bot bot pushed a commit to rapidsai/integration that referenced this pull request Oct 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cudf.polars Issues specific to cudf.polars feature request New feature or request non-breaking Non-breaking change Python Affects Python cuDF API.
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

[FEA] Build conda packages for Polars GPU engine
4 participants