Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch to using native traceback #16851

Merged
merged 6 commits into from
Sep 20, 2024
Merged

Switch to using native traceback #16851

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
8ee78ae
Switch to using native traceback
galipremsagar Sep 19, 2024
bce16a9
Merge branch 'branch-24.10' into tb_optimize
galipremsagar Sep 19, 2024
bca0a1c
Merge remote-tracking branch 'upstream/branch-24.10' into tb_optimize
galipremsagar Sep 19, 2024
573cf49
Merge branch 'tb_optimize' of https://github.com/galipremsagar/cudf i…
galipremsagar Sep 19, 2024
ed5b0e4
Merge remote-tracking branch 'upstream/branch-24.10' into tb_optimize
galipremsagar Sep 19, 2024
52a29fc
move to pytest.ini
galipremsagar Sep 19, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions ci/test_wheel_cudf.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,7 @@ rapids-logger "pytest pylibcudf"
pushd python/pylibcudf/pylibcudf/tests
python -m pytest \
--cache-clear \
--numprocesses=8 \
--dist=worksteal \
.
popd
Expand Down
2 changes: 2 additions & 0 deletions ci/test_wheel_dask_cudf.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,6 +41,7 @@ pushd python/dask_cudf/dask_cudf
DASK_DATAFRAME__QUERY_PLANNING=True python -m pytest \
--junitxml="${RAPIDS_TESTS_DIR}/junit-dask-cudf.xml" \
--numprocesses=8 \
--dist=worksteal \
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Curious how much of a speedup you see with this change?

Copy link
Contributor Author

@galipremsagar galipremsagar Sep 20, 2024 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When we switched cudf wide, we were able to cut down 25% of the execution time: #15207 (comment)

.
popd

Expand All @@ -50,5 +51,6 @@ pushd python/dask_cudf/dask_cudf
DASK_DATAFRAME__QUERY_PLANNING=False python -m pytest \
--junitxml="${RAPIDS_TESTS_DIR}/junit-dask-cudf-legacy.xml" \
--numprocesses=8 \
--dist=worksteal \
.
popd
1 change: 1 addition & 0 deletions python/cudf/benchmarks/pytest.ini
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,3 +6,4 @@ python_classes = Bench
python_functions = bench_*
markers =
pandas_incompatible: mark a benchmark that cannot be run with pandas
addopts = --tb=native
1 change: 1 addition & 0 deletions python/cudf/cudf/tests/pytest.ini
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,3 +14,4 @@ filterwarnings =
ignore:Passing a BlockManager to DataFrame is deprecated:DeprecationWarning
# PerformanceWarning from cupy warming up the JIT cache
ignore:Jitify is performing a one-time only warm-up to populate the persistent cache:cupy._util.PerformanceWarning
addopts = --tb=native
3 changes: 3 additions & 0 deletions python/cudf/cudf_pandas_tests/third_party_integration_tests/tests/pytest.ini
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,10 @@
# Copyright (c) 2024, NVIDIA CORPORATION.

[pytest]
xfail_strict=true
markers=
assert_eq: custom binary asserter for a test
xfail_gold: this test is expected to fail in the gold pass
xfail_cudf_pandas: this test is expected to fail in the cudf_pandas pass
xfail_compare: this test is expected to fail in the comparison pass
addopts = --tb=native
4 changes: 4 additions & 0 deletions python/cudf_kafka/cudf_kafka/tests/pytest.ini
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
# Copyright (c) 2024, NVIDIA CORPORATION.

[pytest]
addopts = --tb=native
4 changes: 4 additions & 0 deletions python/cudf_polars/tests/pytest.ini
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
# Copyright (c) 2024, NVIDIA CORPORATION.

[pytest]
addopts = --tb=native
4 changes: 4 additions & 0 deletions python/custreamz/custreamz/tests/pytest.ini
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
# Copyright (c) 2024, NVIDIA CORPORATION.

[pytest]
addopts = --tb=native
4 changes: 4 additions & 0 deletions python/dask_cudf/dask_cudf/tests/pytest.ini
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
# Copyright (c) 2024, NVIDIA CORPORATION.

[pytest]
addopts = --tb=native
1 change: 1 addition & 0 deletions python/pylibcudf/pylibcudf/tests/pytest.ini
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,3 +6,4 @@ filterwarnings =
error
ignore:::.*xdist.*
ignore:::.*pytest.*
addopts = --tb=native
Loading