Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Only install necessary components in conda packages. #2209

Merged
merged 15 commits into from
Mar 7, 2024
Merged

Only install necessary components in conda packages. #2209

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
e645fb2
Only install compiled component in build_libraft.sh.
bdice Mar 4, 2024
00b1d0e
Use component raft for header-only package.
bdice Mar 4, 2024
c101777
Add hnswlib component.
bdice Mar 5, 2024
2f18cec
Also install hnswlib headers.
bdice Mar 6, 2024
2318061
Merge branch 'branch-24.04' into conda-libraft-compiled-component-only
bdice Mar 6, 2024
26bdafd
Fix style.
bdice Mar 6, 2024
16bf75e
Ensure users of libraft find the CCCL package provied by librmm
robertmaynard Mar 6, 2024
cfda6ac
Add debug lines
robertmaynard Mar 6, 2024
e08c6c3
Revert "Ensure users of libraft find the CCCL package provied by librmm"
robertmaynard Mar 6, 2024
12372b4
Merge remote-tracking branch 'upstream/branch-24.04' into conda-libra…
bdice Mar 6, 2024
411262b
Revert changes to build_libraft_headers.sh and hnswlib install rules.
bdice Mar 6, 2024
cff0977
Use benchmark conda package instead of building it.
bdice Mar 6, 2024
49474da
Add --compile-lib. Without this flag, both the shared and static libr…
bdice Mar 6, 2024
ae9e5b1
Fix copyright.
bdice Mar 6, 2024
baed39a
Try building tests with a host dependency on libraft-static.
bdice Mar 6, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions conda/recipes/libraft/build_libraft.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
#!/usr/bin/env bash
# Copyright (c) 2022-2023, NVIDIA CORPORATION.
# Copyright (c) 2022-2024, NVIDIA CORPORATION.

./build.sh libraft --allgpuarch --compile-lib --build-metrics=compile_lib --incl-cache-stats --no-nvtx
./build.sh libraft --allgpuarch --compile-lib --build-metrics=compile_lib --incl-cache-stats --no-nvtx -n
cmake --install cpp/build --component compiled
Comment on lines +4 to +5
Copy link
Contributor Author

@bdice bdice Mar 4, 2024 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This now looks a lot like https://github.com/rapidsai/raft/blob/branch-24.04/conda/recipes/libraft/build_libraft_static.sh except installing the compiled component rather than compiled-static.

5 changes: 4 additions & 1 deletion conda/recipes/libraft/build_libraft_headers.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,7 @@
#!/usr/bin/env bash
# Copyright (c) 2022-2023, NVIDIA CORPORATION.
# Copyright (c) 2022-2024, NVIDIA CORPORATION.

# We must install everything (not just the "raft" component) because some
# dependencies like cuCollections and cutlass place their install rules in the
# "all" component.
./build.sh libraft --allgpuarch --no-nvtx
2 changes: 1 addition & 1 deletion conda/recipes/libraft/build_libraft_tests.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#!/usr/bin/env bash
# Copyright (c) 2022-2023, NVIDIA CORPORATION.
# Copyright (c) 2022-2024, NVIDIA CORPORATION.

./build.sh tests bench-prims --allgpuarch --no-nvtx --build-metrics=tests_bench_prims --incl-cache-stats
cmake --install cpp/build --component testing
3 changes: 3 additions & 0 deletions conda/recipes/libraft/conda_build_config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,9 @@ cmake_version:
nccl_version:
- ">=2.9.9"

gbench_version:
- "==1.8.0"

gtest_version:
- ">=1.13.0"

Expand Down
6 changes: 6 additions & 0 deletions conda/recipes/libraft/meta.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -280,7 +280,11 @@ outputs:
- ninja
- sysroot_{{ target_platform }} {{ sysroot_version }}
host:
# We must include both libraft and libraft-static to prevent the test
# builds from packaging those libraries. However, tests only depend on
# the shared library in libraft.
- {{ pin_subpackage('libraft', exact=True) }}
- {{ pin_subpackage('libraft-static', exact=True) }}
- cuda-version ={{ cuda_version }}
{% if cuda_major == "11" %}
- cuda-profiler-api {{ cuda11_cuda_profiler_api_run_version }}
Expand All @@ -300,6 +304,7 @@ outputs:
- libcusolver-dev
- libcusparse-dev
{% endif %}
- benchmark {{ gbench_version }}
- gmock {{ gtest_version }}
- gtest {{ gtest_version }}
run:
Expand All @@ -314,6 +319,7 @@ outputs:
- libcusparse
{% endif %}
- {{ pin_subpackage('libraft', exact=True) }}
- benchmark {{ gbench_version }}
- gmock {{ gtest_version }}
- gtest {{ gtest_version }}
about:
Expand Down
Loading