Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[QST] How to install from source with system's ucx libs #1047

Closed
cctry opened this issue Jun 13, 2024 · 2 comments
Closed

[QST] How to install from source with system's ucx libs #1047

cctry opened this issue Jun 13, 2024 · 2 comments

Comments

@cctry
Copy link

cctry commented Jun 13, 2024

Hi,

I am trying to install uxc-py from source usingpip install . with libucx installed in $CONDA_PREFIX/lib.
I got the error about trying to find the wheel for libucx.

ERROR: Could not find a version that satisfies the requirement libucx-cu12==1.15.0 (from versions: 1.14.1.post1, 1.15.0.post1, 1.16.0.post1)

How should I avoid this dependency check or direct it to the system's version?
@jameslamb jameslamb mentioned this issue Jun 13, 2024
Merged
@pentschev
Copy link
Member

Thanks for your question @cctry , there have been a few recent changes to our build system that we also noticed yesterday were breaking changes, we're looking to have them fixed by today or early next week. There's also a chance that we'll need to pass more options to pip install . which we will document accordingly and update this issue then. If this is an immediate blocker for you, reverting #1044 should allow pip install . still but that's not going to be a long-term solution.

rapids-bot bot pushed a commit that referenced this issue Jul 3, 2024
@jameslamb
make pip source installs a bit easier (#1048)
bfb1d99 
Follow-up to #1044
Contributes to rapidsai/build-planning#31
Related to #1047

* updates `libucx` build requirements so they can be satisfied by only packages from pypi.org
* removes `--extra-index-url https://pypi.anaconda.org/rapidsai-wheels-nightly/simple/` in `pip install` calls, now that `rapids-build-backend` is on pypi.org (https://pypi.org/project/rapids-build-backend/)
* sets `rapids-build-backend` config `disable-cuda=true` in `pyproject.toml`
  - *this means that now `pip install .` will not require `nvcc` or produce a wheel with a suffix like `-cu12`*
  - *modified CI script used to build wheels to override this, so the published wheels will still have `-cu${ver}` suffixes
* updates docs on source installation to reflect these changes

## Notes for Reviewers

These changes came out of an offline conversation with @pentschev and @vyasr

Authors:
  - James Lamb (https://github.com/jameslamb)
  - Peter Andreas Entschev (https://github.com/pentschev)

Approvers:
  - Peter Andreas Entschev (https://github.com/pentschev)
  - Vyas Ramasubramani (https://github.com/vyasr)

URL: #1048
@pentschev
Copy link
Member

With #1048 now merged, installing via pip install . should now be supported again, apologies for the longer than expected delay in hashing out all details.

Since you're using conda, the simpler approach for you is to install the ucx package from conda-forge, that will most likely cover your needs and you'll still be able to install UCX-Py from source, please refer to the conda installation docs here. If you absolutely need the libucx-cu* package from PyPI that should be supported as well but it is a much more involved process and much less user-friendly as it requires setting LD_LIBRARY_PATH both for install and runtime, refer to the docs here. Unfortunately using a custom UCX-Py install with PyPI packages without setting LD_LIBRARY_PATH would be a much more challenging and time-consuming effort and thus we do not intend in supporting at the moment.

I'll tentatively close this issue as I believe your case is now resolved, but please feel free to reopen this or open a new issue should you encounter any issues.

@jameslamb jameslamb mentioned this issue Nov 8, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@pentschev @cctry