Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

libdevice not found when using jax with nvidia drivers installed #283

Open
1 task done
mwittgen opened this issue Oct 1, 2024 · 11 comments
Open
1 task done

libdevice not found when using jax with nvidia drivers installed #283

mwittgen opened this issue Oct 1, 2024 · 11 comments
Labels
bug Something isn't working

Comments

@mwittgen
Copy link

mwittgen commented Oct 1, 2024

Solution to issue cannot be found in the documentation.

  • I checked the documentation.

Issue

With this test program and /dev/nvidia* being present in the system

import jax.numpy as np
np.sin(3)

fails with

jaxlib.xla_extension.XlaRuntimeError: INTERNAL: libdevice not found at ./libdevice.10.bc

jax fails to find libdevice
Testing with strace

strace -f python test.py  |& grep libdevice
[pid 13910] access("/home/wittgen/lsst/v28/lsstsw/miniconda/envs/lsst-scipipe-9.0.0/lib/python3.11/site-packages/nvidia/cuda_nvcc/nvvm/libdevice", F_OK) = -1 ENOENT (No such file or directory)
[pid 13910] access("/home/conda/feedstock_root/build_artifacts/jaxlib_1725045424189/_build_env/targets/x86_64-linux/nvvm/libdevice", F_OK) = -1 ENOENT (No such file or directory)
[pid 13910] access("/usr/local/cuda/nvvm/libdevice", F_OK) = -1 ENOENT (No such file or directory)
[pid 13910] access("/home/wittgen/lsst/v28/lsstsw/miniconda/envs/lsst-scipipe-9.0.0/lib/python3.11/site-packages/nvidia/cuda_nvcc/nvvm/libdevice", F_OK) = -1 ENOENT (No such file or directory)
[pid 13910] access("/home/wittgen/lsst/v28/lsstsw/miniconda/envs/lsst-scipipe-9.0.0/lib/python3.11/nvidia/cuda_nvcc/nvvm/libdevice", F_OK) = -1 ENOENT (No such file or directory)
[pid 13910] access("nvvm/libdevice", F_OK) = -1 ENOENT (No such file or directory)
[pid 13910] access("libdevice.10.bc", F_OK) = -1 ENOENT (No such file or directory)
[pid 13910] write(2, "jaxlib.xla_extension.XlaRuntimeE"..., 89jaxlib.xla_extension.XlaRuntimeError: INTERNAL: libdevice not found at ./libdevice.10.bc

The default search paths seem wrong. conda installs libdevice for example in
lib/nvvm/libdevice

Installed packages

# packages in environment at /home/wittgen/lsst/v28/lsstsw/miniconda/envs/lsst-scipipe-9.0.0:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                       2_gnu    conda-forge
_sysroot_linux-64_curr_repodata_hack 3                   h69a702a_16    conda-forge
ads                       0.12.6             pyhd8ed1ab_0    conda-forge
affine                    2.4.0              pyhd8ed1ab_0    conda-forge
aiobotocore               2.15.1             pyhd8ed1ab_0    conda-forge
aiohappyeyeballs          2.4.0              pyhd8ed1ab_0    conda-forge
aiohttp                   3.10.6          py311h9ecbd09_0    conda-forge
aioitertools              0.12.0             pyhd8ed1ab_0    conda-forge
aiosignal                 1.3.1              pyhd8ed1ab_0    conda-forge
alembic                   1.13.3             pyhd8ed1ab_0    conda-forge
alsa-lib                  1.2.12               h4ab18f5_0    conda-forge
annotated-types           0.7.0              pyhd8ed1ab_0    conda-forge
anyio                     4.6.0              pyhd8ed1ab_1    conda-forge
aom                       3.9.1                hac33072_0    conda-forge
apr                       1.7.0                hd590300_6    conda-forge
archspec                  0.2.3              pyhd8ed1ab_0    conda-forge
argcomplete               3.5.0              pyhd8ed1ab_0    conda-forge
asdf                      3.4.0              pyhd8ed1ab_0    conda-forge
asdf-astropy              0.6.1              pyhd8ed1ab_0    conda-forge
asdf-coordinates-schemas  0.3.0              pyhd8ed1ab_0    conda-forge
asdf-standard             1.1.1              pyhd8ed1ab_0    conda-forge
asdf-transform-schemas    0.5.0              pyhd8ed1ab_0    conda-forge
asdf-wcs-schemas          0.4.0              pyhd8ed1ab_0    conda-forge
assist                    1.1.9           py311hd1f4a16_2    conda-forge
asteval                   1.0.4              pyhd8ed1ab_0    conda-forge
astropy                   6.1.3           py311h9f3472d_1    conda-forge
astropy-iers-data         0.2024.9.23.0.31.43    pyhd8ed1ab_0    conda-forge
astroquery                0.4.7              pyhd8ed1ab_0    conda-forge
asttokens                 2.4.1              pyhd8ed1ab_0    conda-forge
attrs                     24.2.0             pyh71513ae_0    conda-forge
autograd                  1.7.0              pyhd8ed1ab_0    conda-forge
aws-c-auth                0.7.22              hbd3ac97_10    conda-forge
aws-c-cal                 0.7.1                h87b94db_1    conda-forge
aws-c-common              0.9.23               h4ab18f5_0    conda-forge
aws-c-compression         0.2.18               he027950_7    conda-forge
aws-c-event-stream        0.4.2               h7671281_15    conda-forge
aws-c-http                0.8.2                he17ee6b_6    conda-forge
aws-c-io                  0.14.10              h826b7d6_1    conda-forge
aws-c-mqtt                0.10.4               hcd6a914_8    conda-forge
aws-c-s3                  0.6.0                h365ddd8_2    conda-forge
aws-c-sdkutils            0.1.16               he027950_3    conda-forge
aws-checksums             0.1.18               he027950_7    conda-forge
aws-crt-cpp               0.27.3               hda66527_2    conda-forge
aws-sdk-cpp               1.11.329             h46c3b66_9    conda-forge
aws-xray-sdk              2.14.0             pyhd8ed1ab_0    conda-forge
azure-core-cpp            1.13.0               h935415a_0    conda-forge
azure-identity-cpp        1.8.0                hd126650_2    conda-forge
azure-storage-blobs-cpp   12.12.0              hd2e3451_0    conda-forge
azure-storage-common-cpp  12.7.0               h10ac4d7_1    conda-forge
azure-storage-files-datalake-cpp 12.11.0              h325d260_1    conda-forge
backoff                   2.2.1              pyhd8ed1ab_0    conda-forge
backports                 1.0                pyhd8ed1ab_4    conda-forge
backports.tarfile         1.0.0              pyhd8ed1ab_1    conda-forge
batoid                    0.7.3           py311h7db5c69_3    conda-forge
batoid-rubin              0.5.0              pyh707e725_0    conda-forge
bcrypt                    4.2.0           py311h9e33e62_1    conda-forge
beautifulsoup4            4.12.3             pyha770c72_0    conda-forge
binutils                  2.43                 h4852527_1    conda-forge
binutils_impl_linux-64    2.43                 h4bf12b8_1    conda-forge
binutils_linux-64         2.43                 h4852527_1    conda-forge
blinker                   1.8.2              pyhd8ed1ab_0    conda-forge
blosc                     1.21.6               hef167b5_0    conda-forge
boltons                   24.0.0             pyhd8ed1ab_0    conda-forge
boto3                     1.35.23            pyhd8ed1ab_0    conda-forge
botocore                  1.35.23         pyge310_1234567_0    conda-forge
bottleneck                1.4.0           py311h9f3472d_2    conda-forge
brotli                    1.1.0                hb9d3cd8_2    conda-forge
brotli-bin                1.1.0                hb9d3cd8_2    conda-forge
brotli-python             1.1.0           py311hfdbb021_2    conda-forge
brunsli                   0.1                  h9c3ff4c_0    conda-forge
bzip2                     1.0.8                h4bc722e_7    conda-forge
c-ares                    1.33.1               heb4867d_0    conda-forge
c-blosc2                  2.15.1               hc57e6cf_0    conda-forge
c-compiler                1.7.0                hd590300_1    conda-forge
ca-certificates           2024.8.30            hbcca054_0    conda-forge
cached-property           1.5.2                hd8ed1ab_1    conda-forge
cached_property           1.5.2              pyha770c72_1    conda-forge
cachetools                5.5.0              pyhd8ed1ab_0    conda-forge
cairo                     1.18.0               hbb29018_2    conda-forge
cassandra-driver          3.29.2          py311he455363_0    conda-forge
certifi                   2024.8.30          pyhd8ed1ab_0    conda-forge
cffi                      1.17.1          py311hf29c0ef_0    conda-forge
cfitsio                   4.4.0                hbdc6101_1    conda-forge
charls                    2.4.2                h59595ed_0    conda-forge
charset-normalizer        3.3.2              pyhd8ed1ab_0    conda-forge
cli_helpers               2.3.1              pyhd8ed1ab_0    conda-forge
click                     8.1.7           unix_pyh707e725_0    conda-forge
click-plugins             1.1.1                      py_0    conda-forge
cligj                     0.7.2              pyhd8ed1ab_1    conda-forge
cmake                     3.30.3               hf9cb763_0    conda-forge
colorama                  0.4.6              pyhd8ed1ab_0    conda-forge
coloredlogs               15.0.1             pyhd8ed1ab_3    conda-forge
colour-science            0.4.4              pyh6c4a22f_0    conda-forge
comm                      0.2.2              pyhd8ed1ab_0    conda-forge
compilers                 1.7.0                ha770c72_1    conda-forge
conda                     24.7.1          py311h38be061_0    conda-forge
conda-libmamba-solver     24.7.0             pyhd8ed1ab_0    conda-forge
conda-package-handling    2.3.0              pyh7900ff3_0    conda-forge
conda-package-streaming   0.10.0             pyhd8ed1ab_0    conda-forge
configobj                 5.0.9              pyhd8ed1ab_0    conda-forge
configparser              7.1.0              pyhd8ed1ab_0    conda-forge
contourpy                 1.3.0           py311hd18a35c_2    conda-forge
coverage                  7.6.1           py311h9ecbd09_1    conda-forge
coveralls                 4.0.1              pyhd8ed1ab_0    conda-forge
cryptography              43.0.1          py311hafd3f86_0    conda-forge
cspice                    67                   hd590300_6    conda-forge
cuda-cccl_linux-64        12.6.37              ha770c72_0    conda-forge
cuda-crt-dev_linux-64     12.6.68              ha770c72_0    conda-forge
cuda-crt-tools            12.6.68              ha770c72_0    conda-forge
cuda-cudart               12.6.68              h5888daf_0    conda-forge
cuda-cudart-dev           12.6.68              h5888daf_0    conda-forge
cuda-cudart-dev_linux-64  12.6.68              h3f2d84a_0    conda-forge
cuda-cudart-static        12.6.68              h5888daf_0    conda-forge
cuda-cudart-static_linux-64 12.6.68              h3f2d84a_0    conda-forge
cuda-cudart_linux-64      12.6.68              h3f2d84a_0    conda-forge
cuda-cupti                12.6.68              h5888daf_0    conda-forge
cuda-driver-dev_linux-64  12.6.68              h3f2d84a_0    conda-forge
cuda-nvcc                 12.6.68              hcdd1206_0    conda-forge
cuda-nvcc-dev_linux-64    12.6.68              he91c749_0    conda-forge
cuda-nvcc-impl            12.6.68              h85509e4_0    conda-forge
cuda-nvcc-tools           12.6.68              he02047a_0    conda-forge
cuda-nvcc_linux-64        12.6.68              h8a487aa_0    conda-forge
cuda-nvrtc                12.6.68              h5888daf_0    conda-forge
cuda-nvtx                 12.6.68              h5888daf_0    conda-forge
cuda-nvvm-dev_linux-64    12.6.68              ha770c72_0    conda-forge
cuda-nvvm-impl            12.6.68              he02047a_0    conda-forge
cuda-nvvm-tools           12.6.68              he02047a_0    conda-forge
cuda-version              12.6                 h7480c83_3    conda-forge
cudnn                     9.2.1.18             hbc370b7_0    conda-forge
cxx-compiler              1.7.0                h00ab1b0_1    conda-forge
cycler                    0.12.1             pyhd8ed1ab_0    conda-forge
cyrus-sasl                2.1.27               h54b06d7_7    conda-forge
danish                    0.5.0           py311hfdbb021_2    conda-forge
dav1d                     1.2.1                hd590300_0    conda-forge
dbus                      1.13.6               h5008d03_3    conda-forge
decorator                 5.1.1              pyhd8ed1ab_0    conda-forge
deepdiff                  8.0.1              pyhd8ed1ab_0    conda-forge
defusedxml                0.7.1              pyhd8ed1ab_0    conda-forge
deprecated                1.2.14             pyh1a96a4e_0    conda-forge
dill                      0.3.8              pyhd8ed1ab_0    conda-forge
distro                    1.9.0              pyhd8ed1ab_0    conda-forge
docopt                    0.6.2                      py_1    conda-forge
dogpile.cache             1.2.2              pyhd8ed1ab_1    conda-forge
double-conversion         3.3.0                h59595ed_0    conda-forge
doxygen                   1.10.0               h661eb56_0    conda-forge
dustmaps                  1.0.13          py311h38be061_0    conda-forge
eigen                     3.4.0                h00ab1b0_0    conda-forge
emcee                     3.1.6              pyhd8ed1ab_0    conda-forge
esutil                    0.6.14          py311h7db5c69_1    conda-forge
eups                      2.2.10          py311h38be061_1    conda-forge
exceptiongroup            1.2.2              pyhd8ed1ab_0    conda-forge
execnet                   2.1.1              pyhd8ed1ab_0    conda-forge
executing                 2.1.0              pyhd8ed1ab_0    conda-forge
expat                     2.6.3                h5888daf_0    conda-forge
fastavro                  1.9.7           py311h9ecbd09_0    conda-forge
ffmpeg                    6.1.1           gpl_h9be9148_116    conda-forge
fftw                      3.3.10          nompi_hf1063bd_110    conda-forge
filelock                  3.16.1             pyhd8ed1ab_0    conda-forge
firefly-client            3.1.0              pyhd8ed1ab_0    conda-forge
fitsio                    1.2.4           py311hfd33317_1    conda-forge
fitsverify                4.22                 h82ae5b5_1    conda-forge
flake8                    7.1.0              pyhd8ed1ab_0    conda-forge
flask                     3.0.3              pyhd8ed1ab_0    conda-forge
flask-cors                5.0.0              pyhd8ed1ab_0    conda-forge
fmt                       10.2.1               h00ab1b0_0    conda-forge
font-ttf-dejavu-sans-mono 2.37                 hab24e00_0    conda-forge
font-ttf-inconsolata      3.000                h77eed37_0    conda-forge
font-ttf-source-code-pro  2.038                h77eed37_0    conda-forge
font-ttf-ubuntu           0.83                 h77eed37_2    conda-forge
fontconfig                2.14.2               h14ed4e7_0    conda-forge
fonts-conda-ecosystem     1                             0    conda-forge
fonts-conda-forge         1                             0    conda-forge
fonttools                 4.54.1          py311h9ecbd09_0    conda-forge
fortran-compiler          1.7.0                heb67821_1    conda-forge
freeglut                  3.2.2                ha6d2627_3    conda-forge
freetype                  2.12.1               h267a509_2    conda-forge
freexl                    2.0.0                h743c826_0    conda-forge
fribidi                   1.0.10               h36c2ea0_0    conda-forge
frozendict                2.4.4           py311h9ecbd09_1    conda-forge
frozenlist                1.4.1           py311h9ecbd09_1    conda-forge
fsspec                    2024.9.0           pyhff2d567_0    conda-forge
future                    1.0.0              pyhd8ed1ab_0    conda-forge
galsim                    2.6.0           py311h8f85c52_2    conda-forge
gcc                       12.4.0               h236703b_1    conda-forge
gcc_impl_linux-64         12.4.0               hb2e57f8_1    conda-forge
gcc_linux-64              12.4.0               h6b7512a_4    conda-forge
geomet                    0.2.1.post1        pyh9f0ad1d_0    conda-forge
geos                      3.12.1               h59595ed_0    conda-forge
geotiff                   1.7.3                hf7fa9e8_2    conda-forge
getcalspec                2.1.0              pyhd8ed1ab_0    conda-forge
gettext                   0.22.5               he02047a_3    conda-forge
gettext-tools             0.22.5               he02047a_3    conda-forge
gflags                    2.2.2             h5888daf_1005    conda-forge
gfortran                  12.4.0               h236703b_1    conda-forge
gfortran_impl_linux-64    12.4.0               hc568b83_1    conda-forge
gfortran_linux-64         12.4.0               hd748a6a_4    conda-forge
giflib                    5.2.2                hd590300_0    conda-forge
ginga                     5.1.0              pyhd8ed1ab_0    conda-forge
git                       2.45.2          pl5321he096aa3_0    conda-forge
git-lfs                   3.5.1                ha770c72_0    conda-forge
globus-sdk                3.45.0             pyhd8ed1ab_0    conda-forge
glog                      0.7.1                hbabe93e_0    conda-forge
gmp                       6.3.0                hac33072_2    conda-forge
gmpy2                     2.1.5           py311h0f6cedb_2    conda-forge
gnutls                    3.7.9                hb077bed_0    conda-forge
graphite2                 1.3.13            h59595ed_1003    conda-forge
greenlet                  3.1.1           py311hfdbb021_0    conda-forge
gsl                       2.7                  he838d99_0    conda-forge
gsoap                     2.8.123              h8dc497d_0    conda-forge
gwcs                      0.21.0             pyhd8ed1ab_0    conda-forge
gxx                       12.4.0               h236703b_1    conda-forge
gxx_impl_linux-64         12.4.0               h613a52c_1    conda-forge
gxx_linux-64              12.4.0               h8489865_4    conda-forge
h11                       0.14.0             pyhd8ed1ab_0    conda-forge
h2                        4.1.0              pyhd8ed1ab_0    conda-forge
h5py                      3.11.0          nompi_py311h439e445_102    conda-forge
harfbuzz                  9.0.0                hfac3d4d_0    conda-forge
hdf4                      4.2.15               h2a13503_7    conda-forge
hdf5                      1.14.3          nompi_hdf9ad27_105    conda-forge
healpy                    1.16.6          py311h9e3404a_5    conda-forge
healsparse                1.10.1             pyhd8ed1ab_0    conda-forge
hpack                     4.0.0              pyh9f0ad1d_0    conda-forge
hpgeom                    1.3.2           py311h9f3472d_0    conda-forge
htcondor                  23.0.3          py311h38be061_0    conda-forge
htcondor-classads         23.0.3               hc9a1274_0    conda-forge
htcondor-utils            23.0.3               h841b71b_0    conda-forge
html5lib                  1.1                pyh9f0ad1d_0    conda-forge
httpcore                  1.0.5              pyhd8ed1ab_0    conda-forge
httpretty                 1.1.4              pyhd8ed1ab_0    conda-forge
httpx                     0.27.2             pyhd8ed1ab_0    conda-forge
humanfriendly             10.0               pyhd8ed1ab_6    conda-forge
humanize                  4.10.0             pyhd8ed1ab_0    conda-forge
hyperframe                6.0.1              pyhd8ed1ab_0    conda-forge
icu                       73.2                 h59595ed_0    conda-forge
idds-client               2.1.37             pyhd8ed1ab_0    conda-forge
idds-common               2.1.37             pyhd8ed1ab_0    conda-forge
idds-doma                 2.1.37             pyhd8ed1ab_0    conda-forge
idds-workflow             2.1.37             pyhd8ed1ab_0    conda-forge
idna                      3.10               pyhd8ed1ab_0    conda-forge
imagecodecs               2024.6.1        py311hb8791aa_2    conda-forge
imageio                   2.35.1             pyh12aca89_0    conda-forge
imath                     3.1.12               h7955e40_0    conda-forge
iminuit                   2.30.0          py311hfdbb021_0    conda-forge
importlib-metadata        8.5.0              pyha770c72_0    conda-forge
importlib_resources       6.4.5              pyhd8ed1ab_0    conda-forge
iniconfig                 2.0.0              pyhd8ed1ab_0    conda-forge
ipython                   8.27.0             pyh707e725_0    conda-forge
ipywidgets                8.1.5              pyhd8ed1ab_0    conda-forge
itsdangerous              2.2.0              pyhd8ed1ab_0    conda-forge
jaraco.classes            3.4.0              pyhd8ed1ab_1    conda-forge
jaraco.context            5.3.0              pyhd8ed1ab_1    conda-forge
jaraco.functools          4.0.0              pyhd8ed1ab_0    conda-forge
jasper                    4.2.4                h536e39c_0    conda-forge
jax                       0.4.31             pyhd8ed1ab_1    conda-forge
jaxlib                    0.4.31          cuda120py311hd88f13b_201    conda-forge
jedi                      0.19.1             pyhd8ed1ab_0    conda-forge
jeepney                   0.8.0              pyhd8ed1ab_0    conda-forge
jinja2                    3.1.4              pyhd8ed1ab_0    conda-forge
jmespath                  1.0.1              pyhd8ed1ab_0    conda-forge
joblib                    1.4.2              pyhd8ed1ab_0    conda-forge
joserfc                   1.0.0              pyhd8ed1ab_0    conda-forge
jq                        1.7.1                hd590300_0    conda-forge
json-c                    0.17                 h1220068_1    conda-forge
jsondiff                  2.0.0              pyhd8ed1ab_0    conda-forge
jsonpatch                 1.33               pyhd8ed1ab_0    conda-forge
jsonpointer               3.0.0           py311h38be061_1    conda-forge
jsonschema                4.23.0             pyhd8ed1ab_0    conda-forge
jsonschema-path           0.3.3              pyhd8ed1ab_0    conda-forge
jsonschema-specifications 2023.12.1          pyhd8ed1ab_0    conda-forge
jupyterlab_widgets        3.0.13             pyhd8ed1ab_0    conda-forge
jxrlib                    1.1                  hd590300_3    conda-forge
kealib                    1.5.3                hf8d3e68_2    conda-forge
kernel-headers_linux-64   3.10.0              h4a8ded7_16    conda-forge
keyring                   25.4.1             pyha804496_0    conda-forge
keyutils                  1.6.1                h166bdaf_0    conda-forge
kiwisolver                1.4.7           py311hd18a35c_0    conda-forge
krb5                      1.21.3               h659f571_0    conda-forge
lame                      3.100             h166bdaf_1003    conda-forge
lazy-loader               0.4                pyhd8ed1ab_1    conda-forge
lazy-object-proxy         1.10.0          py311h459d7ec_0    conda-forge
lazy_loader               0.4                pyhd8ed1ab_1    conda-forge
lcms2                     2.16                 hb7c19ff_0    conda-forge
ld_impl_linux-64          2.43                 h712a8e2_1    conda-forge
lerc                      4.0.0                h27087fc_0    conda-forge
libabseil                 20240116.2      cxx17_he02047a_1    conda-forge
libaec                    1.1.3                h59595ed_0    conda-forge
libapr                    1.7.0                hd590300_6    conda-forge
libapriconv               1.2.2                hd590300_6    conda-forge
libaprutil                1.6.1                h40f5838_6    conda-forge
libarchive                3.7.4                hfca40fe_0    conda-forge
libarrow                  17.0.0           h4b47046_3_cpu    conda-forge
libarrow-acero            17.0.0           he02047a_3_cpu    conda-forge
libarrow-dataset          17.0.0           he02047a_3_cpu    conda-forge
libarrow-substrait        17.0.0           hc9a23c6_3_cpu    conda-forge
libasprintf               0.22.5               he8f35ee_3    conda-forge
libasprintf-devel         0.22.5               he8f35ee_3    conda-forge
libass                    0.17.1               h39113c1_2    conda-forge
libavif16                 1.1.1                h9b56c87_0    conda-forge
libblas                   3.9.0           24_linux64_openblas    conda-forge
libboost                  1.82.0               h6fcfa73_6    conda-forge
libboost-devel            1.82.0               h00ab1b0_6    conda-forge
libboost-headers          1.82.0               ha770c72_6    conda-forge
libboost-python           1.82.0          py311h92ebd52_6    conda-forge
libboost-python-devel     1.82.0          py311h781c19f_6    conda-forge
libbrotlicommon           1.1.0                hb9d3cd8_2    conda-forge
libbrotlidec              1.1.0                hb9d3cd8_2    conda-forge
libbrotlienc              1.1.0                hb9d3cd8_2    conda-forge
libcblas                  3.9.0           24_linux64_openblas    conda-forge
libclang-cpp18.1          18.1.8          default_hf981a13_5    conda-forge
libclang13                19.1.0          default_h9c6a7e4_0    conda-forge
libcondor_utils           23.0.3               h5fb16dd_0    conda-forge
libcrc32c                 1.1.2                h9c3ff4c_0    conda-forge
libcublas                 12.6.1.4             h5888daf_0    conda-forge
libcufft                  11.2.6.59            h5888daf_0    conda-forge
libcups                   2.3.3                h4637d8d_4    conda-forge
libcurand                 10.3.7.68            h5888daf_0    conda-forge
libcurl                   8.10.1               hbbe4b11_0    conda-forge
libcusolver               11.6.4.69            h5888daf_0    conda-forge
libcusparse               12.5.3.3             h5888daf_0    conda-forge
libcxx                    16.0.6               he02047a_2    conda-forge
libcxxabi                 16.0.6               h4bc722e_2    conda-forge
libdeflate                1.20                 hd590300_0    conda-forge
libdrm                    2.4.123              hb9d3cd8_0    conda-forge
libedit                   3.1.20191231         he28a2e2_2    conda-forge
libegl                    1.7.0                ha4b6fd6_0    conda-forge
libev                     4.33                 hd590300_2    conda-forge
libevent                  2.1.12               hf998b51_1    conda-forge
libexpat                  2.6.3                h5888daf_0    conda-forge
libffi                    3.4.2                h7f98852_5    conda-forge
libgcc                    14.1.0               h77fa898_1    conda-forge
libgcc-devel_linux-64     12.4.0             ha4f9413_101    conda-forge
libgcc-ng                 14.1.0               h69a702a_1    conda-forge
libgdal                   3.9.1                h471f4ab_0    conda-forge
libgettextpo              0.22.5               he02047a_3    conda-forge
libgettextpo-devel        0.22.5               he02047a_3    conda-forge
libgfortran               14.1.0               h69a702a_1    conda-forge
libgfortran-ng            14.1.0               h69a702a_1    conda-forge
libgfortran5              14.1.0               hc5f4f2c_1    conda-forge
libgl                     1.7.0                ha4b6fd6_0    conda-forge
libglib                   2.80.2               hf974151_0    conda-forge
libglu                    9.0.0             ha6d2627_1004    conda-forge
libglvnd                  1.7.0                ha4b6fd6_0    conda-forge
libglx                    1.7.0                ha4b6fd6_0    conda-forge
libgomp                   14.1.0               h77fa898_1    conda-forge
libgoogle-cloud           2.26.0               h26d7fe4_0    conda-forge
libgoogle-cloud-storage   2.26.0               ha262f82_0    conda-forge
libgrpc                   1.62.2               h15f2491_0    conda-forge
libhwloc                  2.11.1          default_hecaa2ac_1000    conda-forge
libhwy                    1.1.0                h00ab1b0_0    conda-forge
libiconv                  1.17                 hd590300_2    conda-forge
libidn2                   2.3.7                hd590300_0    conda-forge
libjpeg-turbo             3.0.0                hd590300_1    conda-forge
libjxl                    0.10.3               h66b40c8_0    conda-forge
libkml                    1.3.0             hf539b9f_1021    conda-forge
liblapack                 3.9.0           24_linux64_openblas    conda-forge
liblapacke                3.9.0           24_linux64_openblas    conda-forge
libllvm14                 14.0.6               hcd5def8_4    conda-forge
libllvm18                 18.1.8               h8b73ec9_2    conda-forge
libllvm19                 19.1.0               ha7bfdaf_0    conda-forge
libmamba                  1.5.10               h4cc3d14_0    conda-forge
libmambapy                1.5.10          py311h7f1ffb1_0    conda-forge
libnetcdf                 4.9.2           nompi_h135f659_114    conda-forge
libnghttp2                1.58.0               h47da74e_1    conda-forge
libnsl                    2.0.1                hd590300_0    conda-forge
libntlm                   1.4               h7f98852_1002    conda-forge
libnvjitlink              12.6.68              h5888daf_1    conda-forge
libopenblas               0.3.27          pthreads_hac2b453_1    conda-forge
libopencv                 4.10.0          qt6_py311h266c844_602    conda-forge
libopenvino               2024.2.0             h2da1b83_1    conda-forge
libopenvino-auto-batch-plugin 2024.2.0             hb045406_1    conda-forge
libopenvino-auto-plugin   2024.2.0             hb045406_1    conda-forge
libopenvino-hetero-plugin 2024.2.0             h5c03a75_1    conda-forge
libopenvino-intel-cpu-plugin 2024.2.0             h2da1b83_1    conda-forge
libopenvino-intel-gpu-plugin 2024.2.0             h2da1b83_1    conda-forge
libopenvino-intel-npu-plugin 2024.2.0             he02047a_1    conda-forge
libopenvino-ir-frontend   2024.2.0             h5c03a75_1    conda-forge
libopenvino-onnx-frontend 2024.2.0             h07e8aee_1    conda-forge
libopenvino-paddle-frontend 2024.2.0             h07e8aee_1    conda-forge
libopenvino-pytorch-frontend 2024.2.0             he02047a_1    conda-forge
libopenvino-tensorflow-frontend 2024.2.0             h39126c6_1    conda-forge
libopenvino-tensorflow-lite-frontend 2024.2.0             he02047a_1    conda-forge
libopus                   1.3.1                h7f98852_1    conda-forge
libparquet                17.0.0           h9e5060d_3_cpu    conda-forge
libpciaccess              0.18                 hd590300_0    conda-forge
libpng                    1.6.44               hadc24fc_0    conda-forge
libpq                     16.4                 h2d7952a_1    conda-forge
libprotobuf               4.25.3               hd5b35b9_1    conda-forge
librdkafka                1.9.2                ha5a0de0_2    conda-forge
libre2-11                 2023.09.01           h5a48ba9_2    conda-forge
librttopo                 1.1.0               h8917695_15    conda-forge
libsanitizer              12.4.0               h46f95d5_1    conda-forge
libsodium                 1.0.20               h4ab18f5_0    conda-forge
libsolv                   0.7.30               h3509ff9_0    conda-forge
libspatialite             5.1.0                h6fbd9c4_7    conda-forge
libsqlite                 3.46.1               hadc24fc_0    conda-forge
libssh2                   1.11.0               h0841786_0    conda-forge
libstdcxx                 14.1.0               hc0a3c3a_1    conda-forge
libstdcxx-devel_linux-64  12.4.0             ha4f9413_101    conda-forge
libstdcxx-ng              14.1.0               h4852527_1    conda-forge
libtasn1                  4.19.0               h166bdaf_0    conda-forge
libthrift                 0.19.0               hb90f79a_1    conda-forge
libtiff                   4.6.0                h1dd3fc0_3    conda-forge
libtorch                  2.4.0           cpu_generic_h4a3044c_1    conda-forge
libunistring              0.9.10               h7f98852_0    conda-forge
libutf8proc               2.8.0                h166bdaf_0    conda-forge
libuuid                   2.38.1               h0b41bf4_0    conda-forge
libuv                     1.49.0               hb9d3cd8_0    conda-forge
libva                     2.22.0               h8a09558_1    conda-forge
libvpx                    1.14.1               hac33072_0    conda-forge
libwebp-base              1.4.0                hd590300_0    conda-forge
libxcb                    1.17.0               h8a09558_0    conda-forge
libxcrypt                 4.4.36               hd590300_1    conda-forge
libxkbcommon              1.7.0                h2c5496b_1    conda-forge
libxml2                   2.12.7               h4c95cb1_3    conda-forge
libxslt                   1.1.39               h76b75d6_0    conda-forge
libzip                    1.11.1               hf83b1b0_0    conda-forge
libzlib                   1.3.1                h4ab18f5_1    conda-forge
libzopfli                 1.0.3                h9c3ff4c_0    conda-forge
llvmlite                  0.43.0          py311h9c9ff8c_1    conda-forge
lmfit                     1.2.2              pyhd8ed1ab_1    conda-forge
log4cxx                   1.2.0                ha5ff813_1    conda-forge
lsst-ts-xml               21.0.0             pyh707e725_0    conda-forge
lsstdesc.coord            1.3.0           py311hd18a35c_2    conda-forge
lxml                      5.3.0           py311hcfaa980_1    conda-forge
lz4-c                     1.9.4                hcb278e6_0    conda-forge
lzo                       2.10              hd590300_1001    conda-forge
make                      4.4.1                hb9d3cd8_1    conda-forge
mako                      1.3.5              pyhd8ed1ab_0    conda-forge
markupsafe                2.1.5           py311h9ecbd09_1    conda-forge
matplotlib-base           3.9.2           py311h2b939e6_1    conda-forge
matplotlib-inline         0.1.7              pyhd8ed1ab_0    conda-forge
mccabe                    0.7.0              pyhd8ed1ab_0    conda-forge
menuinst                  2.1.2           py311h38be061_1    conda-forge
meson                     1.5.2              pyhd8ed1ab_0    conda-forge
minizip                   4.0.7                h401b404_0    conda-forge
minuit2                   6.22.06         minuit2_standalone    conda-forge
minuit2_standalone        6.22.06            h9c3ff4c_100    conda-forge
ml_dtypes                 0.5.0           py311h7db5c69_0    conda-forge
mock                      5.1.0              pyhd8ed1ab_0    conda-forge
more-itertools            10.5.0             pyhd8ed1ab_0    conda-forge
moto                      5.0.15             pyhd8ed1ab_0    conda-forge
mpc                       1.3.1                h24ddda3_1    conda-forge
mpfr                      4.2.1                h90cbb55_3    conda-forge
mpi                       1.0                       mpich    conda-forge
mpi4py                    4.0.0           py311h50ea477_3    conda-forge
mpich                     4.2.2              h4a7f18d_101    conda-forge
mpmath                    1.3.0              pyhd8ed1ab_0    conda-forge
multidict                 6.1.0           py311h9ecbd09_0    conda-forge
multiprocess              0.70.16         py311h9ecbd09_1    conda-forge
munge                     0.5.16               h63a00c3_0    conda-forge
munkres                   1.1.4              pyh9f0ad1d_0    conda-forge
mysql-common              8.3.0                h70512c7_5    conda-forge
mysql-libs                8.3.0                ha479ceb_5    conda-forge
nccl                      2.22.3.1             hbc370b7_1    conda-forge
ncurses                   6.5                  he02047a_1    conda-forge
ndarray                   1.6.4                h310167e_3    conda-forge
nest-asyncio              1.6.0              pyhd8ed1ab_0    conda-forge
nettle                    3.9.1                h7ab15ed_0    conda-forge
networkx                  3.3                pyhd8ed1ab_1    conda-forge
ngmix-core                2.3.1           py311h38be061_0    conda-forge
ninja                     1.12.1               h297d8ca_0    conda-forge
nomkl                     1.0                  h5ca1d4c_0    conda-forge
nose                      1.3.7                   py_1006    conda-forge
nspr                      4.35                 h27087fc_0    conda-forge
nss                       3.104                hd34e28f_0    conda-forge
numba                     0.60.0          py311h4bc866e_0    conda-forge
numexpr                   2.10.0          py311h8d05612_100    conda-forge
numpy                     1.26.4          py311h64a7726_0    conda-forge
ocl-icd                   2.3.2                hd590300_1    conda-forge
oniguruma                 6.9.9                hd590300_0    conda-forge
openapi-schema-validator  0.6.2              pyhd8ed1ab_0    conda-forge
openapi-spec-validator    0.7.1              pyhd8ed1ab_0    conda-forge
openblas                  0.3.27          pthreads_h9eca1d5_1    conda-forge
opencv                    4.10.0          qt6_py311hc414901_602    conda-forge
openexr                   3.2.2                h04e0de5_2    conda-forge
openh264                  2.4.1                h59595ed_0    conda-forge
openjpeg                  2.5.2                h488ebb8_0    conda-forge
openssl                   3.3.2                hb9d3cd8_0    conda-forge
opt-einsum                3.3.0                hd8ed1ab_2    conda-forge
opt_einsum                3.3.0              pyhc1e730c_2    conda-forge
orc                       2.0.1                h17fec99_1    conda-forge
orderly-set               5.2.2              pyhd8ed1ab_0    conda-forge
p11-kit                   0.24.1               hc5aa10d_0    conda-forge
packaging                 24.1               pyhd8ed1ab_0    conda-forge
panda-client              1.5.78             pyhd8ed1ab_0    conda-forge
pandas                    2.2.3           py311h7db5c69_1    conda-forge
paramiko                  3.5.0              pyhd8ed1ab_0    conda-forge
parsl                     2024.4.29          pyhd8ed1ab_0    conda-forge
parso                     0.8.4              pyhd8ed1ab_0    conda-forge
patch                     2.7.6             h7f98852_1002    conda-forge
pathable                  0.4.3              pyhd8ed1ab_0    conda-forge
patsy                     0.5.6              pyhd8ed1ab_0    conda-forge
pbr                       6.1.0              pyhd8ed1ab_0    conda-forge
pcre2                     10.43                hcad00b1_0    conda-forge
pendulum                  3.0.0           py311h9e33e62_1    conda-forge
pep8-naming               0.14.1             pyhd8ed1ab_0    conda-forge
perl                      5.32.1          7_hd590300_perl5    conda-forge
pexpect                   4.9.0              pyhd8ed1ab_0    conda-forge
pgcli                     4.1.0              pyhd8ed1ab_0    conda-forge
pgplot                    5.2.2             hbeaba86_1009    conda-forge
pgspecial                 2.1.2              pyhd8ed1ab_0    conda-forge
photutils                 1.13.0          py311h07ce7c0_0    conda-forge
pickleshare               0.7.5                   py_1003    conda-forge
piff                      1.4.1           py311h38be061_1    conda-forge
pillow                    10.4.0          py311h4aec55e_1    conda-forge
pip                       24.2               pyh8b19718_1    conda-forge
pixman                    0.43.2               h59595ed_0    conda-forge
pkg-config                0.29.2            h4bc722e_1009    conda-forge
pkgutil-resolve-name      1.3.10             pyhd8ed1ab_1    conda-forge
platformdirs              4.3.6              pyhd8ed1ab_0    conda-forge
pluggy                    1.5.0              pyhd8ed1ab_0    conda-forge
pooch                     1.8.2              pyhd8ed1ab_0    conda-forge
poppler                   24.04.0              hb6cd0d7_0    conda-forge
poppler-data              0.4.12               hd8ed1ab_0    conda-forge
postgresql                16.4                 hb2eb5c0_1    conda-forge
prmon                     3.1.0                h636ad5a_1    conda-forge
progressbar2              4.5.0              pyhd8ed1ab_0    conda-forge
proj                      9.4.1                h54d7996_1    conda-forge
prompt-toolkit            3.0.47             pyha770c72_0    conda-forge
prompt_toolkit            3.0.47               hd8ed1ab_0    conda-forge
psutil                    6.0.0           py311h9ecbd09_1    conda-forge
psycopg                   3.2.2           py311h0cfe25b_0    conda-forge
psycopg-c                 3.2.2           py311h125dfe0_0    conda-forge
psycopg2                  2.9.9           py311h03dec38_0    conda-forge
pthread-stubs             0.4               hb9d3cd8_1002    conda-forge
ptyprocess                0.7.0              pyhd3deb0d_0    conda-forge
pugixml                   1.14                 h59595ed_0    conda-forge
pure_eval                 0.2.3              pyhd8ed1ab_0    conda-forge
py-cpuinfo                9.0.0              pyhd8ed1ab_0    conda-forge
py-opencv                 4.10.0          qt6_py311h074fb97_602    conda-forge
pyarrow                   17.0.0          py311hbd00459_1    conda-forge
pyarrow-core              17.0.0          py311h4510849_1_cpu    conda-forge
pybind11                  2.13.6          py311hd18a35c_0    conda-forge
pybind11-abi              4                    hd8ed1ab_3    conda-forge
pybind11-global           2.13.6          py311hd18a35c_0    conda-forge
pycodestyle               2.12.1             pyhd8ed1ab_0    conda-forge
pycosat                   0.6.6           py311h459d7ec_0    conda-forge
pycparser                 2.22               pyhd8ed1ab_0    conda-forge
pydantic                  2.9.2              pyhd8ed1ab_0    conda-forge
pydantic-core             2.23.4          py311h9e33e62_0    conda-forge
pyerfa                    2.0.1.4         py311h9f3472d_2    conda-forge
pyflakes                  3.2.0              pyhd8ed1ab_0    conda-forge
pygments                  2.18.0             pyhd8ed1ab_0    conda-forge
pyjwt                     2.9.0              pyhd8ed1ab_1    conda-forge
pyld                      2.0.4              pyhd8ed1ab_0    conda-forge
pynacl                    1.5.0           py311h9ecbd09_4    conda-forge
pyparsing                 3.1.4              pyhd8ed1ab_0    conda-forge
pyproj                    3.6.1           py311h58d3061_9    conda-forge
pysocks                   1.7.1              pyha2e5f31_6    conda-forge
pysynphot                 2.0.0           py311h1f0f07a_6    conda-forge
pytables                  3.10.1          py311h17fbfd3_1    conda-forge
pytest                    8.3.3              pyhd8ed1ab_0    conda-forge
pytest-cov                5.0.0              pyhd8ed1ab_0    conda-forge
pytest-doctestplus        1.2.1              pyhd8ed1ab_0    conda-forge
pytest-openfiles          0.5.0                      py_0    conda-forge
pytest-runner             6.0.0              pyhd8ed1ab_0    conda-forge
pytest-session2file       0.1.11             pyh44b312d_0    conda-forge
pytest-subtests           0.13.1             pyhd8ed1ab_0    conda-forge
pytest-vcr                1.0.2              pyh9f0ad1d_0    conda-forge
pytest-xdist              3.6.1              pyhd8ed1ab_0    conda-forge
python                    3.11.10         hc5c86c4_1_cpython    conda-forge
python-confluent-kafka    1.9.2           py311hd4cff14_2    conda-forge
python-dateutil           2.9.0              pyhd8ed1ab_0    conda-forge
python-htcondor           23.0.3          py311h949af2a_0    conda-forge
python-tzdata             2024.2             pyhd8ed1ab_0    conda-forge
python-utils              3.8.2              pyhd8ed1ab_0    conda-forge
python-wget               3.2                        py_0    conda-forge
python_abi                3.11                    5_cp311    conda-forge
pytorch                   2.4.0           cpu_generic_py311h7a8ff39_1    conda-forge
pytz                      2024.1             pyhd8ed1ab_0    conda-forge
pyvo                      1.5.2              pyhd8ed1ab_0    conda-forge
pywavelets                1.7.0           py311h9f3472d_1    conda-forge
pyyaml                    6.0.2           py311h9ecbd09_1    conda-forge
pyzmq                     26.2.0          py311h7deb3e3_2    conda-forge
qhull                     2020.2               h434a139_5    conda-forge
qt6-main                  6.7.2                h7d13b96_3    conda-forge
qtpy                      2.4.1              pyhd8ed1ab_0    conda-forge
rasterio                  1.3.10          py311h539dff6_4    conda-forge
rav1e                     0.6.6                he8a937b_2    conda-forge
re2                       2023.09.01           h7f4b329_2    conda-forge
readline                  8.2                  h8228510_1    conda-forge
rebound                   4.4.1           py311h61187de_2    conda-forge
referencing               0.35.1             pyhd8ed1ab_0    conda-forge
reproc                    14.2.4.post0         hd590300_1    conda-forge
reproc-cpp                14.2.4.post0         h59595ed_1    conda-forge
requests                  2.32.3             pyhd8ed1ab_0    conda-forge
responses                 0.25.3             pyhd8ed1ab_0    conda-forge
rfc3339-validator         0.1.4              pyhd8ed1ab_0    conda-forge
rhash                     1.4.4                hd590300_0    conda-forge
rpds-py                   0.20.0          py311h9e33e62_1    conda-forge
ruamel.yaml               0.18.6          py311h459d7ec_0    conda-forge
ruamel.yaml.clib          0.2.8           py311h459d7ec_0    conda-forge
rubin-env                 9.0.0           py311h98d72c0_6    conda-forge
rubin-env-nosysroot       9.0.0           py311h85c7640_6    conda-forge
rucio-clients             35.4.0             pyhd8ed1ab_0    conda-forge
ruff                      0.5.2           py311hce3a109_0    conda-forge
s2n                       1.4.17               he19d79f_0    conda-forge
s3fs                      2024.9.0           pyhd8ed1ab_0    conda-forge
s3transfer                0.10.2             pyhd8ed1ab_0    conda-forge
sbpy                      0.3.0              pyhd8ed1ab_0    conda-forge
schwimmbad                0.4.2           py311h38be061_1    conda-forge
scikit-image              0.24.0          py311h044e617_2    conda-forge
scikit-learn              1.5.2           py311h57cc02b_1    conda-forge
scipy                     1.13.1          py311h517d4fd_0    conda-forge
scitokens-cpp             1.1.1                h475ca95_0    conda-forge
scons                     4.7.0           py311h38be061_0    conda-forge
seaborn                   0.13.2               hd8ed1ab_2    conda-forge
seaborn-base              0.13.2             pyhd8ed1ab_2    conda-forge
secretstorage             3.3.3           py311h38be061_3    conda-forge
semantic_version          2.10.0             pyhd8ed1ab_0    conda-forge
setproctitle              1.3.3           py311h9ecbd09_1    conda-forge
setuptools                72.1.0             pyhd8ed1ab_0    conda-forge
setuptools-scm            8.1.0              pyhd8ed1ab_0    conda-forge
shapely                   2.0.4           py311h0bed3d6_1    conda-forge
six                       1.16.0             pyh6c4a22f_0    conda-forge
skyproj                   1.2.4              pyhd8ed1ab_0    conda-forge
sleef                     3.7                  h1b44611_0    conda-forge
snappy                    1.2.1                ha2e4443_0    conda-forge
sniffio                   1.3.1              pyhd8ed1ab_0    conda-forge
snuggs                    1.4.7              pyhd8ed1ab_1    conda-forge
sorcha                    0.9.1              pyhd8ed1ab_0    conda-forge
soupsieve                 2.5                pyhd8ed1ab_1    conda-forge
spdlog                    1.14.1               h597fd29_0    conda-forge
spherematch               0.10.2          py311h0eeffd6_1    conda-forge
spiceypy                  6.0.0              pyhd8ed1ab_0    conda-forge
sqlalchemy                2.0.35          py311h9ecbd09_0    conda-forge
sqlite                    3.46.1               h9eae976_0    conda-forge
sqlparse                  0.4.4              pyhd8ed1ab_0    conda-forge
stack_data                0.6.2              pyhd8ed1ab_0    conda-forge
starlink-ast              9.2.10               hd590300_0    conda-forge
statsmodels               0.14.3          py311h9f3472d_1    conda-forge
stevedore                 5.3.0              pyhd8ed1ab_0    conda-forge
stomp.py                  8.0.1              pyhd8ed1ab_1    conda-forge
svt-av1                   2.1.2                hac33072_0    conda-forge
sympy                     1.13.2          pypyh2585a3b_103    conda-forge
synphot                   1.4.0           py311h9f3472d_3    conda-forge
sysroot_linux-64          2.17                h4a8ded7_16    conda-forge
tabulate                  0.9.0              pyhd8ed1ab_1    conda-forge
tbb                       2021.13.0            h84d6215_0    conda-forge
tblib                     3.0.0              pyhd8ed1ab_0    conda-forge
threadpoolctl             3.5.0              pyhc1e730c_0    conda-forge
tifffile                  2024.9.20          pyhd8ed1ab_0    conda-forge
tiledb                    2.24.2               h8cb3aa9_5    conda-forge
time-machine              2.15.0          py311h9ecbd09_1    conda-forge
tk                        8.6.13          noxft_h4845f30_101    conda-forge
toml                      0.10.2             pyhd8ed1ab_0    conda-forge
tomli                     2.0.1              pyhd8ed1ab_0    conda-forge
torchvision               0.19.1          cpu_py311hafe623f_0    conda-forge
tqdm                      4.66.5             pyhd8ed1ab_0    conda-forge
traitlets                 5.14.3             pyhd8ed1ab_0    conda-forge
treecorr                  4.3.3           py311hb755f60_1    conda-forge
treegp                    1.2.0              pyhd8ed1ab_0    conda-forge
truststore                0.9.2              pyhd8ed1ab_0    conda-forge
typeguard                 4.3.0              pyhd8ed1ab_1    conda-forge
types-pyyaml              6.0.12.20240917    pyhd8ed1ab_0    conda-forge
typing-extensions         4.12.2               hd8ed1ab_0    conda-forge
typing_extensions         4.12.2             pyha770c72_0    conda-forge
tzcode                    2024b                hb9d3cd8_0    conda-forge
tzdata                    2024a                h8827d51_1    conda-forge
uncertainties             3.2.2              pyhd8ed1ab_1    conda-forge
uriparser                 0.9.8                hac33072_0    conda-forge
urllib3                   1.26.19            pyhd8ed1ab_0    conda-forge
vcrpy                     6.0.1              pyhd8ed1ab_0    conda-forge
voms                      2.1.0rc3             h25bd2b9_0    conda-forge
wayland                   1.23.1               h3e06ad9_0    conda-forge
wayland-protocols         1.37                 hd8ed1ab_0    conda-forge
wcslib                    8.2.2                hc8ac846_1    conda-forge
wcwidth                   0.2.13             pyhd8ed1ab_0    conda-forge
webdav4                   0.10.0             pyhd8ed1ab_0    conda-forge
webencodings              0.5.1              pyhd8ed1ab_2    conda-forge
websocket-client          1.8.0              pyhd8ed1ab_0    conda-forge
werkzeug                  3.0.4              pyhd8ed1ab_0    conda-forge
wheel                     0.44.0             pyhd8ed1ab_0    conda-forge
widgetsnbextension        4.0.13             pyhd8ed1ab_0    conda-forge
wrapt                     1.16.0          py311h9ecbd09_1    conda-forge
ws4py                     0.5.1                      py_0    conda-forge
x264                      1!164.3095           h166bdaf_2    conda-forge
x265                      3.5                  h924138e_3    conda-forge
xcb-util                  0.4.1                hb711507_2    conda-forge
xcb-util-cursor           0.1.5                hb9d3cd8_0    conda-forge
xcb-util-image            0.4.0                hb711507_2    conda-forge
xcb-util-keysyms          0.4.1                hb711507_0    conda-forge
xcb-util-renderutil       0.3.10               hb711507_0    conda-forge
xcb-util-wm               0.4.2                hb711507_0    conda-forge
xerces-c                  3.2.5                hac6953d_0    conda-forge
xkeyboard-config          2.42                 h4ab18f5_0    conda-forge
xmltodict                 0.13.0             pyhd8ed1ab_0    conda-forge
xorg-fixesproto           5.0               hb9d3cd8_1003    conda-forge
xorg-inputproto           2.3.2             hb9d3cd8_1003    conda-forge
xorg-kbproto              1.0.7             hb9d3cd8_1003    conda-forge
xorg-libice               1.1.1                hd590300_0    conda-forge
xorg-libsm                1.2.4                h7391055_0    conda-forge
xorg-libx11               1.8.9                hb711507_1    conda-forge
xorg-libxau               1.0.11               hb9d3cd8_1    conda-forge
xorg-libxdmcp             1.1.3                hb9d3cd8_1    conda-forge
xorg-libxext              1.3.4                h0b41bf4_2    conda-forge
xorg-libxfixes            5.0.3             h7f98852_1004    conda-forge
xorg-libxi                1.7.10               h4bc722e_1    conda-forge
xorg-libxrender           0.9.11               hd590300_0    conda-forge
xorg-renderproto          0.11.1            hb9d3cd8_1003    conda-forge
xorg-xextproto            7.3.0             hb9d3cd8_1004    conda-forge
xorg-xproto               7.0.31            hb9d3cd8_1008    conda-forge
xpa                       2.1.20               h27087fc_1    conda-forge
xz                        5.2.6                h166bdaf_0    conda-forge
yaml                      0.2.5                h7f98852_2    conda-forge
yaml-cpp                  0.8.0                h59595ed_0    conda-forge
yarl                      1.12.1          py311h9ecbd09_0    conda-forge
zenodo_get                1.6.1              pyhd8ed1ab_0    conda-forge
zeromq                    4.3.5                ha4adb4c_5    conda-forge
zfp                       1.0.1                h5888daf_2    conda-forge
zipp                      3.20.2             pyhd8ed1ab_0    conda-forge
zlib                      1.3.1                h4ab18f5_1    conda-forge
zlib-ng                   2.2.2                h5888daf_0    conda-forge
zstandard                 0.23.0          py311hbc35293_1    conda-forge
zstd                      1.5.6                ha6fb4c9_0    conda-forge

Environment info

mamba version : 1.5.9
     active environment : lsst-scipipe-9.0.0
    active env location : /home/wittgen/lsst/v28/lsstsw/miniconda/envs/lsst-scipipe-9.0.0
            shell level : 1
       user config file : /home/wittgen/.condarc
 populated config files : /home/wittgen/lsst/v28/lsstsw/miniconda/.condarc
                          /home/wittgen/lsst/v28/lsstsw/miniconda/envs/lsst-scipipe-9.0.0/.condarc
          conda version : 24.7.1
    conda-build version : not installed
         python version : 3.12.5.final.0
                 solver : libmamba (default)
       virtual packages : __archspec=1=zen
                          __conda=24.7.1=0
                          __cuda=12.6=0
                          __glibc=2.34=0
                          __linux=5.14.0=0
                          __unix=0=0
       base environment : /home/wittgen/lsst/v28/lsstsw/miniconda  (writable)
      conda av data dir : /home/wittgen/lsst/v28/lsstsw/miniconda/etc/conda
  conda av metadata url : None
           channel URLs : https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
                          https://conda.anaconda.org/nodefaults/linux-64
                          https://conda.anaconda.org/nodefaults/noarch
                          https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /home/wittgen/lsst/v28/lsstsw/miniconda/pkgs
                          /home/wittgen/.conda/pkgs
       envs directories : /home/wittgen/lsst/v28/lsstsw/miniconda/envs
                          /home/wittgen/.conda/envs
               platform : linux-64
             user-agent : conda/24.7.1 requests/2.32.3 CPython/3.12.5 Linux/5.14.0-427.37.1.el9_4.x86_64 almalinux/9.4 glibc/2.34 solver/libmamba conda-libmamba-solver/24.7.0 libmambapy/1.5.9
                UID:GID : 1000:1000
             netrc file : None
           offline mode : False
@mwittgen mwittgen added the bug Something isn't working label Oct 1, 2024
@beckermr
Copy link
Member

beckermr commented Oct 1, 2024

@conda-forge/core @jakirkham Do you all have any ideas here?

@jakirkham
Copy link
Member

So libdevice comes from nvvm

Originally cuda-nvcc-tools included nvvm. This works for CUDA 12.0+. However this includes a few extra things that one may not want/need

In CUDA 12.2, cuda-nvvm-tools was created containing just nvvm, which cuda-nvcc-tools depends on. So would recommend installing cuda-nvvm-tools when using CUDA 12.2+

If these are hard dependencies, the recipe here could be updated to include these. In the interim, users could consider installing one of these packages themselves based on their needs

Hope that helps. Please feel free to ask more questions 🙂

@jakirkham
Copy link
Member

cc @conda-forge/cuda (for vis)

@mwittgen
Copy link
Author

mwittgen commented Oct 3, 2024

cuda-nvvm-tools 12.6.68 he02047a_0 conda-forge are installed in our environment, but the default paths
to find libdevice look in the wrong place. I can fix the setup by creating a symlink or copying into one of the search paths determined by running strace on the example.

@jakirkham
Copy link
Member

Ah thanks for pointing that out. See that above

Also noticing the path the package uses appears comes from the recipes build environment instead of the host environment, which indicates there is a bug in the build script

Looks like the relevant bits are in jaxlib so will transfer this issue

@jakirkham jakirkham transferred this issue from conda-forge/jax-feedstock Oct 3, 2024
@jakirkham
Copy link
Member

Yeah think this just needs cuda-nvcc-tools in requirements/host. Not seeing it there (though please let me know if I just missed it)

Also think this should be cuda-nvcc-tools

jaxlib-feedstock/recipe/meta.yaml

Line 85 in a10f0e8

- cuda-nvcc # [(cuda_compiler_version or "").startswith("12")]

As a side note, think we can drop this workaround as well. It was fixed upstream: conda-forge/cuda-cupti-feedstock#14

jaxlib-feedstock/recipe/meta.yaml

Lines 86 to 87 in a10f0e8

# Workaround for https://github.com/conda-forge/cuda-cupti-feedstock/issues/14
- cuda-cupti >=12.0.90,<13.0a0 # [(cuda_compiler_version or "").startswith("12")]

xhochy added a commit to regro-cf-autotick-bot/jaxlib-feedstock that referenced this issue Oct 10, 2024
@xhochy
Apply fixes from conda-forge#283
8b8ab4a
@xhochy
Copy link
Member

xhochy commented Oct 10, 2024

I'm including these fixes now in #281 (comment)

@hmaarrfk hmaarrfk mentioned this issue Oct 18, 2024
Open
1 task
@traversaro
Copy link
Contributor

@mwittgen this should have been fixed by #288 (jaxlib version 0.4.34=*_201).

Can you test if the problem is solved for you? Thanks!

@jakirkham
Copy link
Member

As conda-forge recently moved to CUDA 12.6 ( conda-forge/conda-forge-pinning-feedstock#6720 ), think we can change cuda-nvcc-tools to cuda-nvvm-tools to get a more compact requirement

xref: #283 (comment)

@traversaro
Copy link
Contributor

As conda-forge recently moved to CUDA 12.6 ( conda-forge/conda-forge-pinning-feedstock#6720 ), think we can change cuda-nvcc-tools to cuda-nvvm-tools to get a more compact requirement

xref: #283 (comment)

If I am not wrong jax cuda support depends at runtime on ptxas, so I guess we need to keep cuda-nvcc-tools, but if libdevice is contained in cuda-nvvm-tools we need to add also that as a dependency.

@jakirkham
Copy link
Member

Ah ok. Yeah would stick with cuda-nvcc-tools then

cuda-nvcc-tools already depends on cuda-nvvm-tools. Don't foresee that changing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@xhochy @traversaro @jakirkham @beckermr @mwittgen