Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot install xformers on linux server #390

Closed
fedshyvana opened this issue Sep 14, 2022 · 14 comments · Fixed by #529
Closed

Cannot install xformers on linux server #390

fedshyvana opened this issue Sep 14, 2022 · 14 comments · Fixed by #529

Comments

@fedshyvana
Copy link

fedshyvana commented Sep 14, 2022

❓ Questions and Help

When I tried either pip install or build from source, I get this issue:

 × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [18 lines of output]
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/home/username/xformers/setup.py", line 239, in <module>
          ext_modules=get_extensions(),
        File "/home/username/xformers/setup.py", line 187, in get_extensions
          cuda_version = get_cuda_version(CUDA_HOME)
        File "/home/username/xformers/setup.py", line 51, in get_cuda_version
          raw_output = subprocess.check_output([nvcc_bin, "-V"], universal_newlines=True)
        File "/home/username/anaconda3/envs/test_env/lib/python3.9/subprocess.py", line 424, in check_output
          return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
        File "/home/username/anaconda3/envs/test_env/lib/python3.9/subprocess.py", line 505, in run
          with Popen(*popenargs, **kwargs) as process:
        File "/home/username/anaconda3/envs/test_env/lib/python3.9/subprocess.py", line 951, in __init__
          self._execute_child(args, executable, preexec_fn, close_fds,
        File "/home/username/anaconda3/envs/test_env/lib/python3.9/subprocess.py", line 1821, in _execute_child
          raise child_exception_type(errno_num, err_msg, err_filename)
      FileNotFoundError: [Errno 2] No such file or directory: '/home/username/anaconda3/envs/test_env/bin/nvcc'
      [end of output]

here's the output of nvcc --version

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Tue_Mar__8_18:18:20_PST_2022
Cuda compilation tools, release 11.6, V11.6.124
Build cuda_11.6.r11.6/compiler.31057947_0

and as additional information, I was able to install pytorch the usual way/verify that cuda is available.

@blefaudeux
Copy link
Contributor

you can check with which nvcc where the binary resides, looks like for some reason the setup script looks for it in /home/username/anaconda3/envs/test_env/bin/nvcc and it's not there. Something which works well for me is to let conda handle torch + cuda toolchain, this way the versions are in sync & the paths are usually reliable. I hope that helps

@fmassa
Copy link
Contributor

fmassa commented Sep 16, 2022

Hi,

Thanks for reporting this issue!

We should get this fixed, the following part

xformers/setup.py

Lines 49 to 59 in 51dd119

def get_cuda_version(cuda_dir) -> int:
nvcc_bin = "nvcc" if cuda_dir is None else cuda_dir + "/bin/nvcc"
raw_output = subprocess.check_output([nvcc_bin, "-V"], universal_newlines=True)
output = raw_output.split()
release_idx = output.index("release") + 1
release = output[release_idx].split(".")
bare_metal_major = int(release[0])
bare_metal_minor = int(release[1][0])
assert bare_metal_minor < 100
return bare_metal_major * 100 + bare_metal_minor

is not robust to all systems

@trufty
Copy link

trufty commented Oct 9, 2022

Just chiming in that I ran into the same error using an Nvidia Cuda docker container, but switching from nvidia/cuda:11.7.x-base-ubuntu22.04 to nvidia/cuda:11.7.x-devel-ubuntu22.04 devel resolved the issue since it has nvcc pre-installed (although much larger image)

Also had to drop back to xformers==0.0.12 because of a cutlass sub module issue. But either way it works now!

@fmassa
Copy link
Contributor

fmassa commented Oct 10, 2022

Hi,

We have recently added a conda package for xformers in https://anaconda.org/xformers/xformers, could you maybe try using it instead?

@cornpo
Copy link

cornpo commented Oct 19, 2022

Ubuntu 22, python3.9, ROCm. I did conda install -c "xformers/label/dev" xformers

Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: | 
Found conflicts! Looking for incompatible packages.
This can take several minutes.  Press CTRL-C to abort.
failed                                                                                                                        

UnsatisfiableError: The following specifications were found to be incompatible with each other:

Output in format: Requested package -> Available versionsThe following specifications were found to be incompatible with your system:

  - feature:/linux-64::__glibc==2.35=0
  - feature:|@/linux-64::__glibc==2.35=0

Your installed version is: 2.35

@0xdevalias
Copy link

0xdevalias commented Nov 15, 2022

We have recently added a conda package for xformers in https://anaconda.org/xformers/xformers, could you maybe try using it instead?

Originally posted by @fmassa in #390 (comment)

Seeing a similar error as above:

⇒ conda install -n "$CONDA_ENV_NAME" xformers -c xformers/label/dev

Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: - 
Found conflicts! Looking for incompatible packages.
This can take several minutes.  Press CTRL-C to abort.
                                                                               failed

UnsatisfiableError: The following specifications were found to be incompatible with each other:

Output in format: Requested package -> Available versionsThe following specifications were found to be incompatible with your system:

  - feature:/linux-64::__glibc==2.27=0
  - feature:|@/linux-64::__glibc==2.27=0

Your installed version is: 2.27
⇒ ldd --version
ldd (Ubuntu GLIBC 2.27-3ubuntu1.6) 2.27
⇒ uname -a
Linux 010e900fca52 5.15.0-25-generic #25-Ubuntu SMP Wed Mar 30 15:54:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
⇒ conda --version
conda 4.13.0
⇒ python --version
Python 3.10.8

A few potentially related issues I found when googling:


@fmassa Any thoughts on what might be going wrong here?

@0xdevalias
Copy link

0xdevalias commented Nov 15, 2022

Digging into this a bit more:

Tried looking at the specific versions available with conda search:

⇒ conda search xformers -c xformers/label/dev

Loading channels: done
# Name                       Version           Build  Channel
..snip..
xformers             0.0.15.dev337+git.fd21b40 py310_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.15.dev337+git.fd21b40 py310_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.15.dev337+git.fd21b40 py310_cu11.6_pyt1.13  xformers/label/dev
xformers             0.0.15.dev337+git.fd21b40 py310_cu11.7_pyt1.13  xformers/label/dev
xformers             0.0.15.dev337+git.fd21b40 py39_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.15.dev337+git.fd21b40 py39_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.15.dev337+git.fd21b40 py39_cu11.6_pyt1.13  xformers/label/dev
xformers             0.0.15.dev337+git.fd21b40 py39_cu11.7_pyt1.13  xformers/label/dev
Full output
⇒ conda search xformers -c xformers/label/dev

Loading channels: done
# Name                       Version           Build  Channel
xformers             0.0.14.dev309+git.2236ed0 py310_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev309+git.2236ed0 py310_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev309+git.2236ed0 py39_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev309+git.2236ed0 py39_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev310+git.e31c571 py310_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev310+git.e31c571 py310_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev310+git.e31c571 py39_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev310+git.e31c571 py39_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev311+git.ba93c50 py310_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev311+git.ba93c50 py310_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev311+git.ba93c50 py39_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev311+git.ba93c50 py39_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev312+git.3633e1a py310_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev312+git.3633e1a py310_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev312+git.3633e1a py39_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev312+git.3633e1a py39_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev313+git.265eb03 py310_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev313+git.265eb03 py310_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev313+git.265eb03 py39_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev313+git.265eb03 py39_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev314+git.faa88b1 py310_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev314+git.faa88b1 py310_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev314+git.faa88b1 py39_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev314+git.faa88b1 py39_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev315+git.e23b369 py310_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev315+git.e23b369 py310_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev315+git.e23b369 py39_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev315+git.e23b369 py39_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev316+git.95ad2fc py310_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev316+git.95ad2fc py310_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev316+git.95ad2fc py39_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev316+git.95ad2fc py39_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev317+git.42e5c27 py310_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev317+git.42e5c27 py310_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev317+git.42e5c27 py39_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev317+git.42e5c27 py39_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev318+git.44c560d py310_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev318+git.44c560d py310_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev318+git.44c560d py39_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.14.dev318+git.44c560d py39_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.15.dev332+git.8367685 py310_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.15.dev332+git.8367685 py310_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.15.dev332+git.8367685 py39_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.15.dev332+git.8367685 py39_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.15.dev336+git.cb79827 py310_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.15.dev336+git.cb79827 py310_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.15.dev336+git.cb79827 py39_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.15.dev336+git.cb79827 py39_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.15.dev337+git.fd21b40 py310_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.15.dev337+git.fd21b40 py310_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.15.dev337+git.fd21b40 py310_cu11.6_pyt1.13  xformers/label/dev
xformers             0.0.15.dev337+git.fd21b40 py310_cu11.7_pyt1.13  xformers/label/dev
xformers             0.0.15.dev337+git.fd21b40 py39_cu11.3_pyt1.12.1  xformers/label/dev
xformers             0.0.15.dev337+git.fd21b40 py39_cu11.6_pyt1.12.1  xformers/label/dev
xformers             0.0.15.dev337+git.fd21b40 py39_cu11.6_pyt1.13  xformers/label/dev
xformers             0.0.15.dev337+git.fd21b40 py39_cu11.7_pyt1.13  xformers/label/dev

And then installing one that should be compatible with my system, though it just gave me a different error:

⇒ conda install -n "$CONDA_ENV_NAME" -c xformers/label/dev xformers=*=py310_cu11.7_pyt1.13

Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: / 
Found conflicts! Looking for incompatible packages.
This can take several minutes.  Press CTRL-C to abort.
                                                                               failed

UnsatisfiableError: The following specifications were found to be incompatible with each other:

Output in format: Requested package -> Available versionsThe following specifications were found to be incompatible with your system:

  - feature:/linux-64::__glibc==2.27=0
  - python=3.10 -> libgcc-ng[version='>=11.2.0'] -> __glibc[version='>=2.17']

Your installed version is: 2.27

Trying a different build:

⇒ conda install -n "$CONDA_ENV_NAME" -c xformers/label/dev xformers=*=py310_cu11.6_pyt1.12.1

Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: - 
Found conflicts! Looking for incompatible packages.
This can take several minutes.  Press CTRL-C to abort.
                                                                               failed

UnsatisfiableError: The following specifications were found to be incompatible with each other:

Output in format: Requested package -> Available versionsThe following specifications were found to be incompatible with your system:

  - feature:/linux-64::__glibc==2.27=0
  - feature:|@/linux-64::__glibc==2.27=0

Your installed version is: 2.27

@0xdevalias
Copy link

0xdevalias commented Nov 15, 2022

This StackOverflow gave me an idea:

Looking at the xformers versions online:

We can see that, for example, linux-64/xformers-0.0.15.dev337+git.fd21b40-py310_cu11.7_pyt1.13 has the following 'depends':

python >=3.10,<3.11.0a0, pytorch 1.13, pytorch-cuda >=11.7,<11.8

Yet the conda env I had activated didn't currently have any versions of pytorch / pytorch-cuda installed into it. I assumed that shouldn't matter, particularly when I was explicitly requesting the version I wanted, as I presumed it would just install it for me.. but maybe not?

Trying a few other things:

⇒ conda install -n "$CONDA_ENV_NAME" -c pytorch pytorch=1.13 pytorch-cuda=11.7 (error)

⇒ conda install -n "$CONDA_ENV_NAME" -c pytorch pytorch=1.13 pytorch-cuda=11.7

Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: | 
Found conflicts! Looking for incompatible packages.
This can take several minutes.  Press CTRL-C to abort.
                                                                               failed

UnsatisfiableError: The following specifications were found to be incompatible with each other:

Output in format: Requested package -> Available versions

Package pytorch-cuda conflicts for:
pytorch-cuda=11.7
pytorch=1.13 -> pytorch-cuda[version='>=11.6,<11.7|>=11.7,<11.8']The following specifications were found to be incompatible with your system:

  - feature:/linux-64::__glibc==2.27=0
  - feature:|@/linux-64::__glibc==2.27=0
  - python=3.10 -> libgcc-ng[version='>=11.2.0'] -> __glibc[version='>=2.17']

Your installed version is: 2.27

⇒ conda install -n "$CONDA_ENV_NAME" -c pytorch pytorch-cuda=11.7 (error)

⇒ conda install -n "$CONDA_ENV_NAME" -c pytorch pytorch-cuda=11.7

Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: | 
Found conflicts! Looking for incompatible packages.
This can take several minutes.  Press CTRL-C to abort.
                                                                               failed

UnsatisfiableError: The following specifications were found to be incompatible with your system:

  - feature:/linux-64::__glibc==2.27=0
  - python=3.10 -> libgcc-ng[version='>=11.2.0'] -> __glibc[version='>=2.17']

Your installed version is: 2.27

⇒ conda install -n "$CONDA_ENV_NAME" -c pytorch pytorch=1.13 (seems like it will work)

⇒ conda install -n "$CONDA_ENV_NAME" -c pytorch pytorch=1.13

Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /opt/conda/envs/xformers

  added / updated specs:
    - pytorch=1.13


The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    blas-1.0                   |              mkl           6 KB
    intel-openmp-2022.1.0      |    h9e868ea_3769         4.5 MB
    mkl-2022.1.0               |     hc2b9512_224       129.7 MB
    pytorch-1.13.0             |     py3.10_cpu_0        84.3 MB  pytorch
    pytorch-mutex-1.0          |              cpu           3 KB  pytorch
    typing_extensions-4.3.0    |  py310h06a4308_0          42 KB
    ------------------------------------------------------------
                                           Total:       218.6 MB

The following NEW packages will be INSTALLED:

  blas               pkgs/main/linux-64::blas-1.0-mkl None
  intel-openmp       pkgs/main/linux-64::intel-openmp-2022.1.0-h9e868ea_3769 None
  mkl                pkgs/main/linux-64::mkl-2022.1.0-hc2b9512_224 None
  pytorch            pytorch/linux-64::pytorch-1.13.0-py3.10_cpu_0 None
  pytorch-mutex      pytorch/noarch::pytorch-mutex-1.0-cpu None
  typing_extensions  pkgs/main/linux-64::typing_extensions-4.3.0-py310h06a4308_0 None


Proceed ([y]/n)? 

So narrowing down the issue to seemingly pytorch-cuda, I looked at it's 'depends'

pytorch-cuda-11.7-h67b0de4_0

cuda-nvcc >=11.7,<11.8, cuda-command-line-tools >=11.7,<11.8, cuda-driver-dev >=11.7,<11.8, cuda-cuobjdump >=11.7,<11.8, cuda-cudart >=11.7,<11.8, cuda-toolkit >=11.7,<11.8, cuda-nvrtc >=11.7,<11.8, cuda-cupti >=11.7,<11.8, cuda-runtime >=11.7,<11.8, cuda-cudart-dev >=11.7,<11.8, cuda-nvtx >=11.7,<11.8, cuda-nvprune >=11.7,<11.8, cuda-nvrtc-dev >=11.7,<11.8, cuda-libraries >=11.7,<11.8, cuda-libraries-dev >=11.7,<11.8, cuda-cudaart-dev >=11.7,<11.8, cuda-compiler >=11.7,<11.8, cuda-cccl >=11.7,<11.8, cuda-nvml-dev >=11.7,<11.8, cuda-cuxxfilt >=11.7,<11.8, cuda-tools >=11.7,<11.8

I figured these should all be able to be provided by cuda-toolkit:

So I decided to try installing that, which looked like it would work:

⇒ conda install -n "$CONDA_ENV_NAME" -c "nvidia/label/cuda-11.7.1" cuda-toolkit (seems like it will work)

⇒ conda install -n "$CONDA_ENV_NAME" -c "nvidia/label/cuda-11.7.1" cuda-toolkit

Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /opt/conda/envs/xformers

  added / updated specs:
    - cuda-toolkit


The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    cuda-cccl-11.7.91          |                0         1.2 MB  nvidia/label/cuda-11.7.1
    cuda-command-line-tools-11.7.1|                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-compiler-11.7.1       |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-cudart-11.7.99        |                0         194 KB  nvidia/label/cuda-11.7.1
    cuda-cudart-dev-11.7.99    |                0         1.1 MB  nvidia/label/cuda-11.7.1
    cuda-cuobjdump-11.7.91     |                0         158 KB  nvidia/label/cuda-11.7.1
    cuda-cupti-11.7.101        |                0        22.9 MB  nvidia/label/cuda-11.7.1
    cuda-cuxxfilt-11.7.91      |                0         293 KB  nvidia/label/cuda-11.7.1
    cuda-documentation-11.7.91 |                0          88 KB  nvidia/label/cuda-11.7.1
    cuda-driver-dev-11.7.99    |                0          16 KB  nvidia/label/cuda-11.7.1
    cuda-gdb-11.7.91           |                0         4.8 MB  nvidia/label/cuda-11.7.1
    cuda-libraries-11.7.1      |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-libraries-dev-11.7.1  |                0           2 KB  nvidia/label/cuda-11.7.1
    cuda-memcheck-11.7.91      |                0         168 KB  nvidia/label/cuda-11.7.1
    cuda-nsight-11.7.91        |                0       113.6 MB  nvidia/label/cuda-11.7.1
    cuda-nsight-compute-11.7.1 |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-nvcc-11.7.99          |                0        42.7 MB  nvidia/label/cuda-11.7.1
    cuda-nvdisasm-11.7.91      |                0        31.5 MB  nvidia/label/cuda-11.7.1
    cuda-nvml-dev-11.7.91      |                0          80 KB  nvidia/label/cuda-11.7.1
    cuda-nvprof-11.7.101       |                0         4.3 MB  nvidia/label/cuda-11.7.1
    cuda-nvprune-11.7.91       |                0          64 KB  nvidia/label/cuda-11.7.1
    cuda-nvrtc-11.7.99         |                0        17.3 MB  nvidia/label/cuda-11.7.1
    cuda-nvrtc-dev-11.7.99     |                0        16.9 MB  nvidia/label/cuda-11.7.1
    cuda-nvtx-11.7.91          |                0          57 KB  nvidia/label/cuda-11.7.1
    cuda-nvvp-11.7.101         |                0       114.3 MB  nvidia/label/cuda-11.7.1
    cuda-sanitizer-api-11.7.91 |                0        16.8 MB  nvidia/label/cuda-11.7.1
    cuda-toolkit-11.7.1        |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-tools-11.7.1          |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-visual-tools-11.7.1   |                0           1 KB  nvidia/label/cuda-11.7.1
    gds-tools-1.3.1.18         |                0           2 KB  nvidia/label/cuda-11.7.1
    libcublas-11.10.3.66       |                0       286.1 MB  nvidia/label/cuda-11.7.1
    libcublas-dev-11.10.3.66   |                0       296.4 MB  nvidia/label/cuda-11.7.1
    libcufft-10.7.2.91         |                0        93.6 MB  nvidia/label/cuda-11.7.1
    libcufft-dev-10.7.2.91     |                0       196.4 MB  nvidia/label/cuda-11.7.1
    libcufile-1.3.1.18         |                0         545 KB  nvidia/label/cuda-11.7.1
    libcufile-dev-1.3.1.18     |                0        12.4 MB  nvidia/label/cuda-11.7.1
    libcurand-10.2.10.91       |                0        50.3 MB  nvidia/label/cuda-11.7.1
    libcurand-dev-10.2.10.91   |                0        50.7 MB  nvidia/label/cuda-11.7.1
    libcusolver-11.4.0.1       |                0        78.7 MB  nvidia/label/cuda-11.7.1
    libcusolver-dev-11.4.0.1   |                0        55.9 MB  nvidia/label/cuda-11.7.1
    libcusparse-11.7.4.91      |                0       151.1 MB  nvidia/label/cuda-11.7.1
    libcusparse-dev-11.7.4.91  |                0       309.5 MB  nvidia/label/cuda-11.7.1
    libnpp-11.7.4.75           |                0       129.3 MB  nvidia/label/cuda-11.7.1
    libnpp-dev-11.7.4.75       |                0       126.6 MB  nvidia/label/cuda-11.7.1
    libnvjpeg-11.8.0.2         |                0         2.2 MB  nvidia/label/cuda-11.7.1
    libnvjpeg-dev-11.8.0.2     |                0         1.9 MB  nvidia/label/cuda-11.7.1
    nsight-compute-2022.2.1.3  |                0       461.4 MB  nvidia/label/cuda-11.7.1
    ------------------------------------------------------------
                                           Total:        2.63 GB

The following NEW packages will be INSTALLED:

  cuda-cccl          nvidia/label/cuda-11.7.1/linux-64::cuda-cccl-11.7.91-0 None
  cuda-command-line~ nvidia/label/cuda-11.7.1/linux-64::cuda-command-line-tools-11.7.1-0 None
  cuda-compiler      nvidia/label/cuda-11.7.1/linux-64::cuda-compiler-11.7.1-0 None
  cuda-cudart        nvidia/label/cuda-11.7.1/linux-64::cuda-cudart-11.7.99-0 None
  cuda-cudart-dev    nvidia/label/cuda-11.7.1/linux-64::cuda-cudart-dev-11.7.99-0 None
  cuda-cuobjdump     nvidia/label/cuda-11.7.1/linux-64::cuda-cuobjdump-11.7.91-0 None
  cuda-cupti         nvidia/label/cuda-11.7.1/linux-64::cuda-cupti-11.7.101-0 None
  cuda-cuxxfilt      nvidia/label/cuda-11.7.1/linux-64::cuda-cuxxfilt-11.7.91-0 None
  cuda-documentation nvidia/label/cuda-11.7.1/linux-64::cuda-documentation-11.7.91-0 None
  cuda-driver-dev    nvidia/label/cuda-11.7.1/linux-64::cuda-driver-dev-11.7.99-0 None
  cuda-gdb           nvidia/label/cuda-11.7.1/linux-64::cuda-gdb-11.7.91-0 None
  cuda-libraries     nvidia/label/cuda-11.7.1/linux-64::cuda-libraries-11.7.1-0 None
  cuda-libraries-dev nvidia/label/cuda-11.7.1/linux-64::cuda-libraries-dev-11.7.1-0 None
  cuda-memcheck      nvidia/label/cuda-11.7.1/linux-64::cuda-memcheck-11.7.91-0 None
  cuda-nsight        nvidia/label/cuda-11.7.1/linux-64::cuda-nsight-11.7.91-0 None
  cuda-nsight-compu~ nvidia/label/cuda-11.7.1/linux-64::cuda-nsight-compute-11.7.1-0 None
  cuda-nvcc          nvidia/label/cuda-11.7.1/linux-64::cuda-nvcc-11.7.99-0 None
  cuda-nvdisasm      nvidia/label/cuda-11.7.1/linux-64::cuda-nvdisasm-11.7.91-0 None
  cuda-nvml-dev      nvidia/label/cuda-11.7.1/linux-64::cuda-nvml-dev-11.7.91-0 None
  cuda-nvprof        nvidia/label/cuda-11.7.1/linux-64::cuda-nvprof-11.7.101-0 None
  cuda-nvprune       nvidia/label/cuda-11.7.1/linux-64::cuda-nvprune-11.7.91-0 None
  cuda-nvrtc         nvidia/label/cuda-11.7.1/linux-64::cuda-nvrtc-11.7.99-0 None
  cuda-nvrtc-dev     nvidia/label/cuda-11.7.1/linux-64::cuda-nvrtc-dev-11.7.99-0 None
  cuda-nvtx          nvidia/label/cuda-11.7.1/linux-64::cuda-nvtx-11.7.91-0 None
  cuda-nvvp          nvidia/label/cuda-11.7.1/linux-64::cuda-nvvp-11.7.101-0 None
  cuda-sanitizer-api nvidia/label/cuda-11.7.1/linux-64::cuda-sanitizer-api-11.7.91-0 None
  cuda-toolkit       nvidia/label/cuda-11.7.1/linux-64::cuda-toolkit-11.7.1-0 None
  cuda-tools         nvidia/label/cuda-11.7.1/linux-64::cuda-tools-11.7.1-0 None
  cuda-visual-tools  nvidia/label/cuda-11.7.1/linux-64::cuda-visual-tools-11.7.1-0 None
  gds-tools          nvidia/label/cuda-11.7.1/linux-64::gds-tools-1.3.1.18-0 None
  libcublas          nvidia/label/cuda-11.7.1/linux-64::libcublas-11.10.3.66-0 None
  libcublas-dev      nvidia/label/cuda-11.7.1/linux-64::libcublas-dev-11.10.3.66-0 None
  libcufft           nvidia/label/cuda-11.7.1/linux-64::libcufft-10.7.2.91-0 None
  libcufft-dev       nvidia/label/cuda-11.7.1/linux-64::libcufft-dev-10.7.2.91-0 None
  libcufile          nvidia/label/cuda-11.7.1/linux-64::libcufile-1.3.1.18-0 None
  libcufile-dev      nvidia/label/cuda-11.7.1/linux-64::libcufile-dev-1.3.1.18-0 None
  libcurand          nvidia/label/cuda-11.7.1/linux-64::libcurand-10.2.10.91-0 None
  libcurand-dev      nvidia/label/cuda-11.7.1/linux-64::libcurand-dev-10.2.10.91-0 None
  libcusolver        nvidia/label/cuda-11.7.1/linux-64::libcusolver-11.4.0.1-0 None
  libcusolver-dev    nvidia/label/cuda-11.7.1/linux-64::libcusolver-dev-11.4.0.1-0 None
  libcusparse        nvidia/label/cuda-11.7.1/linux-64::libcusparse-11.7.4.91-0 None
  libcusparse-dev    nvidia/label/cuda-11.7.1/linux-64::libcusparse-dev-11.7.4.91-0 None
  libnpp             nvidia/label/cuda-11.7.1/linux-64::libnpp-11.7.4.75-0 None
  libnpp-dev         nvidia/label/cuda-11.7.1/linux-64::libnpp-dev-11.7.4.75-0 None
  libnvjpeg          nvidia/label/cuda-11.7.1/linux-64::libnvjpeg-11.8.0.2-0 None
  libnvjpeg-dev      nvidia/label/cuda-11.7.1/linux-64::libnvjpeg-dev-11.8.0.2-0 None
  nsight-compute     nvidia/label/cuda-11.7.1/linux-64::nsight-compute-2022.2.1.3-0 None


Proceed ([y]/n)? 

That then made me think that maybe the earlier conda install commands were actually failing because the -c pytorch and -c "nvidia/label/cuda-11.7.1" wasn't available to add the 'package repo' for it to find/satisfy the cuda dependencies.. so then I tried the following:

⇒ conda install -n "$CONDA_ENV_NAME" -c xformers/label/dev -c pytorch -c nvidia/label/cuda-11.7.1 xformers=*=py310_cu11.7_pyt1.13 (seems like it will work)

⇒ conda install -n "$CONDA_ENV_NAME" -c xformers/label/dev -c pytorch -c nvidia/label/cuda-11.7.1 xformers=*=py310_cu11.7_pyt1.13

Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /opt/conda/envs/xformers

  added / updated specs:
    - xformers[build=py310_cu11.7_pyt1.13]


The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    blas-1.0                   |              mkl           6 KB
    cuda-11.7.1                |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-cccl-11.7.91          |                0         1.2 MB  nvidia/label/cuda-11.7.1
    cuda-command-line-tools-11.7.1|                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-compiler-11.7.1       |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-cudart-11.7.99        |                0         194 KB  nvidia/label/cuda-11.7.1
    cuda-cudart-dev-11.7.99    |                0         1.1 MB  nvidia/label/cuda-11.7.1
    cuda-cuobjdump-11.7.91     |                0         158 KB  nvidia/label/cuda-11.7.1
    cuda-cupti-11.7.101        |                0        22.9 MB  nvidia/label/cuda-11.7.1
    cuda-cuxxfilt-11.7.91      |                0         293 KB  nvidia/label/cuda-11.7.1
    cuda-demo-suite-11.7.91    |                0         4.9 MB  nvidia/label/cuda-11.7.1
    cuda-documentation-11.7.91 |                0          88 KB  nvidia/label/cuda-11.7.1
    cuda-driver-dev-11.7.99    |                0          16 KB  nvidia/label/cuda-11.7.1
    cuda-gdb-11.7.91           |                0         4.8 MB  nvidia/label/cuda-11.7.1
    cuda-libraries-11.7.1      |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-libraries-dev-11.7.1  |                0           2 KB  nvidia/label/cuda-11.7.1
    cuda-memcheck-11.7.91      |                0         168 KB  nvidia/label/cuda-11.7.1
    cuda-nsight-11.7.91        |                0       113.6 MB  nvidia/label/cuda-11.7.1
    cuda-nsight-compute-11.7.1 |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-nvcc-11.7.99          |                0        42.7 MB  nvidia/label/cuda-11.7.1
    cuda-nvdisasm-11.7.91      |                0        31.5 MB  nvidia/label/cuda-11.7.1
    cuda-nvml-dev-11.7.91      |                0          80 KB  nvidia/label/cuda-11.7.1
    cuda-nvprof-11.7.101       |                0         4.3 MB  nvidia/label/cuda-11.7.1
    cuda-nvprune-11.7.91       |                0          64 KB  nvidia/label/cuda-11.7.1
    cuda-nvrtc-11.7.99         |                0        17.3 MB  nvidia/label/cuda-11.7.1
    cuda-nvrtc-dev-11.7.99     |                0        16.9 MB  nvidia/label/cuda-11.7.1
    cuda-nvtx-11.7.91          |                0          57 KB  nvidia/label/cuda-11.7.1
    cuda-nvvp-11.7.101         |                0       114.3 MB  nvidia/label/cuda-11.7.1
    cuda-runtime-11.7.1        |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-sanitizer-api-11.7.91 |                0        16.8 MB  nvidia/label/cuda-11.7.1
    cuda-toolkit-11.7.1        |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-tools-11.7.1          |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-visual-tools-11.7.1   |                0           1 KB  nvidia/label/cuda-11.7.1
    gds-tools-1.3.1.18         |                0           2 KB  nvidia/label/cuda-11.7.1
    intel-openmp-2022.1.0      |    h9e868ea_3769         4.5 MB
    libcublas-11.10.3.66       |                0       286.1 MB  nvidia/label/cuda-11.7.1
    libcublas-dev-11.10.3.66   |                0       296.4 MB  nvidia/label/cuda-11.7.1
    libcufft-10.7.2.91         |                0        93.6 MB  nvidia/label/cuda-11.7.1
    libcufft-dev-10.7.2.91     |                0       196.4 MB  nvidia/label/cuda-11.7.1
    libcufile-1.3.1.18         |                0         545 KB  nvidia/label/cuda-11.7.1
    libcufile-dev-1.3.1.18     |                0        12.4 MB  nvidia/label/cuda-11.7.1
    libcurand-10.2.10.91       |                0        50.3 MB  nvidia/label/cuda-11.7.1
    libcurand-dev-10.2.10.91   |                0        50.7 MB  nvidia/label/cuda-11.7.1
    libcusolver-11.4.0.1       |                0        78.7 MB  nvidia/label/cuda-11.7.1
    libcusolver-dev-11.4.0.1   |                0        55.9 MB  nvidia/label/cuda-11.7.1
    libcusparse-11.7.4.91      |                0       151.1 MB  nvidia/label/cuda-11.7.1
    libcusparse-dev-11.7.4.91  |                0       309.5 MB  nvidia/label/cuda-11.7.1
    libnpp-11.7.4.75           |                0       129.3 MB  nvidia/label/cuda-11.7.1
    libnpp-dev-11.7.4.75       |                0       126.6 MB  nvidia/label/cuda-11.7.1
    libnvjpeg-11.8.0.2         |                0         2.2 MB  nvidia/label/cuda-11.7.1
    libnvjpeg-dev-11.8.0.2     |                0         1.9 MB  nvidia/label/cuda-11.7.1
    mkl-2022.1.0               |     hc2b9512_224       129.7 MB
    nsight-compute-2022.2.1.3  |                0       461.4 MB  nvidia/label/cuda-11.7.1
    pytorch-1.13.0             |py3.10_cuda11.7_cudnn8.5.0_0        1.15 GB  pytorch
    pytorch-cuda-11.7          |       h67b0de4_0           7 KB  pytorch
    pytorch-mutex-1.0          |             cuda           3 KB  pytorch
    typing_extensions-4.3.0    |  py310h06a4308_0          42 KB
    xformers-0.0.15.dev337+git.fd21b40|py310_cu11.7_pyt1.13       105.3 MB  xformers/label/dev
    ------------------------------------------------------------
                                           Total:        4.01 GB

The following NEW packages will be INSTALLED:

  blas               pkgs/main/linux-64::blas-1.0-mkl None
  cuda               nvidia/label/cuda-11.7.1/linux-64::cuda-11.7.1-0 None
  cuda-cccl          nvidia/label/cuda-11.7.1/linux-64::cuda-cccl-11.7.91-0 None
  cuda-command-line~ nvidia/label/cuda-11.7.1/linux-64::cuda-command-line-tools-11.7.1-0 None
  cuda-compiler      nvidia/label/cuda-11.7.1/linux-64::cuda-compiler-11.7.1-0 None
  cuda-cudart        nvidia/label/cuda-11.7.1/linux-64::cuda-cudart-11.7.99-0 None
  cuda-cudart-dev    nvidia/label/cuda-11.7.1/linux-64::cuda-cudart-dev-11.7.99-0 None
  cuda-cuobjdump     nvidia/label/cuda-11.7.1/linux-64::cuda-cuobjdump-11.7.91-0 None
  cuda-cupti         nvidia/label/cuda-11.7.1/linux-64::cuda-cupti-11.7.101-0 None
  cuda-cuxxfilt      nvidia/label/cuda-11.7.1/linux-64::cuda-cuxxfilt-11.7.91-0 None
  cuda-demo-suite    nvidia/label/cuda-11.7.1/linux-64::cuda-demo-suite-11.7.91-0 None
  cuda-documentation nvidia/label/cuda-11.7.1/linux-64::cuda-documentation-11.7.91-0 None
  cuda-driver-dev    nvidia/label/cuda-11.7.1/linux-64::cuda-driver-dev-11.7.99-0 None
  cuda-gdb           nvidia/label/cuda-11.7.1/linux-64::cuda-gdb-11.7.91-0 None
  cuda-libraries     nvidia/label/cuda-11.7.1/linux-64::cuda-libraries-11.7.1-0 None
  cuda-libraries-dev nvidia/label/cuda-11.7.1/linux-64::cuda-libraries-dev-11.7.1-0 None
  cuda-memcheck      nvidia/label/cuda-11.7.1/linux-64::cuda-memcheck-11.7.91-0 None
  cuda-nsight        nvidia/label/cuda-11.7.1/linux-64::cuda-nsight-11.7.91-0 None
  cuda-nsight-compu~ nvidia/label/cuda-11.7.1/linux-64::cuda-nsight-compute-11.7.1-0 None
  cuda-nvcc          nvidia/label/cuda-11.7.1/linux-64::cuda-nvcc-11.7.99-0 None
  cuda-nvdisasm      nvidia/label/cuda-11.7.1/linux-64::cuda-nvdisasm-11.7.91-0 None
  cuda-nvml-dev      nvidia/label/cuda-11.7.1/linux-64::cuda-nvml-dev-11.7.91-0 None
  cuda-nvprof        nvidia/label/cuda-11.7.1/linux-64::cuda-nvprof-11.7.101-0 None
  cuda-nvprune       nvidia/label/cuda-11.7.1/linux-64::cuda-nvprune-11.7.91-0 None
  cuda-nvrtc         nvidia/label/cuda-11.7.1/linux-64::cuda-nvrtc-11.7.99-0 None
  cuda-nvrtc-dev     nvidia/label/cuda-11.7.1/linux-64::cuda-nvrtc-dev-11.7.99-0 None
  cuda-nvtx          nvidia/label/cuda-11.7.1/linux-64::cuda-nvtx-11.7.91-0 None
  cuda-nvvp          nvidia/label/cuda-11.7.1/linux-64::cuda-nvvp-11.7.101-0 None
  cuda-runtime       nvidia/label/cuda-11.7.1/linux-64::cuda-runtime-11.7.1-0 None
  cuda-sanitizer-api nvidia/label/cuda-11.7.1/linux-64::cuda-sanitizer-api-11.7.91-0 None
  cuda-toolkit       nvidia/label/cuda-11.7.1/linux-64::cuda-toolkit-11.7.1-0 None
  cuda-tools         nvidia/label/cuda-11.7.1/linux-64::cuda-tools-11.7.1-0 None
  cuda-visual-tools  nvidia/label/cuda-11.7.1/linux-64::cuda-visual-tools-11.7.1-0 None
  gds-tools          nvidia/label/cuda-11.7.1/linux-64::gds-tools-1.3.1.18-0 None
  intel-openmp       pkgs/main/linux-64::intel-openmp-2022.1.0-h9e868ea_3769 None
  libcublas          nvidia/label/cuda-11.7.1/linux-64::libcublas-11.10.3.66-0 None
  libcublas-dev      nvidia/label/cuda-11.7.1/linux-64::libcublas-dev-11.10.3.66-0 None
  libcufft           nvidia/label/cuda-11.7.1/linux-64::libcufft-10.7.2.91-0 None
  libcufft-dev       nvidia/label/cuda-11.7.1/linux-64::libcufft-dev-10.7.2.91-0 None
  libcufile          nvidia/label/cuda-11.7.1/linux-64::libcufile-1.3.1.18-0 None
  libcufile-dev      nvidia/label/cuda-11.7.1/linux-64::libcufile-dev-1.3.1.18-0 None
  libcurand          nvidia/label/cuda-11.7.1/linux-64::libcurand-10.2.10.91-0 None
  libcurand-dev      nvidia/label/cuda-11.7.1/linux-64::libcurand-dev-10.2.10.91-0 None
  libcusolver        nvidia/label/cuda-11.7.1/linux-64::libcusolver-11.4.0.1-0 None
  libcusolver-dev    nvidia/label/cuda-11.7.1/linux-64::libcusolver-dev-11.4.0.1-0 None
  libcusparse        nvidia/label/cuda-11.7.1/linux-64::libcusparse-11.7.4.91-0 None
  libcusparse-dev    nvidia/label/cuda-11.7.1/linux-64::libcusparse-dev-11.7.4.91-0 None
  libnpp             nvidia/label/cuda-11.7.1/linux-64::libnpp-11.7.4.75-0 None
  libnpp-dev         nvidia/label/cuda-11.7.1/linux-64::libnpp-dev-11.7.4.75-0 None
  libnvjpeg          nvidia/label/cuda-11.7.1/linux-64::libnvjpeg-11.8.0.2-0 None
  libnvjpeg-dev      nvidia/label/cuda-11.7.1/linux-64::libnvjpeg-dev-11.8.0.2-0 None
  mkl                pkgs/main/linux-64::mkl-2022.1.0-hc2b9512_224 None
  nsight-compute     nvidia/label/cuda-11.7.1/linux-64::nsight-compute-2022.2.1.3-0 None
  pytorch            pytorch/linux-64::pytorch-1.13.0-py3.10_cuda11.7_cudnn8.5.0_0 None
  pytorch-cuda       pytorch/noarch::pytorch-cuda-11.7-h67b0de4_0 None
  pytorch-mutex      pytorch/noarch::pytorch-mutex-1.0-cuda None
  typing_extensions  pkgs/main/linux-64::typing_extensions-4.3.0-py310h06a4308_0 None
  xformers           xformers/label/dev/linux-64::xformers-0.0.15.dev337+git.fd21b40-py310_cu11.7_pyt1.13 None


Proceed ([y]/n)? 

And the more simplified:

⇒ conda install -n "$CONDA_ENV_NAME" -c xformers/label/dev -c pytorch -c nvidia/label/cuda-11.7.1 xformers (seems like it will work)

⇒ conda install -n "$CONDA_ENV_NAME" -c xformers/label/dev -c pytorch -c nvidia/label/cuda-11.7.1 xformers

Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /opt/conda/envs/xformers

  added / updated specs:
    - xformers


The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    blas-1.0                   |              mkl           6 KB
    cuda-11.7.1                |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-cccl-11.7.91          |                0         1.2 MB  nvidia/label/cuda-11.7.1
    cuda-command-line-tools-11.7.1|                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-compiler-11.7.1       |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-cudart-11.7.99        |                0         194 KB  nvidia/label/cuda-11.7.1
    cuda-cudart-dev-11.7.99    |                0         1.1 MB  nvidia/label/cuda-11.7.1
    cuda-cuobjdump-11.7.91     |                0         158 KB  nvidia/label/cuda-11.7.1
    cuda-cupti-11.7.101        |                0        22.9 MB  nvidia/label/cuda-11.7.1
    cuda-cuxxfilt-11.7.91      |                0         293 KB  nvidia/label/cuda-11.7.1
    cuda-demo-suite-11.7.91    |                0         4.9 MB  nvidia/label/cuda-11.7.1
    cuda-documentation-11.7.91 |                0          88 KB  nvidia/label/cuda-11.7.1
    cuda-driver-dev-11.7.99    |                0          16 KB  nvidia/label/cuda-11.7.1
    cuda-gdb-11.7.91           |                0         4.8 MB  nvidia/label/cuda-11.7.1
    cuda-libraries-11.7.1      |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-libraries-dev-11.7.1  |                0           2 KB  nvidia/label/cuda-11.7.1
    cuda-memcheck-11.7.91      |                0         168 KB  nvidia/label/cuda-11.7.1
    cuda-nsight-11.7.91        |                0       113.6 MB  nvidia/label/cuda-11.7.1
    cuda-nsight-compute-11.7.1 |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-nvcc-11.7.99          |                0        42.7 MB  nvidia/label/cuda-11.7.1
    cuda-nvdisasm-11.7.91      |                0        31.5 MB  nvidia/label/cuda-11.7.1
    cuda-nvml-dev-11.7.91      |                0          80 KB  nvidia/label/cuda-11.7.1
    cuda-nvprof-11.7.101       |                0         4.3 MB  nvidia/label/cuda-11.7.1
    cuda-nvprune-11.7.91       |                0          64 KB  nvidia/label/cuda-11.7.1
    cuda-nvrtc-11.7.99         |                0        17.3 MB  nvidia/label/cuda-11.7.1
    cuda-nvrtc-dev-11.7.99     |                0        16.9 MB  nvidia/label/cuda-11.7.1
    cuda-nvtx-11.7.91          |                0          57 KB  nvidia/label/cuda-11.7.1
    cuda-nvvp-11.7.101         |                0       114.3 MB  nvidia/label/cuda-11.7.1
    cuda-runtime-11.7.1        |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-sanitizer-api-11.7.91 |                0        16.8 MB  nvidia/label/cuda-11.7.1
    cuda-toolkit-11.7.1        |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-tools-11.7.1          |                0           1 KB  nvidia/label/cuda-11.7.1
    cuda-visual-tools-11.7.1   |                0           1 KB  nvidia/label/cuda-11.7.1
    gds-tools-1.3.1.18         |                0           2 KB  nvidia/label/cuda-11.7.1
    intel-openmp-2022.1.0      |    h9e868ea_3769         4.5 MB
    libcublas-11.10.3.66       |                0       286.1 MB  nvidia/label/cuda-11.7.1
    libcublas-dev-11.10.3.66   |                0       296.4 MB  nvidia/label/cuda-11.7.1
    libcufft-10.7.2.91         |                0        93.6 MB  nvidia/label/cuda-11.7.1
    libcufft-dev-10.7.2.91     |                0       196.4 MB  nvidia/label/cuda-11.7.1
    libcufile-1.3.1.18         |                0         545 KB  nvidia/label/cuda-11.7.1
    libcufile-dev-1.3.1.18     |                0        12.4 MB  nvidia/label/cuda-11.7.1
    libcurand-10.2.10.91       |                0        50.3 MB  nvidia/label/cuda-11.7.1
    libcurand-dev-10.2.10.91   |                0        50.7 MB  nvidia/label/cuda-11.7.1
    libcusolver-11.4.0.1       |                0        78.7 MB  nvidia/label/cuda-11.7.1
    libcusolver-dev-11.4.0.1   |                0        55.9 MB  nvidia/label/cuda-11.7.1
    libcusparse-11.7.4.91      |                0       151.1 MB  nvidia/label/cuda-11.7.1
    libcusparse-dev-11.7.4.91  |                0       309.5 MB  nvidia/label/cuda-11.7.1
    libnpp-11.7.4.75           |                0       129.3 MB  nvidia/label/cuda-11.7.1
    libnpp-dev-11.7.4.75       |                0       126.6 MB  nvidia/label/cuda-11.7.1
    libnvjpeg-11.8.0.2         |                0         2.2 MB  nvidia/label/cuda-11.7.1
    libnvjpeg-dev-11.8.0.2     |                0         1.9 MB  nvidia/label/cuda-11.7.1
    mkl-2022.1.0               |     hc2b9512_224       129.7 MB
    nsight-compute-2022.2.1.3  |                0       461.4 MB  nvidia/label/cuda-11.7.1
    pytorch-1.13.0             |py3.10_cuda11.7_cudnn8.5.0_0        1.15 GB  pytorch
    pytorch-cuda-11.7          |       h67b0de4_0           7 KB  pytorch
    pytorch-mutex-1.0          |             cuda           3 KB  pytorch
    typing_extensions-4.3.0    |  py310h06a4308_0          42 KB
    xformers-0.0.15.dev337+git.fd21b40|py310_cu11.7_pyt1.13       105.3 MB  xformers/label/dev
    ------------------------------------------------------------
                                           Total:        4.01 GB

The following NEW packages will be INSTALLED:

  blas               pkgs/main/linux-64::blas-1.0-mkl None
  cuda               nvidia/label/cuda-11.7.1/linux-64::cuda-11.7.1-0 None
  cuda-cccl          nvidia/label/cuda-11.7.1/linux-64::cuda-cccl-11.7.91-0 None
  cuda-command-line~ nvidia/label/cuda-11.7.1/linux-64::cuda-command-line-tools-11.7.1-0 None
  cuda-compiler      nvidia/label/cuda-11.7.1/linux-64::cuda-compiler-11.7.1-0 None
  cuda-cudart        nvidia/label/cuda-11.7.1/linux-64::cuda-cudart-11.7.99-0 None
  cuda-cudart-dev    nvidia/label/cuda-11.7.1/linux-64::cuda-cudart-dev-11.7.99-0 None
  cuda-cuobjdump     nvidia/label/cuda-11.7.1/linux-64::cuda-cuobjdump-11.7.91-0 None
  cuda-cupti         nvidia/label/cuda-11.7.1/linux-64::cuda-cupti-11.7.101-0 None
  cuda-cuxxfilt      nvidia/label/cuda-11.7.1/linux-64::cuda-cuxxfilt-11.7.91-0 None
  cuda-demo-suite    nvidia/label/cuda-11.7.1/linux-64::cuda-demo-suite-11.7.91-0 None
  cuda-documentation nvidia/label/cuda-11.7.1/linux-64::cuda-documentation-11.7.91-0 None
  cuda-driver-dev    nvidia/label/cuda-11.7.1/linux-64::cuda-driver-dev-11.7.99-0 None
  cuda-gdb           nvidia/label/cuda-11.7.1/linux-64::cuda-gdb-11.7.91-0 None
  cuda-libraries     nvidia/label/cuda-11.7.1/linux-64::cuda-libraries-11.7.1-0 None
  cuda-libraries-dev nvidia/label/cuda-11.7.1/linux-64::cuda-libraries-dev-11.7.1-0 None
  cuda-memcheck      nvidia/label/cuda-11.7.1/linux-64::cuda-memcheck-11.7.91-0 None
  cuda-nsight        nvidia/label/cuda-11.7.1/linux-64::cuda-nsight-11.7.91-0 None
  cuda-nsight-compu~ nvidia/label/cuda-11.7.1/linux-64::cuda-nsight-compute-11.7.1-0 None
  cuda-nvcc          nvidia/label/cuda-11.7.1/linux-64::cuda-nvcc-11.7.99-0 None
  cuda-nvdisasm      nvidia/label/cuda-11.7.1/linux-64::cuda-nvdisasm-11.7.91-0 None
  cuda-nvml-dev      nvidia/label/cuda-11.7.1/linux-64::cuda-nvml-dev-11.7.91-0 None
  cuda-nvprof        nvidia/label/cuda-11.7.1/linux-64::cuda-nvprof-11.7.101-0 None
  cuda-nvprune       nvidia/label/cuda-11.7.1/linux-64::cuda-nvprune-11.7.91-0 None
  cuda-nvrtc         nvidia/label/cuda-11.7.1/linux-64::cuda-nvrtc-11.7.99-0 None
  cuda-nvrtc-dev     nvidia/label/cuda-11.7.1/linux-64::cuda-nvrtc-dev-11.7.99-0 None
  cuda-nvtx          nvidia/label/cuda-11.7.1/linux-64::cuda-nvtx-11.7.91-0 None
  cuda-nvvp          nvidia/label/cuda-11.7.1/linux-64::cuda-nvvp-11.7.101-0 None
  cuda-runtime       nvidia/label/cuda-11.7.1/linux-64::cuda-runtime-11.7.1-0 None
  cuda-sanitizer-api nvidia/label/cuda-11.7.1/linux-64::cuda-sanitizer-api-11.7.91-0 None
  cuda-toolkit       nvidia/label/cuda-11.7.1/linux-64::cuda-toolkit-11.7.1-0 None
  cuda-tools         nvidia/label/cuda-11.7.1/linux-64::cuda-tools-11.7.1-0 None
  cuda-visual-tools  nvidia/label/cuda-11.7.1/linux-64::cuda-visual-tools-11.7.1-0 None
  gds-tools          nvidia/label/cuda-11.7.1/linux-64::gds-tools-1.3.1.18-0 None
  intel-openmp       pkgs/main/linux-64::intel-openmp-2022.1.0-h9e868ea_3769 None
  libcublas          nvidia/label/cuda-11.7.1/linux-64::libcublas-11.10.3.66-0 None
  libcublas-dev      nvidia/label/cuda-11.7.1/linux-64::libcublas-dev-11.10.3.66-0 None
  libcufft           nvidia/label/cuda-11.7.1/linux-64::libcufft-10.7.2.91-0 None
  libcufft-dev       nvidia/label/cuda-11.7.1/linux-64::libcufft-dev-10.7.2.91-0 None
  libcufile          nvidia/label/cuda-11.7.1/linux-64::libcufile-1.3.1.18-0 None
  libcufile-dev      nvidia/label/cuda-11.7.1/linux-64::libcufile-dev-1.3.1.18-0 None
  libcurand          nvidia/label/cuda-11.7.1/linux-64::libcurand-10.2.10.91-0 None
  libcurand-dev      nvidia/label/cuda-11.7.1/linux-64::libcurand-dev-10.2.10.91-0 None
  libcusolver        nvidia/label/cuda-11.7.1/linux-64::libcusolver-11.4.0.1-0 None
  libcusolver-dev    nvidia/label/cuda-11.7.1/linux-64::libcusolver-dev-11.4.0.1-0 None
  libcusparse        nvidia/label/cuda-11.7.1/linux-64::libcusparse-11.7.4.91-0 None
  libcusparse-dev    nvidia/label/cuda-11.7.1/linux-64::libcusparse-dev-11.7.4.91-0 None
  libnpp             nvidia/label/cuda-11.7.1/linux-64::libnpp-11.7.4.75-0 None
  libnpp-dev         nvidia/label/cuda-11.7.1/linux-64::libnpp-dev-11.7.4.75-0 None
  libnvjpeg          nvidia/label/cuda-11.7.1/linux-64::libnvjpeg-11.8.0.2-0 None
  libnvjpeg-dev      nvidia/label/cuda-11.7.1/linux-64::libnvjpeg-dev-11.8.0.2-0 None
  mkl                pkgs/main/linux-64::mkl-2022.1.0-hc2b9512_224 None
  nsight-compute     nvidia/label/cuda-11.7.1/linux-64::nsight-compute-2022.2.1.3-0 None
  pytorch            pytorch/linux-64::pytorch-1.13.0-py3.10_cuda11.7_cudnn8.5.0_0 None
  pytorch-cuda       pytorch/noarch::pytorch-cuda-11.7-h67b0de4_0 None
  pytorch-mutex      pytorch/noarch::pytorch-mutex-1.0-cuda None
  typing_extensions  pkgs/main/linux-64::typing_extensions-4.3.0-py310h06a4308_0 None
  xformers           xformers/label/dev/linux-64::xformers-0.0.15.dev337+git.fd21b40-py310_cu11.7_pyt1.13 None


Proceed ([y]/n)? 

Note that i'm explicitly choosing to use -c nvidia/label/cuda-11.7.1 and not just -c nvidia with a version constraint of cuda-toolkit=11.7.1, as if I do the latter, then it appears to try and pull in cuda 11.8.x versions of things (rather than 11.7.1), which will no doubt cause stuff to break:

⇒ conda install -n "$CONDA_ENV_NAME" -c nvidia cuda-toolkit=11.7.1 (will seemingly incorrectly try and install 11.8.x things)

⇒ conda install -n "$CONDA_ENV_NAME" -c nvidia cuda-toolkit=11.7.1

Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /opt/conda/envs/xformers

  added / updated specs:
    - cuda-toolkit=11.7.1


The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    cuda-cccl-11.8.89          |                0         1.2 MB  nvidia
    cuda-command-line-tools-11.8.0|                0           1 KB  nvidia
    cuda-compiler-11.8.0       |                0           1 KB  nvidia
    cuda-cudart-11.8.89        |                0         197 KB  nvidia
    cuda-cudart-dev-11.8.89    |                0         1.1 MB  nvidia
    cuda-cuobjdump-11.8.86     |                0         229 KB  nvidia
    cuda-cupti-11.8.87         |                0        25.3 MB  nvidia
    cuda-cuxxfilt-11.8.86      |                0         291 KB  nvidia
    cuda-documentation-11.8.86 |                0          89 KB  nvidia
    cuda-driver-dev-11.8.89    |                0          16 KB  nvidia
    cuda-gdb-11.8.86           |                0         4.8 MB  nvidia
    cuda-libraries-11.8.0      |                0           1 KB  nvidia
    cuda-libraries-dev-11.8.0  |                0           2 KB  nvidia
    cuda-memcheck-11.8.86      |                0         168 KB  nvidia
    cuda-nsight-11.8.86        |                0       113.6 MB  nvidia
    cuda-nsight-compute-11.8.0 |                0           1 KB  nvidia
    cuda-nvcc-11.8.89          |                0        50.8 MB  nvidia
    cuda-nvdisasm-11.8.86      |                0        48.7 MB  nvidia
    cuda-nvml-dev-11.8.86      |                0          83 KB  nvidia
    cuda-nvprof-11.8.87        |                0         4.4 MB  nvidia
    cuda-nvprune-11.8.86       |                0          65 KB  nvidia
    cuda-nvrtc-11.8.89         |                0        19.1 MB  nvidia
    cuda-nvrtc-dev-11.8.89     |                0        17.0 MB  nvidia
    cuda-nvtx-11.8.86          |                0          57 KB  nvidia
    cuda-nvvp-11.8.87          |                0       114.4 MB  nvidia
    cuda-profiler-api-11.8.86  |                0          18 KB  nvidia
    cuda-sanitizer-api-11.8.86 |                0        16.6 MB  nvidia
    cuda-toolkit-11.7.1        |                0           1 KB  nvidia
    cuda-tools-11.8.0          |                0           1 KB  nvidia
    cuda-visual-tools-11.8.0   |                0           1 KB  nvidia
    gds-tools-1.4.0.31         |                0           2 KB  nvidia
    libcublas-11.11.3.6        |                0       364.0 MB  nvidia
    libcublas-dev-11.11.3.6    |                0       394.1 MB  nvidia
    libcufft-10.9.0.58         |                0       142.8 MB  nvidia
    libcufft-dev-10.9.0.58     |                0       275.8 MB  nvidia
    libcufile-1.4.0.31         |                0         548 KB  nvidia
    libcufile-dev-1.4.0.31     |                0         1.6 MB  nvidia
    libcurand-10.3.0.86        |                0        53.2 MB  nvidia
    libcurand-dev-10.3.0.86    |                0        53.7 MB  nvidia
    libcusolver-11.4.1.48      |                0        96.5 MB  nvidia
    libcusolver-dev-11.4.1.48  |                0        66.3 MB  nvidia
    libcusparse-11.7.5.86      |                0       176.3 MB  nvidia
    libcusparse-dev-11.7.5.86  |                0       359.7 MB  nvidia
    libnpp-11.8.0.86           |                0       147.8 MB  nvidia
    libnpp-dev-11.8.0.86       |                0       144.5 MB  nvidia
    libnvjpeg-11.9.0.86        |                0         2.4 MB  nvidia
    libnvjpeg-dev-11.9.0.86    |                0         2.1 MB  nvidia
    nsight-compute-2022.3.0.22 |                0       610.0 MB  nvidia
    ------------------------------------------------------------
                                           Total:        3.23 GB

The following NEW packages will be INSTALLED:

  cuda-cccl          nvidia/linux-64::cuda-cccl-11.8.89-0 None
  cuda-command-line~ nvidia/linux-64::cuda-command-line-tools-11.8.0-0 None
  cuda-compiler      nvidia/linux-64::cuda-compiler-11.8.0-0 None
  cuda-cudart        nvidia/linux-64::cuda-cudart-11.8.89-0 None
  cuda-cudart-dev    nvidia/linux-64::cuda-cudart-dev-11.8.89-0 None
  cuda-cuobjdump     nvidia/linux-64::cuda-cuobjdump-11.8.86-0 None
  cuda-cupti         nvidia/linux-64::cuda-cupti-11.8.87-0 None
  cuda-cuxxfilt      nvidia/linux-64::cuda-cuxxfilt-11.8.86-0 None
  cuda-documentation nvidia/linux-64::cuda-documentation-11.8.86-0 None
  cuda-driver-dev    nvidia/linux-64::cuda-driver-dev-11.8.89-0 None
  cuda-gdb           nvidia/linux-64::cuda-gdb-11.8.86-0 None
  cuda-libraries     nvidia/linux-64::cuda-libraries-11.8.0-0 None
  cuda-libraries-dev nvidia/linux-64::cuda-libraries-dev-11.8.0-0 None
  cuda-memcheck      nvidia/linux-64::cuda-memcheck-11.8.86-0 None
  cuda-nsight        nvidia/linux-64::cuda-nsight-11.8.86-0 None
  cuda-nsight-compu~ nvidia/linux-64::cuda-nsight-compute-11.8.0-0 None
  cuda-nvcc          nvidia/linux-64::cuda-nvcc-11.8.89-0 None
  cuda-nvdisasm      nvidia/linux-64::cuda-nvdisasm-11.8.86-0 None
  cuda-nvml-dev      nvidia/linux-64::cuda-nvml-dev-11.8.86-0 None
  cuda-nvprof        nvidia/linux-64::cuda-nvprof-11.8.87-0 None
  cuda-nvprune       nvidia/linux-64::cuda-nvprune-11.8.86-0 None
  cuda-nvrtc         nvidia/linux-64::cuda-nvrtc-11.8.89-0 None
  cuda-nvrtc-dev     nvidia/linux-64::cuda-nvrtc-dev-11.8.89-0 None
  cuda-nvtx          nvidia/linux-64::cuda-nvtx-11.8.86-0 None
  cuda-nvvp          nvidia/linux-64::cuda-nvvp-11.8.87-0 None
  cuda-profiler-api  nvidia/linux-64::cuda-profiler-api-11.8.86-0 None
  cuda-sanitizer-api nvidia/linux-64::cuda-sanitizer-api-11.8.86-0 None
  cuda-toolkit       nvidia/linux-64::cuda-toolkit-11.7.1-0 None
  cuda-tools         nvidia/linux-64::cuda-tools-11.8.0-0 None
  cuda-visual-tools  nvidia/linux-64::cuda-visual-tools-11.8.0-0 None
  gds-tools          nvidia/linux-64::gds-tools-1.4.0.31-0 None
  libcublas          nvidia/linux-64::libcublas-11.11.3.6-0 None
  libcublas-dev      nvidia/linux-64::libcublas-dev-11.11.3.6-0 None
  libcufft           nvidia/linux-64::libcufft-10.9.0.58-0 None
  libcufft-dev       nvidia/linux-64::libcufft-dev-10.9.0.58-0 None
  libcufile          nvidia/linux-64::libcufile-1.4.0.31-0 None
  libcufile-dev      nvidia/linux-64::libcufile-dev-1.4.0.31-0 None
  libcurand          nvidia/linux-64::libcurand-10.3.0.86-0 None
  libcurand-dev      nvidia/linux-64::libcurand-dev-10.3.0.86-0 None
  libcusolver        nvidia/linux-64::libcusolver-11.4.1.48-0 None
  libcusolver-dev    nvidia/linux-64::libcusolver-dev-11.4.1.48-0 None
  libcusparse        nvidia/linux-64::libcusparse-11.7.5.86-0 None
  libcusparse-dev    nvidia/linux-64::libcusparse-dev-11.7.5.86-0 None
  libnpp             nvidia/linux-64::libnpp-11.8.0.86-0 None
  libnpp-dev         nvidia/linux-64::libnpp-dev-11.8.0.86-0 None
  libnvjpeg          nvidia/linux-64::libnvjpeg-11.9.0.86-0 None
  libnvjpeg-dev      nvidia/linux-64::libnvjpeg-dev-11.9.0.86-0 None
  nsight-compute     nvidia/linux-64::nsight-compute-2022.3.0.22-0 None


Proceed ([y]/n)? 

@0xdevalias
Copy link

So after that giant deepdive, it seems that the TL;DR for resolving the following error:

UnsatisfiableError: The following specifications were found to be incompatible with each other:

Output in format: Requested package -> Available versionsThe following specifications were found to be incompatible with your system:

  - feature:/linux-64::__glibc==2.27=0
  - feature:|@/linux-64::__glibc==2.27=0

Is to ensure that you have all of the required -c conda repositories enabled when doing your conda install. I suspect any of these should work correctly, depending on your needs:

PyTorch 1.13, Cuda 11.7.1, xformers:

conda install -n "$CONDA_ENV_NAME" -c xformers/label/dev -c pytorch -c nvidia/label/cuda-11.7.1 xformers=*=py310_cu11.7_pyt1.13
conda install -n "$CONDA_ENV_NAME" -c xformers/label/dev -c pytorch -c nvidia/label/cuda-11.7.1 xformers
conda install -n "$CONDA_ENV_NAME" -c xformers/label/dev -c pytorch -c nvidia/label/cuda-11.7.1 pytorch=1.13 pytorch-cuda=11.7 xformers

PyTorch 1.12, Cuda 11.7.1, xformers:

conda install -n "$CONDA_ENV_NAME" -c xformers/label/dev -c pytorch -c nvidia/label/cuda-11.7.1 pytorch=1.12 pytorch-cuda=11.7 xformers

PyTorch 1.13, Cuda 11.6.2, xformers:

conda install -n "$CONDA_ENV_NAME" -c xformers/label/dev -c pytorch -c nvidia/label/cuda-11.6.2 pytorch=1.13 pytorch-cuda=11.6 xformers

PyTorch 1.12, Cuda 11.6.2, xformers:

!conda install -n "$CONDA_ENV_NAME" -c xformers/label/dev -c pytorch -c nvidia/label/cuda-11.6.2 pytorch=1.12 pytorch-cuda=11.6 xformers

Etc

@danthe3rd
Copy link
Contributor

Thanks for reporting those!
The correct command to install pytorch with conda should be on the pytorch website and look something like:

conda install pytorch torchvision torchaudio pytorch-cuda=11.6 -c pytorch -c nvidia

After that, you should be able to install xformers with

conda install xformers -c xformers/label/dev

@0xdevalias
Copy link

0xdevalias commented Nov 15, 2022

@danthe3rd Yup, that makes sense after the fact, though conda gives super misleading error messages if it's not already installed.

It would be good to explicitly mention in the installation docs that pytorch needs to be setup properly first, as the current docs don't really make that clear/obvious:

(RECOMMENDED) Using binaries: We provide binaries for Linux and recent PyTorch versions. Install xFormers with conda:

conda install xformers -c xformers/label/dev

And probably also include a note in the troubleshooting installation section about what those misleading conda errors actually mean (eg. "You didn't install pytorch properly") to save people getting stuck/wasting time chasing down deep rabbitholes like a few of us on this issue have gotten.

@danthe3rd
Copy link
Contributor

Great feedback - will update the README in #529

@0xdevalias
Copy link

0xdevalias commented Nov 15, 2022

After that, you should be able to install xformers with

conda install xformers -c xformers/label/dev

I'll need to go through the steps I figured out today in a clean environment again to be sure (won't have a chance to for ~1week or so at the earliest), but it seemed that even using the above command that should have installed the binary versions, in an environment that matched, when I ran the python -m xformers.info test script, it seemed to indicate that things weren't installed correctly; and it wasn't until I had built from source that that script seemed to indicate that it was working.

I did the PyTorch + Cuda + xformers intalls all in a single conda install, rather than one after the other, so i'm not sure if that would make any difference.

Just wanted to note that here while I remembered it.

@lucasjinreal
Copy link

FileNotFoundError: [Errno 2] No such file or directory: '/opt/conda/lib/python3.10/site-packages/xformers/cpp_lib.json'

got this while I installed from source, how?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

8 participants