Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace libmamba-solver with mamba command [skip ci] #11507

Merged
merged 2 commits into from
Sep 26, 2024
Merged

Replace libmamba-solver with mamba command [skip ci] #11507

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
19e5402
quick workaround to make image build work
pxLi Sep 26, 2024
397c9d6
use mamba directly
pxLi Sep 26, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 7 additions & 8 deletions jenkins/Dockerfile-blossom.integration.rocky
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45,17 +45,16 @@ RUN wget --quiet https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86
/bin/bash ~/miniconda.sh -b -p /opt/conda && \
rm -f ~/miniconda.sh
ENV PATH="/opt/conda/bin:$MAVEN_HOME/bin:${PATH}"
RUN conda init
# TODO: re-enable mamba solver after https://github.com/NVIDIA/spark-rapids/issues/9393
# conda config --set solver libmamba
RUN conda init && conda install -n base -c conda-forge mamba

# 'pyarrow' and 'pandas' will be installed as the dependencies of cudf below
RUN export CUDA_VER=`echo ${CUDA_VER} | cut -d '.' -f 1,2` && \
conda install -y -c rapidsai -c rapidsai-nightly -c nvidia -c conda-forge -c defaults cudf=${CUDF_VER} python=3.10 cuda-version=${CUDA_VER} && \
conda install -y spacy && python -m spacy download en_core_web_sm && \
conda install -y -c anaconda pytest requests && \
conda install -y -c conda-forge sre_yield && \
conda clean -ay
mamba install -y -c rapidsai -c rapidsai-nightly -c nvidia -c conda-forge -c defaults \
cudf=${CUDF_VER} python=3.10 cuda-version=${CUDA_VER} && \
mamba install -y spacy && python -m spacy download en_core_web_sm && \
mamba install -y -c anaconda pytest requests && \
mamba install -y -c conda-forge sre_yield && \
mamba clean -ay
# install pytest plugins for xdist parallel run
RUN python -m pip install findspark pytest-xdist pytest-order fastparquet==2024.5.0

Expand Down
15 changes: 7 additions & 8 deletions jenkins/Dockerfile-blossom.integration.ubuntu
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -57,17 +57,16 @@ RUN wget --quiet https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86
/bin/bash ~/miniconda.sh -b -p /opt/conda && \
rm -f ~/miniconda.sh
ENV PATH="/opt/conda/bin:$MAVEN_HOME/bin:${PATH}"
RUN conda init
# TODO: re-enable mamba solver after https://github.com/NVIDIA/spark-rapids/issues/9393
# conda config --set solver libmamba
RUN conda init && conda install -n base -c conda-forge mamba

# 'pyarrow' and 'pandas' will be installed as the dependencies of cudf below
RUN export CUDA_VER=`echo ${CUDA_VER} | cut -d '.' -f 1,2` && \
conda install -y -c rapidsai -c rapidsai-nightly -c nvidia -c conda-forge -c defaults cudf=${CUDF_VER} python=3.10 cuda-version=${CUDA_VER} && \
conda install -y spacy && python -m spacy download en_core_web_sm && \
conda install -y -c anaconda pytest requests && \
conda install -y -c conda-forge sre_yield && \
conda clean -ay
mamba install -y -c rapidsai -c rapidsai-nightly -c nvidia -c conda-forge -c defaults \
cudf=${CUDF_VER} python=3.10 cuda-version=${CUDA_VER} && \
mamba install -y spacy && python -m spacy download en_core_web_sm && \
mamba install -y -c anaconda pytest requests && \
mamba install -y -c conda-forge sre_yield && \
mamba clean -ay
# install pytest plugins for xdist parallel run
RUN python -m pip install findspark pytest-xdist pytest-order fastparquet==2024.5.0

Expand Down