Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jupyter docker: new full build with latest of almost everything except xclim and ravenpy to smooth transition #121

Merged
merged 110 commits into from
May 9, 2024
Merged
Show file tree
Hide file tree
Changes from 5 commits
Commits
Show all changes
110 commits
Select commit Hold shift + click to select a range
1e010a9
docker: new xclim 0.44.0 should fix popmean.shape[axis] error so we c…
tlvu Jun 24, 2023
f567367
docker: set bash as user shell for better Jupyter terminal experience
tlvu Jun 24, 2023
8d344b0
release: update to use image pavics/workflow-tests:230629
tlvu Jun 29, 2023
4ad76b0
docker: pin pydantic to not break ravenpy
tlvu Jul 4, 2023
074f20e
release: update to use image pavics/workflow-tests:py310-230704
tlvu Jul 4, 2023
dde83db
docker: new ravenpy will pin pydantic itself
tlvu Jul 6, 2023
138112a
release: update to use image pavics/workflow-tests:py310-230706
tlvu Jul 6, 2023
30bbbb3
docker: add pykdtree to fix cartopy bug with scipy 1.11
tlvu Jul 6, 2023
e974650
release: update to use image pavics/workflow-tests:py310-230706-2
tlvu Jul 6, 2023
0a918bd
release: update to use image pavics/workflow-tests:py310-230721
tlvu Jul 21, 2023
7b6bd1b
Merge remote-tracking branch 'origin/master' into new-docker-build
tlvu Aug 8, 2023
33c1ec7
docker: unpin intake-esm, issue should be fixed
tlvu Aug 30, 2023
9bfb843
docker: unpin numpy to see if issue with datashade=True in hvplot.qua…
tlvu Aug 30, 2023
7083aae
docker: unpin panel to test if Analogues dashboard can work with newe…
tlvu Aug 30, 2023
117b6de
release: update to use image pavics/workflow-tests:py310-230830
tlvu Aug 30, 2023
9a42dd7
docker: force latest panel >= 1.2.2 because mamba randomly choose old…
tlvu Sep 8, 2023
adc4d3d
release: update to use image pavics/workflow-tests:py310-230830-updat…
tlvu Sep 8, 2023
776011b
Merge remote-tracking branch 'origin/master' into new-docker-build
tlvu Sep 20, 2023
c7c0358
docker: ensure /notebook_dir/ is read-only for the Jupyter user
tlvu Sep 20, 2023
68cce0b
release: update to use image pavics/workflow-tests:py39-230601-1
tlvu Sep 20, 2023
4d8dcd0
docker update: newer panel and bokeh for FWI quick release
tlvu Oct 17, 2023
187f9bf
release: update to use image pavics/workflow-tests:py310-231107
tlvu Nov 7, 2023
8765531
Merge remote-tracking branch 'origin/master' into new-docker-build
tlvu Nov 8, 2023
a8a4c78
Merge remote-tracking branch 'origin/master' into new-docker-build
tlvu Nov 8, 2023
b222b0a
Merge remote-tracking branch 'origin/master' into new-docker-build
tlvu Jan 30, 2024
8529a9a
docker: ensure threddsclient >= 0.4.5 for Thredds v5 compat
tlvu Jan 30, 2024
5c282eb
docker: ensure recent new packages part of new incremental build
tlvu Jan 30, 2024
a62b2dd
docker: ensure xclim >= 0.47.0
tlvu Jan 30, 2024
e2d8193
release: update to use image pavics/workflow-tests:py310-231107-updat…
tlvu Jan 30, 2024
56992e5
docker: add xscen, finagos, upgrade ravenpy and pydantic
tlvu Mar 6, 2024
23cb6af
docker: pin xscen for back-compat with xclim 0.47.0
tlvu Mar 6, 2024
63011de
docker: fix typo in figanos name
tlvu Mar 6, 2024
ce26b1c
release: update to use image pavics/workflow-tests:py310-231107-updat…
tlvu Mar 6, 2024
4f2c099
release: update to use image pavics/workflow-tests:py310-240306
tlvu Mar 7, 2024
daaa489
docker: attempt to fix "Plugin 'jupyterlab_dash' is already registered."
tlvu Mar 7, 2024
f4b19c2
Revert "docker: attempt to fix "Plugin 'jupyterlab_dash' is already r…
tlvu Mar 7, 2024
81deb99
docker: add py39-230601-1-update240116 previous release env export an…
tlvu Mar 7, 2024
866da9f
docker: add py310-231107 env export and build log for full build base…
tlvu Mar 7, 2024
a8b7206
docker: py310-231107-update240306 env export, build log, initial jenkins
tlvu Mar 7, 2024
e7946d1
docker: py310-240306 env export, build log, initial jenkins
tlvu Mar 7, 2024
5f932b4
release: update to use image pavics/workflow-tests:py310-240312
tlvu Mar 12, 2024
8652af6
docker: py310-240312 env export, build log
tlvu Mar 14, 2024
9f6581b
docker: py310-240312 initial jenkins default nb and raven nb
tlvu Mar 14, 2024
a73fc6c
docker: replace jupyter-dash with dash since the previous have warnin…
tlvu Mar 16, 2024
6f2a984
docker: ensure latest birdy 0.8.5 for RavenPy nb fixes
tlvu Mar 16, 2024
232b5ee
release: update to use image pavics/workflow-tests:py310-240316
tlvu Mar 16, 2024
47ceb1f
docker: py310-240316 build log
tlvu Mar 16, 2024
67999ab
docker: py310-240316 conda env, jenkins default and raven nb
tlvu Mar 23, 2024
4fcedaf
release: update to use image pavics/workflow-tests:py310-240323
tlvu Mar 23, 2024
e42adfc
docker: py310-240323: build log
tlvu Mar 23, 2024
266a507
output-sanitize.cfg: fix subset-user-input.ipynb /tmp/ipykernel_NUM/ …
tlvu Mar 23, 2024
4776dee
docker: py310-240323: conda env
tlvu Mar 23, 2024
3314f75
docker: py310-240323: initial jenkins default nb
tlvu Mar 23, 2024
090110e
docker: py310-240323: initial jenkins raven nb
tlvu Mar 25, 2024
14c8c90
jenkins: add SAVE_RESULTING_NOTEBOOK_TIMEOUT for slow notebooks or sl…
tlvu Mar 26, 2024
6dd64ec
docker: remove extra package and build step needed for jupyter-dash
tlvu Apr 2, 2024
2e27636
docker: add conda-pack to root conda env
tlvu Apr 2, 2024
f7e7c43
release: update to use image pavics/workflow-tests:py310-240402
tlvu Apr 2, 2024
fbe057b
docker: py310-240402: build log
tlvu Apr 2, 2024
45f91c8
docker: py310-240402: conda env export
tlvu Apr 2, 2024
05c6a4c
docker: py310-240402: jenkins default nb: homepage nb 4 and 1 intermi…
tlvu Apr 3, 2024
c0bc360
docker: py310-240402: jenkins raven nb
tlvu Apr 3, 2024
7ef44f7
Revert "docker: remove extra package and build step needed for jupyte…
tlvu Apr 5, 2024
216b16e
release: update to use image pavics/workflow-tests:py310-240404
tlvu Apr 5, 2024
b014ee9
docker: py310-240404: build log
tlvu Apr 11, 2024
dab5eb3
docker: py310-240404: conda env export
tlvu Apr 11, 2024
76eb988
docker: py310-240404: initial jenkins, default nb, only homepage nb 4…
tlvu Apr 11, 2024
375c271
docker: py310-240404: initial jenkins, raven nb
tlvu Apr 11, 2024
1d5d7a5
release: update to use image pavics/workflow-tests:py310-240411
tlvu Apr 11, 2024
d3e072d
docker: py310-240411: build log
tlvu Apr 12, 2024
9765cc8
docker: py310-240411: conda env export
tlvu Apr 12, 2024
69c7b34
docker: py310-240411: initial jenkins, raven nb
tlvu Apr 12, 2024
43f5f56
docker: py310-240411: initial jenkins, default nb, only homepage nb 4…
tlvu Apr 12, 2024
6093370
Merge remote-tracking branch 'origin/master' into new-docker-build
tlvu Apr 15, 2024
6f6a2ff
docker: pin jupyter-archive to older ver for the "Extract Archive" op…
tlvu Apr 19, 2024
51c0ba8
docker: add openpyxl for CCCS Panel (Eva request)
tlvu Apr 19, 2024
f3491fe
release: update to use image pavics/workflow-tests:py310-240419
tlvu Apr 19, 2024
9e62842
docker: py310-240419: docker hub build log
tlvu Apr 20, 2024
2f8c450
docker: py310-240419: conda env export
tlvu Apr 20, 2024
80cd6c4
docker: py310-240419: initial jenkins, default nb, only homepage nb 4
tlvu Apr 24, 2024
c792171
docker: py310-240419: initial jenkins, raven nb, some nb hang at impo…
tlvu Apr 26, 2024
a584cac
docker: move to py3.11 and remove cdms2
tlvu Apr 29, 2024
61834e1
release: update to use image pavics/workflow-tests:py310-240428
tlvu Apr 29, 2024
6a8cb91
release: update to use image pavics/workflow-tests:py311-240428
tlvu Apr 29, 2024
393fc67
docker: document why cdms2 was disabled
tlvu Apr 29, 2024
be70c30
docker: py311-240428: docker hub build log
tlvu May 1, 2024
2632657
docker: py311-240428: conda env export
tlvu May 1, 2024
2e96dd6
docker: py311-240428: initial jenkins, default nb
tlvu May 1, 2024
66d2646
docker: py311-240428: initial jenkins, raven nb
tlvu May 1, 2024
a21c3c1
jenkins: add note that ESGF_COMPUTE_API_REPO do not work anymore
tlvu May 3, 2024
f12f917
release: update to use image pavics/workflow-tests:py311-240506
tlvu May 6, 2024
b813769
docker: py311-240506: dockerhub build log
tlvu May 6, 2024
936e344
docker: py311-240506: conda env export
tlvu May 6, 2024
f390690
jenkins: fix nbval --sanitize-with deprecation warning
tlvu May 6, 2024
54698f1
docker: py311-240506: working jenkins, default nb
tlvu May 7, 2024
f8297b4
docker: py311-240506: initial jenkins, raven nb, only 04_Emulating ...
tlvu May 7, 2024
2cd37ec
docker: backport RavenPy/pull/360 to fix nb '04_Emulating...'
tlvu May 7, 2024
06645a7
docker: use official ravenpy 0.13.1 backport branch
tlvu May 7, 2024
8f69876
docker: need to force uninstall ravenpy before installing it from source
tlvu May 7, 2024
3d3b14d
docker: prevent unknown jupyterlab-git downgrade to 0.8.2
tlvu May 7, 2024
008928f
docker: jupyterlab-git 0.50.0 seems to conflict jupyterlab-topbar
tlvu May 7, 2024
a44255e
docker: use official ravenpy==0.13.1 from PyPI
tlvu May 7, 2024
20c7b5e
docker: install [email protected] from source
tlvu May 8, 2024
5533c89
docker: use official birdhouse-birdy==0.8.7 from PyPI
tlvu May 8, 2024
d205720
release: update to use image pavics/workflow-tests:py311-240506-updat…
tlvu May 8, 2024
5e28160
docker: py311-240506-update240508: DockerHub build log
tlvu May 8, 2024
448a347
docker: py311-240506-update240508: conda env export
tlvu May 9, 2024
931cfc9
docker: py311-240506-update240508: jenkins build, raven nb, only know…
tlvu May 9, 2024
c805eae
docker: py311-240506-update240508: jenkins build, default nb, only in…
tlvu May 9, 2024
54792e6
docker: py311-240506-update240508: jenkins build, default nb, all passed
tlvu May 9, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 6 additions & 4 deletions docker/Dockerfile.testing
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# For testing quickly without having to do a full rebuild.

FROM pavics/workflow-tests:py310-231107-update240130
FROM pavics/workflow-tests:py311-240506

#ENV ESMFMKFILE="/opt/conda/envs/birdy/lib/esmf.mk"

Expand All @@ -11,9 +11,11 @@ USER root
# Use 'update' for existing and 'install' for new package.
# Keep same channel ordering to not revert anything.
RUN umask 0000 \
&& mamba install -c conda-forge -c cdat -c bokeh -c plotly -c pyviz/label/dev -c defaults -n birdy xscen==0.8.2 ravenpy==0.13.0 pydantic==2.6.3 \
&& mamba clean --all --yes \
&& pip install --no-cache-dir --upgrade figanos
&& pip uninstall -y ravenpy \
&& pip install --no-cache-dir git+https://github.com/CSHS-CWRA/RavenPy.git@1977732c8dbf39ea7d563e7e30052707ba8fb2ec \
Zeitsperre marked this conversation as resolved.
Show resolved Hide resolved
&& mamba install -c conda-forge -c cdat -c bokeh -c plotly -c pyviz/label/dev -c defaults -n birdy jupyterlab-git==0.44.0 \
&& mamba clean --all --yes
# && pip install --no-cache-dir --upgrade figanos
# && pip uninstall -y ravenpy \
# && mamba install -c conda-forge -c cdat -c bokeh -c plotly -c defaults -n birdy ravenpy aiohttp

Expand Down
2 changes: 1 addition & 1 deletion docker/environment.yml
Original file line number Diff line number Diff line change
Expand Up @@ -175,7 +175,7 @@ dependencies:
# extension to produce .py files from notebook .ipynb files
- jupytext
# jupyterlab extension for git
- jupyterlab-git
- jupyterlab-git >= 0.44.0
# Voilà turns Jupyter notebooks into standalone web applications
- voila
# PIN jupyter-archive due to
Expand Down