Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pipeline patch for .testing #309

Merged
merged 4 commits into from
Jan 28, 2023

Conversation

adcroft
Copy link
Member

@adcroft adcroft commented Jan 13, 2023

Two commits related to allowing the run/testing of .testing to happen in in a different location to where the git repo is cloned and the executables are built

  • 0f5e6ca separates the compiling and running of the "prepoc" codes. This was needed since we can not compile on the compute nodes, and once we move the runners we will not be able to run in the same place we compile
  • 91f3288 allows the work/ and results/ directories to be re-located
  • d70feab is unrelated and just aesthetic, reporting all the green "PASS"s which I find therapeutic to see

In order to adapt pipelines to work from a read-only NFS space we need the
pre-processing step for tc4 to be [optionally] broken into two steps: a
compile step and a data generation step.

Changes:
- Added the target "executables to tc4/Makefile, so only compilation occurs
  when invoked. The "all" target still compiles if needed.
- Added target "preproc-compile" to .testing/Makefile whcih invokes the
  "executables" target of tc4/Makefile. The target "preproc" still compiles
  if needed.
- Added `make-preproc-compile` to the gitlab pipeline prior to submitting
  the "make test" job to the compute nodes.
- I also disconnected the "clean.stats" target from "clean.preproc" since
  the latter removes the pre-processing executables too and given that we
  can't re-compile those and re-create the stats from the same location
  it makes sense to keep those clean steps separated.
@adcroft adcroft requested a review from marshallward January 13, 2023 18:49
@codecov
Copy link

codecov bot commented Jan 13, 2023

Codecov Report

Merging #309 (544220b) into dev/gfdl (321ee0b) will decrease coverage by 0.01%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##           dev/gfdl     #309      +/-   ##
============================================
- Coverage     37.18%   37.18%   -0.01%     
============================================
  Files           265      265              
  Lines         74398    74398              
  Branches      13820    13820              
============================================
- Hits          27667    27665       -2     
- Misses        41647    41648       +1     
- Partials       5084     5085       +1     
Impacted Files Coverage Δ
src/framework/MOM_document.F90 73.14% <0.00%> (-0.44%) ⬇️

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

- Added CPP macro "WORKSPACE" which defaults to ".". This controls where
  the work/ and results/ directories are located as used by the target
  "test" in .testing/Makefile.
- Use WORKSPACE=/lustre/f2/scratch/$USER/runner/$CI_RUNNER_ID in the job
  script so that if the runner is later moved to a read-only-from-compute
  disk the pipeline still works.
Purely asesthetic Purely aesthetic change, but on
success, it's nice to see the long list of green checks.
Previously we only showed any detail on a fail and on
success show the one line summary.
@adcroft adcroft force-pushed the pipeline-testing-patch branch from 889091b to d70feab Compare January 13, 2023 19:31
@marshallward
Copy link
Member

Gaea regression: https://gitlab.gfdl.noaa.gov/ogrp/MOM6/-/pipelines/18087 ✔️

@marshallward marshallward merged commit 1fe52f7 into NOAA-GFDL:dev/gfdl Jan 28, 2023
@adcroft adcroft deleted the pipeline-testing-patch branch June 26, 2023 17:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants