Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update templates for diag_table to be consistent with model_configure #781

Merged
merged 93 commits into from
Sep 3, 2021
Merged

update templates for diag_table to be consistent with model_configure #781

merged 93 commits into from
Sep 3, 2021

Conversation

aerorahul
Copy link
Contributor

@aerorahul aerorahul commented Aug 31, 2021

PR Checklist

  • Ths PR is up-to-date with the top of all sub-component repositories except for those sub-components which are the subject of this PR.

  • This PR has been tested using a branch which is up-to-date with the top of all sub-component repositories. There is no change to the sub-components associated with this PR.

  • An Issue describing the work contained in this PR has been created either in the subcomponent(s) or in the ufs-weather-model. See issue move diag_table/field_table from input directory to tests/parm in the repository  #644

Description

The diag_table templates (and other e.g. MOM6, WW3, ICE) employ different templating than the ones used in input.nml, model_configure and nems.configure. These files use the template defined via @[VARIABLE] which is replaced by $VARIABLE defined upstream.

The workflow team would like to use the templates from the UFS-weather-model for constructing the necessary input files.
This will allow the workflow and the model to use the same templates, albeit filled with application specific values for the templated variables.

No change of answers is expected from this PR.
There is no impact on the general user running regression tests.
There are no library or modulefiles updated or need changes with this PR.

This PR is a re-opening of #759

Issue(s) addressed

Testing

These have not been tested by running the model on any platform in particular with the exception that the change produces the desired output diag_file from the template as before.

  • hera.intel
  • hera.gnu
  • orion.intel
  • cheyenne.intel
  • cheyenne.gnu
  • gaea.intel
  • jet.intel
  • wcoss_cray
  • wcoss_dell_p3
  • CI - dc48455

Dependencies

fv3atm 378

DeniseWorthen and others added 30 commits March 27, 2021 12:30
This reverts commit 7b826d4.
@BrianCurtis-NOAA
Copy link
Collaborator

Automated RT Failure Notification
Machine: gaea
Compiler: intel
Job: BL
Repo location: /lustre/f2/pdata/ncep/emc.nemspara/autort/pr/723627695/20210902020027/ufs-weather-model
Please manually delete: /lustre/f2/scratch/emc.nemspara/FV3_RT/rt_11776
Test control_flake 026 failed failed
Test control_flake 026 failed in run_test failed
Test control_rrtmgp 024 failed failed
Test control_rrtmgp 024 failed in run_test failed
Test control_thompson 029 failed failed
Test control_thompson_no_aero 030 failed failed
Test control_thompson 029 failed in run_test failed
Test control_thompson_no_aero 030 failed in run_test failed
Test control_noahmp 031 failed failed
Test control_noahmp 031 failed in run_test failed
Test control_CubedSphereGrid 012 failed failed
Test control_CubedSphereGrid 012 failed in run_test failed
Test fv3_gsd 038 failed failed
Test fv3_gsd 038 failed in run_test failed
Test control_merra2 023 failed failed
Test control_merra2 023 failed in run_test failed
Test regional_quilt_netcdf_parallel 036 failed failed
Test regional_quilt_netcdf_parallel 036 failed in run_test failed
Test cpld_bmark_wave_v16_p7b 008 failed failed
Test cpld_bmark_wave_v16_p7b 008 failed in run_test failed
Please make changes and add the following label back:
gaea-intel-BL

@BrianCurtis-NOAA
Copy link
Collaborator

Automated RT Failure Notification
Machine: orion
Compiler: intel
Job: BL
Repo location: /work/noaa/nems/emc.nemspara/autort/pr/723627695/20210901210021/ufs-weather-model
Please manually delete: /work/noaa/stmp/bcurtis/stmp/bcurtis/FV3_RT/rt_214245
Please make changes and add the following label back:
orion-intel-BL

@BrianCurtis-NOAA
Copy link
Collaborator

Automated RT Failure Notification
Machine: jet
Compiler: intel
Job: BL
Repo location: /lfs4/HFIP/h-nems/emc.nemspara/autort/pr/723627695/20210902020026/ufs-weather-model
Please manually delete: /lfs4/HFIP/h-nems/emc.nemspara/RT_RUNDIRS/emc.nemspara/FV3_RT/rt_15491
Baseline creation and move successful
Repo location: /lfs4/HFIP/h-nems/emc.nemspara/autort/pr/723627695/20210902060849/ufs-weather-model
Please manually delete: /lfs4/HFIP/h-nems/emc.nemspara/RT_RUNDIRS/emc.nemspara/FV3_RT/rt_98558
Test control_2threads 018 failed failed
Test control_2threads 018 failed in run_test failed
Please make changes and add the following label back:
jet-intel-BL

@climbfuji
Copy link
Collaborator

/lfs4/HFIP/h-nems/emc.nemspara/autort/pr/723627695/20210902060849/ufs-weather-model

control_2threads timed out on Jet. Will rerun this one job and append to the logfile.

aerorahul and others added 2 commits September 2, 2021 09:02
@BrianCurtis-NOAA
Copy link
Collaborator

Automated RT Failure Notification
Machine: gaea
Compiler: intel
Job: RT
Repo location: /lustre/f2/pdata/ncep/emc.nemspara/autort/pr/723627695/20210902201506/ufs-weather-model
Please manually delete: /lustre/f2/scratch/emc.nemspara/FV3_RT/rt_23713
Test control_2threads 019 failed failed
Test control_2threads 019 failed in run_test failed
Test control_decomp 018 failed failed
Test control_decomp 018 failed in run_test failed
Test control_wrtGauss_netcdf_parallel 023 failed failed
Test control_wrtGauss_netcdf_parallel 023 failed in run_test failed
Test control_c192 025 failed failed
Test control_c192 025 failed in run_test failed
Test control_CubedSphereGrid 022 failed failed
Test control_CubedSphereGrid 022 failed in run_test failed
Test control_ca 030 failed failed
Test control_ca 030 failed in run_test failed
Test control_lseaspray 033 failed failed
Test control_lseaspray 033 failed in run_test failed
Test control_lheatstrg 032 failed failed
Test control_lheatstrg 032 failed in run_test failed
Test control_merra2 034 failed failed
Test control_merra2 034 failed in run_test failed
Test control_csawmgt 036 failed failed
Test control_csawmgt 036 failed in run_test failed
Test control_c384 026 failed failed
Test control_c384 026 failed in run_test failed
Test cpld_bmark_v16 010 failed failed
Test cpld_bmark_v16 010 failed in run_test failed
Test regional_control 043 failed failed
Test regional_control 043 failed in run_test failed
Test regional_quilt 045 failed failed
Test regional_quilt 045 failed in run_test failed
Test regional_quilt_hafs 047 failed failed
Test regional_quilt_hafs 047 failed in run_test failed
Test datm_control_gefs 090 failed failed
Test datm_control_gefs 090 failed in run_test failed
Please make changes and add the following label back:
gaea-intel-RT

@junwang-noaa junwang-noaa merged commit 77eaba8 into ufs-community:develop Sep 3, 2021
junwang-noaa added a commit that referenced this pull request Sep 3, 2021
epic-cicd-jenkins pushed a commit that referenced this pull request Apr 17, 2023
## DESCRIPTION OF CHANGES: 
PR #[763](ufs-community/regional_workflow#763) introduced the experiment variable `POST_OUTPUT_DOMAIN_NAME` and used it to modify the names of the UPP output files.  This PR adds `POST_OUTPUT_DOMAIN_NAME` as an argument to the python plotting scripts to enable those scripts to form the proper UPP output file names to read in.  It also modifies the batch scripts (`qsub_job.sh`, `qsub_job_diff.sh`, `sq_job.sh`, and `sq_job_diff.sh`) to add the new argument to the calls to the python plotting scripts that are called.

## TESTS CONDUCTED: 
Both python plotting scripts `plot_allvars.py` and `plot_allvars_diff.py` were run on Hera on preexisting UPP output files and completed successfully.  The batch scripts `sq_job.sh` and `sq_job_diff.sh` were also run successfully on Hera (`qsub_job.sh` and `qsub_job_diff.sh` were not run on e.g. Cheyenne).

## DEPENDENCIES:
PR # in `ufs-srweather-app`.

## DOCUMENTATION:
Modifications to the documentation are in PR #.

## ISSUE: 
Partially resolves issue #781 (still need to introduce tests in `regional_workflow` that run the plotting scripts).

## CONTRIBUTORS: 
@mark-a-potts pointed out the problem and first made the necessary fixes in the `NOAA-EPIC` fork of `regional_workflow`; @gsketefian introduced those changes to this PR and made edits to the comments and documentation.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Baseline Updates Current baselines will be updated. Waiting for Reviews The PR is waiting for reviews from associated component PR's.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants