Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update ESMF to version 8.3.0bs09 #1146

Merged
merged 14 commits into from
Mar 31, 2022
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion modulefiles/ufs_cheyenne.gnu
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ module load mpt/2.22
module load ncarcompilers/0.5.0
module unload netcdf

module use /glade/p/ral/jntp/GMTB/tools/hpc-stack-v1.2.0/modulefiles/stack
module use /glade/work/epicufsrt/GMTB/tools/hpc-stack-v1.2.0_6eb6/modulefiles/stack
module load hpc/1.2.0
module load hpc-gnu/10.1.0
module load hpc-mpt/2.22
Expand Down
2 changes: 1 addition & 1 deletion modulefiles/ufs_cheyenne.gnu_debug
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ module load mpt/2.22
module load ncarcompilers/0.5.0
module unload netcdf

module use /glade/p/ral/jntp/GMTB/tools/hpc-stack-v1.2.0/modulefiles/stack
module use /glade/work/epicufsrt/GMTB/tools/hpc-stack-v1.2.0_6eb6/modulefiles/stack
module load hpc/1.2.0
module load hpc-gnu/10.1.0
module load hpc-mpt/2.22
Expand Down
3 changes: 2 additions & 1 deletion modulefiles/ufs_cheyenne.intel
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,8 @@ module load mpt/2.22
module load ncarcompilers/0.5.0
module unload netcdf

module use /glade/p/ral/jntp/GMTB/tools/hpc-stack-v1.2.0/modulefiles/stack
module use /glade/work/epicufsrt/GMTB/tools/hpc-stack-v1.2.0_6eb6/modulefiles/stack

module load hpc/1.2.0
module load hpc-intel/2021.2
module load hpc-mpt/2.22
Expand Down
2 changes: 1 addition & 1 deletion modulefiles/ufs_cheyenne.intel_debug
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ module load mpt/2.22
module load ncarcompilers/0.5.0
module unload netcdf

module use /glade/p/ral/jntp/GMTB/tools/hpc-stack-v1.2.0/modulefiles/stack
module use /glade/work/epicufsrt/GMTB/tools/hpc-stack-v1.2.0_6eb6/modulefiles/stack
module load hpc/1.2.0
module load hpc-intel/2021.2
module load hpc-mpt/2.22
Expand Down
4 changes: 2 additions & 2 deletions modulefiles/ufs_common
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ module load png/1.6.35
module load hdf5/1.10.6
module load netcdf/4.7.4
module load pio/2.5.2
module load esmf/8.2.1b04
module load esmf/8.3.0b09
module load fms/2021.04

module load bacio/2.4.1
Expand All @@ -20,4 +20,4 @@ module load w3nco/2.4.1

module load gftl-shared/v1.3.3
module load yafyaml/v0.5.1
module load mapl/2.11.0-esmf-8.2.1b04
module load mapl/2.11.0-esmf-8.3.0b09
4 changes: 2 additions & 2 deletions modulefiles/ufs_common_debug
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ module load png/1.6.35
module load hdf5/1.10.6
module load netcdf/4.7.4
module load pio/2.5.2
module load esmf/8.2.1b04-debug
module load esmf/8.3.0b09-debug
module load fms/2021.04

module load bacio/2.4.1
Expand All @@ -20,4 +20,4 @@ module load w3nco/2.4.1

module load gftl-shared/v1.3.3
module load yafyaml/v0.5.1
module load mapl/2.11.0-esmf-8.2.1b04
module load mapl/2.11.0-esmf-8.3.0b09
2 changes: 1 addition & 1 deletion modulefiles/ufs_wcoss_cray
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,7 @@ module load gni-headers
module load udreg
module load ugni

module load esmf/8.2.1b04
module load esmf/8.3.0b09
module load fms/2021.04

module swap pmi pmi/5.0.11
Expand Down
2 changes: 1 addition & 1 deletion modulefiles/ufs_wcoss_cray_debug
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,7 @@ module load gni-headers
module load udreg
module load ugni

module load esmf/8.2.1b04-debug
module load esmf/8.3.0b09-debug
module load fms/2021.04

module swap pmi pmi/5.0.11
Expand Down
330 changes: 165 additions & 165 deletions tests/RegressionTests_cheyenne.gnu.log

Large diffs are not rendered by default.

1,034 changes: 517 additions & 517 deletions tests/RegressionTests_cheyenne.intel.log

Large diffs are not rendered by default.

790 changes: 395 additions & 395 deletions tests/RegressionTests_gaea.intel.log

Large diffs are not rendered by default.

256 changes: 128 additions & 128 deletions tests/RegressionTests_hera.gnu.log

Large diffs are not rendered by default.

804 changes: 402 additions & 402 deletions tests/RegressionTests_hera.intel.log

Large diffs are not rendered by default.

790 changes: 396 additions & 394 deletions tests/RegressionTests_orion.intel.log

Large diffs are not rendered by default.

522 changes: 261 additions & 261 deletions tests/RegressionTests_wcoss_cray.log

Large diffs are not rendered by default.

884 changes: 432 additions & 452 deletions tests/RegressionTests_wcoss_dell_p3.log

Large diffs are not rendered by default.

12 changes: 9 additions & 3 deletions tests/rt.sh
Original file line number Diff line number Diff line change
Expand Up @@ -301,8 +301,8 @@ elif [[ $MACHINE_ID = jet.* ]]; then

export PATH=/lfs4/HFIP/hfv3gfs/software/miniconda3/4.8.3/envs/ufs-weather-model/bin:/lfs4/HFIP/hfv3gfs/software/miniconda3/4.8.3/bin:$PATH
export PYTHONPATH=/lfs4/HFIP/hfv3gfs/software/miniconda3/4.8.3/envs/ufs-weather-model/lib/python3.8/site-packages:/lfs4/HFIP/hfv3gfs/software/miniconda3/4.8.3/lib/python3.8/site-packages
ECFLOW_START=/lfs4/HFIP/hfv3gfs/software/miniconda3/4.8.3/envs/ufs-weather-model/bin/ecflow_start.sh
ECF_PORT=$(( $(id -u) + 1500 ))
module load ecflow
ECFLOW_START=/apps/ecflow/5.5.3/bin/ecflow_start.sh

QUEUE=batch
COMPILE_QUEUE=batch
Expand Down Expand Up @@ -355,7 +355,7 @@ elif [[ $MACHINE_ID = cheyenne.* ]]; then
COMPILE_QUEUE=regular
PARTITION=
dprefix=/glade/scratch
DISKNM=/glade/p/ral/jntp/GMTB/ufs-weather-model/RT
DISKNM=/glade/scratch/epicufsrt/GMTB/ufs-weather-model/RT
STMP=$dprefix
PTMP=$dprefix
SCHEDULER=pbs
Expand Down Expand Up @@ -815,6 +815,12 @@ EOF
export skip_check_results=${skip_check_results}
export delete_rundir=${delete_rundir}
EOF
if [[ $MACHINE_ID = jet.* ]]; then
cat << EOF >> ${RUNDIR_ROOT}/run_test_${TEST_NR}.env
export PATH=/lfs4/HFIP/hfv3gfs/software/miniconda3/4.8.3/envs/ufs-weather-model/bin:/lfs4/HFIP/hfv3gfs/software/miniconda3/4.8.3/bin:$PATH
export PYTHONPATH=/lfs4/HFIP/hfv3gfs/software/miniconda3/4.8.3/envs/ufs-weather-model/lib/python3.8/site-packages:/lfs4/HFIP/hfv3gfs/software/miniconda3/4.8.3/lib/python3.8/site-packages
EOF
fi

if [[ $ROCOTO == true ]]; then
rocoto_create_run_task
Expand Down
9 changes: 7 additions & 2 deletions tests/rt_utils.sh
Original file line number Diff line number Diff line change
Expand Up @@ -286,7 +286,7 @@ check_results() {
if [[ ${MACHINE_ID} =~ orion || ${MACHINE_ID} =~ hera || ${MACHINE_ID} =~ wcoss_dell_p3 || ${MACHINE_ID} =~ wcoss_cray || ${MACHINE_ID} =~ cheyenne || ${MACHINE_ID} =~ gaea || ${MACHINE_ID} =~ jet || ${MACHINE_ID} =~ s4 ]] ; then
printf ".......ALT CHECK.." >> ${REGRESSIONTEST_LOG}
printf ".......ALT CHECK.."
${PATHRT}/compare_ncfile.py ${RTPWD}/${CNTL_DIR}/$i ${RUNDIR}/$i >/dev/null 2>&1 && d=$? || d=$?
${PATHRT}/compare_ncfile.py ${RTPWD}/${CNTL_DIR}/$i ${RUNDIR}/$i > compare_ncfile.log 2>&1 && d=$? || d=$?
if [[ $d -eq 1 ]]; then
echo "....ERROR" >> ${REGRESSIONTEST_LOG}
echo "....ERROR"
Expand Down Expand Up @@ -534,7 +534,7 @@ ecflow_run() {
# in rare instances when UID is greater then 58500 (like Ratko's UID on theia)
[[ $ECF_PORT -gt 49151 ]] && ECF_PORT=12179

ECF_HOST=$( hostname )
ECF_HOST="${ECF_HOST:-$HOSTNAME}"

set +e
ecflow_client --ping --host=${ECF_HOST} --port=${ECF_PORT}
Expand All @@ -544,6 +544,11 @@ ecflow_run() {
if [[ ${MACHINE_ID} == wcoss2 ]]; then
# Annoying "Has NCO assigned port $ECF_PORT for use by this account? (yes/no) ".
echo yes | ${ECFLOW_START} -p ${ECF_PORT} -d ${RUNDIR_ROOT}/ecflow_server
elif [[ ${MACHINE_ID} == jet.* ]]; then
module load ecflow
echo "Using special Jet ECFLOW start procedure"
MYCOMM="bash -l -c \"module load ecflow && ${ECFLOW_START} -d ${RUNDIR_ROOT}/ecflow_server\""
ssh $ECF_HOST "${MYCOMM}"
else
${ECFLOW_START} -p ${ECF_PORT} -d ${RUNDIR_ROOT}/ecflow_server
fi
Expand Down
2 changes: 1 addition & 1 deletion tests/tests/regional_3km
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ export MODEL_CONFIGURE=model_configure_regional_3km.IN
export DIAG_TABLE=diag_table_lam
export FIELD_TABLE=field_table_regional

export WLCLK=10
export WLCLK=15
export FHMAX=6
export TASKS=120
export INPES=10
Expand Down