Update srw_common and hashes of UFS_UTILS and UPP

[chan-hoo]

DESCRIPTION OF CHANGES:

• The hashes of UFS_UTILS and UPP are updated with the latest ones.
• the module file srw_comm is updated with the latest modules.
• Since the latest hash of the ufs weather model requires changes in the input namelists, it will be updated in a separate PR later. However, I confirmed that the latest hash of the ufs weather model was built successfully with srw_common in this PR on Orion and Hera.

TESTS CONDUCTED:

• successfully built on Orion and Hera.
• WE2E tests on Orion and Hera:
  grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_2017_gfdlmp_regional
  grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2
  grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16
  grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_RAP_suite_HRRR
  grid_RRFS_CONUS_3km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15_thompson_mynn_lam3km
  grid_RRFS_CONUScompact_25km_ics_HRRR_lbcs_HRRR_suite_RRFS_v1beta
  grid_RRFS_CONUScompact_25km_ics_HRRR_lbcs_RAP_suite_RRFS_v1alpha

DEPENDENCIES:

• Update scripts to work with the latest hashes of UFS_UTILS and UPP regional_workflow#775

[mkavulich]

Testing on Cheyenne, not sure if all the new modules will be available yet.

[mkavulich]

Build tests did indeed fail on Cheyenne. I believe this PR will need to incorporate some of Ed's PR (#250), but all the library combinations I tried failed in some way. I also opened an issue in the hpc-stack repository a while back (NOAA-EMC/hpc-stack#439) but it has not yet received a satisfactory resolution.

[JeffBeck-NOAA]

Thanks, @chan-hoo for fixing the problem with nccmp on Jet. I'm now getting the following error when building UFS_UTILS.

CMake Error at tests/CMakeLists.txt:21 (message):
  Could not download gfs.v16.sfc.history.nc
Call Stack (most recent call first):
  tests/chgres_cube/CMakeLists.txt:16 (PULL_DATA)

-- Configuring incomplete, errors occurred!
See also "/mnt/lfs4/BMC/wrfruc/beck/ufs-srweather-app/build/src/UFS_UTILS/src/UFS_UTILS-build/CMakeFiles/CMakeOutput.log".
make[2]: *** [src/UFS_UTILS/src/UFS_UTILS-stamp/UFS_UTILS-configure] Error 1
make[1]: *** [src/CMakeFiles/UFS_UTILS.dir/all] Error 2

In UFS_UTILS/tests/chgres_cube/CMakeLists.txt, I see this:

# This function is used to download unit test data.
# It takes two arguments, the URL and the file to
# be downloaded.

function(PULL_DATA THE_URL THE_FILE)
  if(NOT EXISTS "${CMAKE_CURRENT_BINARY_DIR}/data/${THE_FILE}")
    file(DOWNLOAD
      ${THE_URL}/${THE_FILE}
      ${CMAKE_CURRENT_BINARY_DIR}/data/${THE_FILE}
      SHOW_PROGRESS
      STATUS status
      INACTIVITY_TIMEOUT 30
      )
    list(GET status 0 status_num)
    if(NOT status_num EQUAL 0 OR NOT EXISTS "${CMAKE_CURRENT_BINARY_DIR}/data/${THE_FILE}")
      message(FATAL_ERROR "Could not download ${THE_FILE}")

@GeorgeGayno-NOAA, any idea why the download of gfs.v16.sfc.history.nc would fail on Jet?

[GeorgeGayno-NOAA]

Thanks, @chan-hoo for fixing the problem with nccmp on Jet. I'm now getting the following error when building UFS_UTILS.

CMake Error at tests/CMakeLists.txt:21 (message):
  Could not download gfs.v16.sfc.history.nc
Call Stack (most recent call first):
  tests/chgres_cube/CMakeLists.txt:16 (PULL_DATA)

-- Configuring incomplete, errors occurred!
See also "/mnt/lfs4/BMC/wrfruc/beck/ufs-srweather-app/build/src/UFS_UTILS/src/UFS_UTILS-build/CMakeFiles/CMakeOutput.log".
make[2]: *** [src/UFS_UTILS/src/UFS_UTILS-stamp/UFS_UTILS-configure] Error 1
make[1]: *** [src/CMakeFiles/UFS_UTILS.dir/all] Error 2

In UFS_UTILS/tests/chgres_cube/CMakeLists.txt, I see this:

# This function is used to download unit test data.
# It takes two arguments, the URL and the file to
# be downloaded.

function(PULL_DATA THE_URL THE_FILE)
  if(NOT EXISTS "${CMAKE_CURRENT_BINARY_DIR}/data/${THE_FILE}")
    file(DOWNLOAD
      ${THE_URL}/${THE_FILE}
      ${CMAKE_CURRENT_BINARY_DIR}/data/${THE_FILE}
      SHOW_PROGRESS
      STATUS status
      INACTIVITY_TIMEOUT 30
      )
    list(GET status 0 status_num)
    if(NOT status_num EQUAL 0 OR NOT EXISTS "${CMAKE_CURRENT_BINARY_DIR}/data/${THE_FILE}")
      message(FATAL_ERROR "Could not download ${THE_FILE}")

@GeorgeGayno-NOAA, any idea why the download of gfs.v16.sfc.history.nc would fail on Jet?

The download of unit test data was made part of UFS_UTILS build system a few month's ago. See ufs-community/UFS_UTILS#619 for more details. Jet is behind a firewall and can't access the EMC ftp site. So to build on that machine you must set this CMake flag as follows: -DBUILD_TESTING=OFF. If you need to build and run the unit tests locally, you will need to use Hera or Orion.

[chan-hoo]

@GeorgeGayno-NOAA, thank you for this info. @JeffBeck-NOAA, I'll add the flag to devbuild.sh soon.

[JeffBeck-NOAA]

Thanks, @GeorgeGayno-NOAA! @chan-hoo, I'll test again as soon as devbuild.sh is updated. Thanks!

[chan-hoo]

@JeffBeck-NOAA, I changed 'src/CMakeLists.txt' directly because we don't need the unit test for UFS_UTILS in UFS SRW App. Can you test it again?

[mkavulich]

@chan-hoo I am tagging @mark-a-potts and @EdwardSnyder-NOAA RE: Cheyenne build problems. I am out of the loop on the status of the new library builds on Cheyenne.

[mark-a-potts]

Do all the new modules exist on the Tier-1 platforms? EPIC can install any that are missing on Cheyenne, but we don't currently control the installation on the other machines.

[chan-hoo]

@mark-a-potts, I've tested it on Hera and Orion successfully, and I think @JeffBeck-NOAA is testing it on Jet. WCOSS will be away in June, so we don't need to worry about wcoss_dell_p3. I don't have access to other machines. I updated the modules for Cheyenne and other machines on the basis of ufs_common in the ufs-weather-model. Can you test it on Cheyenne?

[JeffBeck-NOAA]

@chan-hoo, the build on Jet now completes successfully. I was able to get the GST to run with the following changes (similar to what we had to do on Hera recently):

In ufs-srweather-app/modulefiles/wflow_jet (change top to bottom)

module use -a /contrib/miniconda3/modulefiles
module load miniconda3

module use /contrib/miniconda3/modulefiles
module load miniconda3/4.5.12

In regional_workflow/modulefiles/tasks/jet/miniconda_regional_workflow (change top to bottom):

module use -a /contrib/miniconda3/modulefiles
module load miniconda3

module use /contrib/miniconda3/modulefiles
module load miniconda3/4.5.12

[chan-hoo]

@JeffBeck-NOAA, thank you for testing it. I've updated the scripts for Jet.

[jkbk2004]

@mkavulich @chan-hoo on cheyenne, ufs-wm currently uses: module use /glade/work/epicufsrt/GMTB/tools/intel/2022.1/hpc-stack-v1.2.0_6eb6/modulefiles/stack and /glade/work/epicufsrt/GMTB/tools/gnu/10.1.0/hpc-stack-v1.2.0/modulefiles/stack

[chan-hoo]

@jkbk2004, as you can see, this PR updates the paths to the hpc-stack on Cheyenne with the ones you pointed above. Can you test this PR on Cheyenne?