Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WCOSS2 Migration and Porting #398

Closed
aerorahul opened this issue Aug 10, 2021 · 49 comments
Closed

WCOSS2 Migration and Porting #398

aerorahul opened this issue Aug 10, 2021 · 49 comments
Assignees
@KateFriedman-NOAA
Labels
Epic port Porting the system to a new platform
Milestone
WCOSS2 - GFSv16.2.x

Comments

@aerorahul
Copy link
Contributor

aerorahul commented Aug 10, 2021 •
edited by KateFriedman-NOAA
Loading

This epic will document the migration and porting of the global workflow and its components to WCOSS2.

The GFSv16 operational tags need to be ported on WCOSS2 along with the current state of the workflow (and its components).

It is not expected to have bit-wise identical results between current WCOSS and WCOSS2, but the differences should be justified through a butterfly test.

Since GFSv16 did not use HPC-Stack, and WCOSS2 will use it, there may be differences in the versions of the libraries. It is acceptable to use the later (newer) versions of the libraries and utilities instead of those from the GFSv16 tag. These differences should be noted in the Issue description for the components.

Proposed here is a suggested approach for porting GFSv16 tag to WCOSS2:

  • Port the latest develop/master to WCOSS2 and perform any relevant testing.
  • Create a branch from the GFSv16 tag/branch in your repository and then git cherry pick build changes from current develop/master that are relevant to GFSv16. Perform a butterfly test and compare output with WCOSS Dell P3.

List of issues to facilitate migration of global workflow and its components to WCOSS2.

Component Issue(s) Contact Status Build Run Notes
global workflow #399, #419 @KateFriedman-NOAA In progress and waiting for component deliveries Y
HPC Stack @Hang-Lei-NOAA Deployed on WCOSS2 by NCO -
NCEPLibs @Hang-Lei-NOAA Deployed on WCOSS2 by NCO -
OBSPROC @ShelleyMelchior-NOAA -
UFS WM #806 @junwang-noaa @DusanJovic-NOAA Test branch provided: gfs_v16.0.16_on_cactus_dogwood Y Local modifications to build with Wen Meng provided upp/8.1.0 module and change to configure.fv3.wcoss2 to use HDF5_ROOT instead of HDF5 variable for HDF5 library paths during build. Only run at C192 so far (ok).
GSI #246 @MichaelLueken-NOAA Provided branch: feature/gfsda.v16.1.5_wcoss2_port; see #398 (comment) Y
GLDAS PR #24 @HelinWei-NOAA New v1.19 tag cut Y
UFS_UTILS #580, #559 @GeorgeGayno-NOAA Test version for develop provided: feature/gfsv16.0.0-wcoss2 Y
UPP #363, #364 @WenMeng-NOAA Test branch provided: post_gfsv16_wcoss2 Y
EMC_gfs_wafs @YaliMao-NOAA Tag provided: gfs_wafs.v6.2.0 Y
EMC_verif-global #66 @malloryprow
TC_tracker @JiayiPeng-NOAA
FIT2OBS @jack-woollen
Bufr sounding @HuiyaChuang-NOAA @GuangPingLou-NOAA
AWIPS, bulletins, GEMPAK (atmosphere and wave) @BoiVuong-NOAA Tested GFS AWIPS, bulletins and GFS gempak (not wave). PR #460
@aerorahul aerorahul added Epic implementation work port Porting the system to a new platform labels Aug 10, 2021
@KateFriedman-NOAA KateFriedman-NOAA pinned this issue Aug 10, 2021
@GeorgeGayno-NOAA GeorgeGayno-NOAA mentioned this issue Aug 10, 2021
Closed
This was referenced Aug 10, 2021
Closed
Closed
@KateFriedman-NOAA KateFriedman-NOAA mentioned this issue Aug 10, 2021
Closed
3 tasks
@KateFriedman-NOAA KateFriedman-NOAA mentioned this issue Aug 18, 2021
Closed
19 tasks
@KateFriedman-NOAA
Copy link
Member

@Hang-Lei-NOAA @junwang-noaa @MichaelLueken-NOAA @HelinWei-NOAA @YaliMao-NOAA @JiayiPeng-NOAA @jack-woollen @ShelleyMelchior-NOAA

All,

This is an epic issue in global-workflow to document the port of the GFS components to WCOSS2. If not already done, please open WCOSS2 port issues in your respective repositories and reference this issue. If your auth repo is still on VLab please comment in this issue with info on your issues in VLab. I will add links to the relevant issues in the table above.

If you are listed in the table above you are a contact for your component but we understand you may not necessarily be the person doing the work. Please let me know if a different contact should be listed, thanks!

I will be working on the workflow side of the port and will be looking for component updates so we can test the full GFS systems (both GFSv16 and GFSv17+) on WCOSS2. We will need both the production versions used by the GFSv16.1.2 (soon-to-be v16.1.3) and the develop/master branches ported to WCOSS2. As able, tests of ported copies should also be performed on tier 1 NOAA platforms (WCOSS-Dell, Hera, Orion, Jet) to check that R&D support is not broken. EIB can assist with testing obsproc on non-WCOSS platforms.

Thank you all!

@malloryprow malloryprow mentioned this issue Aug 26, 2021
Closed
@Hang-Lei-NOAA
Copy link
Contributor

Hang-Lei-NOAA commented Aug 26, 2021 via email

@SMoorthi-emc
Copy link
Contributor

SMoorthi-emc commented Aug 27, 2021 via email

@Hang-Lei-NOAA
Copy link
Contributor

Hang-Lei-NOAA commented Aug 27, 2021 via email

@GeorgeGayno-NOAA
Copy link
Contributor

@Hang-Lei-NOAA I don't have access to Acorn. Can the hpc-stack be installed on Cactus under someone's home directory?

@Hang-Lei-NOAA
Copy link
Contributor

Hang-Lei-NOAA commented Aug 27, 2021 via email

@MichaelLueken
Copy link

@Hang-Lei-NOAA

On Acorn, the environment path to w3emc is:
/lfs/h1/emc/nceplibs/noscrub/hpc-stack/libs/hpc-stack/intel/19.1.3.304/cray-mpich/8.1.4/w3emc/2.7.3/lib/libw3emc_4.a

The actual path to w3emc is:
/lfs/h1/emc/nceplibs/noscrub/hpc-stack/libs/hpc-stack/intel-19.1.3.304/cray-mpich-8.1.7/w3emc/2.7.3/lib/libw3emc_4.a

Please correct one of these paths so that they correspond with one another.

@Hang-Lei-NOAA
Copy link
Contributor

Hang-Lei-NOAA commented Aug 27, 2021 via email

@MichaelLueken
Copy link

@Hang-Lei-NOAA

Thanks, Hang! I was able to compile the code using your hpc-stack v1.2.0.

@KateFriedman-NOAA
Copy link
Member

WCOSS2 transition spreadsheet shared by Steven Earle gives the GFS the following timeframe:

GFS Wed 9/1/21 Thu 2/24/22
Dev testing Wed 9/1/21 Wed 1/5/22
deliver to NCO Thu 1/6/22 Thu 1/6/22
Move to production Fri 1/7/22 Thu 2/24/22

The noted "resource name" is @aerorahul

@HelinWei-NOAA
Copy link
Contributor

@KateFriedman-NOAA I have created the new tag for the version that can be run on wcoss2

@KateFriedman-NOAA
Copy link
Member

@KateFriedman-NOAA I have created the new tag for the version that can be run on wcoss2

@HelinWei-NOAA Great, thanks! Which WCOSS2 port does this tag support? The operational GFSv16 or developmental GFSv17+? This looks like it could potentially support both but we need to be careful of which stack is used: the production stack install for current ops systems or the upcoming development hpc-stack install (not yet installed) for future ops versions.

One question to help with sorting that out...does the GLDAS need parallel netcdf? If so, I believe you need to load the netcdf module that is unlocked by loading the cray-mpich/8.1.4 module (netcdf-hdf5parallel/4.7.4) and not the netcdf/4.7.4 module that is unlocked by the intel modules.

@DusanJovic-NOAA
Copy link

To build GFSv16 (tag v16.0.6) run the following sequence of commands on Cactus:

$  git clone --recursive --branch gfs_v16.0.16_on_cactus_dogwood https://github.com/DusanJovic-NOAA/ufs-weather-model
$  cd ufs-weather-model/tests
$  ./compile.sh $(pwd)/../FV3 wcoss2 "WW3=Y 32BIT=Y" 1

Dusan

@WenMeng-NOAA
Copy link
Contributor

@KateFriedman-NOAA The UPP for GFSV16 wcoss2 transition branch is available at
https://github.com/WenMeng-NOAA/UPP/tree/post_gfsv16_wcoss2

The GFSV16 offline post executable can be built with script under sorc/build_ncep_post.sh.
To build GFSV16 model executable, you may load module upp/8.0.11 on Cactus:
module use /u/Wen.Meng/noscrub/ncep_post/LIBS/modulefiles/mpi/intel/19.1.3.304/cray-mpich/8.1.4
module show upp/8.0.11

@aerorahul
Copy link
Contributor Author

@WenMeng-NOAA @DusanJovic-NOAA
Please open/use an issue in your respective repositories to post the instructions on how to build the ported executable for WCOSS2.
@WenMeng-NOAA that would be issue 363 in the UPP repo.
@DusanJovic-NOAA If there is no issue in the ufs-weather-model, please open one there.
We can follow the issues in the respective repositories.
This comment list will get too long and entwined with a number of components.

@KateFriedman-NOAA
Copy link
Member

All, the parallel hdf5 and netcdf modules have been renamed on WCOSS2 to match the new hpc-stack naming convention found on other platforms. Please update your components builds to use the updated names, thanks!

Before: module load hdf5-parallel/1.10.6 --> Now: module load hdf5/1.10.6
Before: module load netcdf-hdf5parallel/4.7.4 --> Now: module load netcdf/4.7.4

Note: there are now two netcdf/4.7.4 modules. The parallel one that is made available after loading the cray-mpich/8.1.7 module appears to be the default (D) one:

$ module avail netcdf

------------------------ WCOSS2 Intel Compiled MPI Libraries and Tools -------------------------
   netcdf-hdf5parallel/4.7.4    netcdf/4.7.4 (D)    pnetcdf/1.12.2

-------------------------- WCOSS2 Intel Compiled Libraries and Tools ----------------------------
   netcdf/3.6.3    netcdf/4.7.4

The prior named module versions will be removed shortly.

@KateFriedman-NOAA
Copy link
Member

KateFriedman-NOAA commented Sep 17, 2021 •
edited
Loading

Added bufr sounding to the component list. @HuiyaChuang-NOAA @GuangPingLou-NOAA please provide a repo where the work will happen and an associated issue for tracking progress from this epic. Let me know if work is needed to codes that reside in global-workflow, I just started a PR with build changes for what we build in global-workflow for bufrsnd. See PR #444. In the meeting today I mentioned that we're currently building gfs_bufr and tocsbufr in global-workflow via build_gfs_bufrsnd.sh:
https://github.com/KateFriedman-NOAA/global-workflow/blob/feature/ops-wcoss2/sorc/build_gfs_bufrsnd.sh

@KateFriedman-NOAA
Copy link
Member

Added GFS downstream AWIPS, bulletins, and GEMPAK to component table above. @BoiVuong-NOAA is the POC.

@GuangPingLou-NOAA
Copy link
Contributor

GuangPingLou-NOAA commented Sep 17, 2021 via email

lgannoaa added a commit to lgannoaa/global-workflow that referenced this issue Jan 7, 2022
@lgannoaa
ecflow package for wcoss2 GFS transition
966adb4 
  WCOSS2 Migration and Porting
    NOAA-EMC#398
lgannoaa added a commit to lgannoaa/global-workflow that referenced this issue Jan 7, 2022
@lgannoaa
ecflow package for wcoss2 GFS transition
68651b3 
  WCOSS2 Migration and Porting
    NOAA-EMC#398
@lgannoaa lgannoaa mentioned this issue Jan 7, 2022
Merged
This was referenced Jan 12, 2022
Merged
Merged
Merged
Merged
Merged
@aerorahul aerorahul mentioned this issue Jan 21, 2022
Merged
8 tasks
This was referenced Jan 25, 2022
Merged
Merged
@aerorahul aerorahul mentioned this issue Jan 26, 2022
Merged
8 tasks
This was referenced Jan 28, 2022
Merged
Merged
Merged
Merged
lgannoaa pushed a commit to lgannoaa/global-workflow that referenced this issue Feb 9, 2022
@fossell
Add CODEOWNERS file (NOAA-EMC#398)
74135d2 
* Starting UPP version numbers with 10.0.0 for develop branch

* Add codeowners file to develop
@KateFriedman-NOAA KateFriedman-NOAA unpinned this issue Feb 23, 2022
@KateFriedman-NOAA KateFriedman-NOAA mentioned this issue Mar 1, 2022
Closed
2 tasks
@DusanJovic-NOAA DusanJovic-NOAA mentioned this issue Mar 7, 2022
Closed
@KateFriedman-NOAA KateFriedman-NOAA added this to the WCOSS2 - GFSv16.2.0 milestone Mar 7, 2022
@malloryprow
Copy link
Contributor

Finally got a fix from NCO for the problem I was experiencing. Tag verif_global_v2.9.0 from EMC_verif-global has support for WCOSS2!!

@KateFriedman-NOAA
Copy link
Member

Finally got a fix from NCO for the problem I was experiencing. Tag verif_global_v2.9.0 from EMC_verif-global has support for WCOSS2!!

Excellent! I'll test this new tag on WCOSS2 and update the relevant branches with it (dev_v16 to start). Will send you output to check when I have it. Thanks @malloryprow !

KateFriedman-NOAA added a commit that referenced this issue Jul 5, 2022
@KateFriedman-NOAA
Merge branch 'feature/ops-wcoss2_v16.2.0' into operations_v16.2.0
4cee4d3 
* feature/ops-wcoss2_v16.2.0: (415 commits)
  Add GFSv16.1.8 release notes
  Matching memory updates for awips/gempak in config
  Update prior GFS version in v16.2.0 release notes
  Update gfspostsnd job resources - oversubscribing
  Memory and resource adjustments to some jobs (NCO)
  Update to HOMENHC default path in JGLOBAL_ATMOS_TROPCY_QC_RELOC
  Update EMC tag name in v16.2.0 release notes
  Resource updates for analysis_calc job on WCOSS2
  Updated error handling in gfs_bufr script
  Add -g and -traceback flags to utility builds if missing
  EnKf forecast serial netcdf updates and DELTIM=200
  Add HOMEobsproc back to config.base.nco.static
  Update "excl" to "exclhost" in workflow_utils.py
  Update ecf PBS excl to exclhost
  Remove reference to HOMEobsproc in NCO config.base
  Update GFSv16.2.0 release notes for new hand-off tag
  Update WCOSS2 env file cpu-bind flags for threading
  Update UPP tag to upp_v8.1.2
  Remove nco_ver from build.ver - not needed
  Update release notes to update prior version
  Update GFSv16.2.0 release notes to reflect new tag
  Increase post_master job to 126 tasks
  Update enkfgdas_sfc job to use 60GB
  Add gsl module load needed by nco module
  Set hyper=true for gdas_atmos_analysis_calc job
  Optimized gfs_forecast job resource configuration
  Add WCOSS2 operations gfs defs files
  Add missing --init flag to GSI checkout submodule
  update file Release_Notes.gfs.v16.1.7.txt
  add Release_Notes.gfs.v16.1.7.txt
  Code update to syndat_getjtbul.fd for v16.1.7
  Update HOMEobsproc paths in config.base.nco.static
  Update obsproc package settings in dev config.base
  Update prep.sh to use new WCOSS2 obsproc packages
  Add obsproc/prepobs run versions to wcoss2.ver
  Add needed gempak subfolder to gempak ush scripts
  Update GSI submodule command and release notes
  GFS v16.1.6 update: Turn off uv 224 VADWND
  Update GLDAS tag to gldas_gfsv16_release.v.2.0.0
  Update DMPDIR and BASE_GIT paths for WCOSS2
  Update Externals.cfg with GFSv16.2.0 component versions
  Update release notes for current ops version
  Move all PBS place settings to separate line
  Remove commented out lines from transfer lists
  Update WAFS tag to gfs_wafs.v6.2.8
  GFS v16.1.6: Update release notes and comment in config.anal
  Update npe_node_fcst_gfs in config.resources.emc.dyn
  Updates to support wcoss2.ver
  Fold in transfer parm list updates from NCO
  Move transfer lists into new transfer folder
  Update wave job resources with NCO feedback
  Update EMC tag name in v16.2.0 release notes
  Updates to run.ver and create wcoss2.ver
  Script updates from NCO
  GFS v16.1.6: GSI update to add commercial GPSRO in DO-4
  Move excl setting into resource line in ecf scripts
  Update gfs_forecast job resources
  Update several versions in run.ver
  Add OMP_PLACES=cores for fcst block in WCOSS2.env
  Update compilation flags for gaussian_sfcanl build
  Add the following scripts changed to remove module load libjpeg:  jgdas_wave_prep.ecf  jgfs_wave_prep.ecf
  Remove hardwired DELL path util/ush/make_tif.sh
  Remove esmf from enkf fcst
  1.   A check on job/ush/script from HOMEgfs, I found the following reference to USE_CFP:   gldas_forcing.sh   exgdas_atmos_chgres_forenkf.sh   exgdas_atmos_gldas.sh   exgdas_enkf_update.sh   exglobal_atmos_analysis.sh   exglobal_diag.sh
  Correct analysis job walltimes in config.resources
  The following scripts changed to remove module load wgrib2:   jenkfgdas_sfc.ecf   jgfs_wave_prdgen_bulls.ecf   jgdas_wave_postsbs.ecf
  Adjust analysis job walltimes for ops
  Add missing EXPDIR setting to JGDAS_ATMOS_GEMPAK
  Remove non-WCOSS2 references in nco.static configs
  Update EMC tag name in release notes
  Change npe_analdiag to 96
  Remove npe_node_eupd=9 setting on WCOSS2
  Update several GSI/EnKF job resources
  Update to correct infinite loop in gempak script
  Add missing character to GLDAS tag in release notes
  Update GLDAS tag to gldas_gfsv16_release.v.1.28.0
  Remove excl for gfswaveprep job PBS directive
  Update GFSv16.2.0 release notes
  GEMPAK_META script updates from Boi
  Update GEMPAK scripts
  Update gempak job in setup_workflow scripts
  Back out comment of job variable in awips scripts
  Resource adjustments for eobs, waveprep, gfspost
  Resource updates for analysis and eobs
  Change RUN to RUN2 in awips scripts
  Change RUN to RUN2 in gempak pgrb2 spec script
  Correct config list for wavepostbndpntbll job
  Comment out job variable in awips ecf scripts
  Reduce gdas analysis job walltime back to 40mins
  Remove nth_max usage in WCOSS2.env
  A few resource updates from NCO and WCOSS_C removal
  Update analysis job walltime to 50mins
  Optimization resource updates from NCO
  remove obsproc ecfs and there references from suite.def.  work needs to find a proper trigger for the remaining dump job
  bringing in changes from @WeiWei-NCO after his testing
  Update analysis job walltime to 50 mins
  Update gdasechgres job resources
  Update esfc and analysis job resources
  Update C384 and C768 values in config.fv3.emc.dyn
  Update config.resource.emc.dyn with tested values
  Cleanup of config.fv3.nco.static
  Add COMIN_OBS/COMIN_GES_OBS and related xml support
  Add COMIN_OBS/COMIN_GES_OBS and related xml support
  Update resources for gdasesfc job in ecf script
  Numerous resource updates based on optimization
  Update for C768 gdasfcst job resource settings
  Update analysis job ecf resource settings
  Update to WCOSS2 env file for waveprep job
  Add missing get_awipsgroups function to fcstonly
  Update memory setting in workflow_utils for gfs
  update resources for more jobs in ecf scripts from NCO
  update resources for more jobs in ecf scripts from NCO
  update resources for jgfs_atmos_tropcy_qc_reloc.ecf.  Remove developer overwrite section
  update resources for jgdas_atmos_tropcy_qc_reloc.ecf.  Remove developer overwrite section
  update resources for more jobs to include memory in ecf scripts.  wave init jobs need modules for Intel loaded
  update resources for wave jobs to include memory in ecf scripts
  update resources for atmos chgres for enkf in ecf scripts
  update resources for atmos pp wafs_gcip in ecf scripts
  update resources for atmos gempak_meta in ecf scripts
  update resources for atmos gempak in ecf scripts
  update resources for wave init, post and prep jobs in ecf scripts
  fix resource allocations for some jobs that NCO flagged were allocating too many cores
  Remove unneeded COM paths from wavepostsbs JJOB
  Update GLDAS tag in release notes
  Update GLDAS tag to gldas_gfsv16_release.v1.25.0
  wave init jobs just need cray-pals per NCO.  remove rest
  put NCO identified changes from the global-workflow in a branch
  remove gdas remnant from enkfgdas jobnames
  some PBS jobnames were hardwired gdas or gfs, while some inherited from %RUN%. This commit uses %RUN% to make it consistent and possibly will open the door for further consolidation between gdas and gfs families
  post/anl job is the same as the forecast hour.  create a link, instead of having a copy
  Update post job resources in config.resources.nco.static
  Update post jobs ecf script resources
  Update release notes for new EMC tag
  Update workflow_utils.py to support exclusive
  Add imagemagick_ver=7.0.8-7 to run.ver
  Update NCO resource config for memory
  Update v16.2.0 release notes for ecf script linking
  Add memory setting to jgfs_atmos_wafs_master.ecf
  Add memory setting to jgfs_atmos_wafs_grib2_0p25.ecf
  Add memory setting to jgfs_atmos_wafs_grib2.ecf
  Add memory setting to jgfs_atmos_wafs_blending_0p25.ecf
  Add memory setting to jgfs_atmos_wafs_blending.ecf
  Add memory setting to jgfs_atmos_awips_g2_master.ecf
  Add memory setting to jgfs_atmos_awips_master.ecf
  Add excl tag to jgfs_atmos_gempak.ecf
  Add excl tag to jgfs_forecast.ecf
  add pesky blank lines at the end of script. reviewers are brutal
  add script that sets up the links to the master.ecf that loop over forecast hours
  add gitignore in appropriate places to ignore links.  update defs to the consistent grib_wafs ecf tasks
  remove duplicate jgfs_atmos_wafs_f*.ecf files and rename f00 as master
  remove duplicate jgfs_atmos_awips_g2_f*.ecf files and rename f000 as master
  remove duplicate jgfs_atmos_awips_f*.ecf files and rename f000 as master
  remove duplicate gfs_atmos_post_fxxx.ecf files and rename f000 as master
  fix typo that causes the opposite effect
  ignore gdas/atmos/post/ forecast hour ecf links
  remove duplicate gdas_atmos_post_fxxx.ecf files and rename f000 as master
  remove remnant from PR555 that copied gdas/enkf to enkfgdas. add gitignore in enkfgdas/post to ignore links
  remove duplicate enkfgdas_post_fxxx.ecf files and rename f003 as master
  add script that sets up the links to the master.ecf that loop over forecast hours
  add gitignore in appropriate places to ignore links.  update defs to the consistent grib_wafs ecf tasks
  remove duplicate jgfs_atmos_wafs_f*.ecf files and rename f00 as master
  remove duplicate jgfs_atmos_awips_g2_f*.ecf files and rename f000 as master
  remove duplicate jgfs_atmos_awips_f*.ecf files and rename f000 as master
  remove duplicate gfs_atmos_post_fxxx.ecf files and rename f000 as master
  fix typo that causes the opposite effect
  ignore gdas/atmos/post/ forecast hour ecf links
  remove duplicate gdas_atmos_post_fxxx.ecf files and rename f000 as master
  remove remnant from PR555 that copied gdas/enkf to enkfgdas. add gitignore in enkfgdas/post to ignore links
  remove duplicate enkfgdas_post_fxxx.ecf files and rename f003 as master
  request exclusive node where ncpus=128
  remove memory requests of 500gb and request exclusive node instead
  every ecf script that loads compiler dependent module, now loads PrgEnv-intel, craype and intel
  every ecf script that loads compiler dependent module, now loads PrgEnv-intel, craype and intel
  every ecf script that loads compiler dependent module, now loads PrgEnv-intel, craype and intel
  every ecf script that loads cray-mpich, now loads PrgEnv-intel, craype and intel.  Ignore swp files
  Correct COMIN paths in GEMPAK driver scripts
  Update COMIN paths for ukmet, ecmwf, and nam
  Update WAFS tag to gfs_wafs.v6.2.7
  add #PBS -l debug=true to all .ecf files
  Correct COMIN definitions
  Update GLDAS and WAFS tags in release notes
  Update GLDAS tag to gldas_gfsv16_release.v1.24.0
  revert ecflow include files to NCO versions.  Will adapt as necessary for proper use
  Remove NCO if-block from JJOB scripts
  Update ROTDIR in config.base.nco.static
  Remove ecflow post assignment in envir-p1.h
  Remove remark from envir-p1.h and head.h Update analysis ecflow script to use 128 for wcoss2 Remove extra CDATE
  Reference to NCO version:  - Move enkf out of gdas and rename it to enkfgdas.      Include all ecflow definition files job name      Include all ecflow scripts name and job/log name  - Move "model=gfs" to the top on each job except all jobs under obsproc.      obsproc will no longer be part of GFS. Therefore leave it without change for testing purpose.  - Remove the source of model_ver from each ecflow script except all jobs under obsproc.      obsproc will no longer be part of GFS. Therefore leave it without change for testing purpose.
  Update enkf structure changes in ecflow definition files
  Update WAFS tag to gfs_wafs.v6.2.6
  Remove envvar from module-setup.*.inc scripts
  Remove envvar from WCOSS2 driver scripts
  Update machine-setup based on NCO feedback
  Update builds and makefiles based on NCO feedback
  Modulefile updates based on NCO feedback
  Update build.ver based on NCO feedback
  Add OMP_STACKSIZE to WCOSS2.env for forecast
  Update Release_Notes.gfs.v16.2.0.md
  Fix GFS fcst APRUN_FV3 command
  ecflow package for wcoss2 GFS transition   WCOSS2 Migration and Porting     #398
  ...
@KateFriedman-NOAA KateFriedman-NOAA mentioned this issue Jul 5, 2022
Merged
13 tasks
KateFriedman-NOAA added a commit that referenced this issue Jul 7, 2022
@KateFriedman-NOAA
GFSv16.2.0 - WCOSS2 transition (#892)
0b771c9 
The GFSv16 is ported to the new WCOSS2 system (Cactus/Dogwood).

Refs #398, #399
@KateFriedman-NOAA
Copy link
Member

The migration of the GFS/global-workflow to WCOSS2 is complete. Both the operational GFSv16 and develop versions of the system have been porting and are now supported on WCOSS2.

THANK YOU TO EVERYONE WHO HELPED WITH THESE PORTS!

Merged
3 tasks
kayeekayee pushed a commit to kayeekayee/global-workflow that referenced this issue May 30, 2024
@climbfuji @DeniseWorthen
Remove Noah-WRFv4, contains "reduce memory required by MERRA2 data" (N…
4214e6d 
…OAA-EMC#410) (NOAA-EMC#398)

* Remove Noah WRFv4 and all variables required only by this scheme; remove suite FV3_HAFS_v0_hwrf
* Reduce memory required by MERRA2 data

Co-authored-by: Denise Worthen <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@KateFriedman-NOAA KateFriedman-NOAA

Labels
Epic port Porting the system to a new platform
Projects
None yet
Milestone
WCOSS2 - GFSv16.2.x
Development

No branches or pull requests