Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge GSI update into WAFS update release branch for ops GFSv16.3.11 #2035

Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
9696c8a
Update GFS and OBSPROC versions in version files
KateFriedman-NOAA Sep 14, 2023
bc0ce76
Create Release_Notes.gfs.v16.3.10.md for upgrade
KateFriedman-NOAA Sep 14, 2023
fc7b91a
Merge pull request #1860 from KateFriedman-NOAA/release/gfs.v16.3.10
KateFriedman-NOAA Sep 18, 2023
349ed47
Changes required for NOAA-21 monitoring
ADCollard Oct 4, 2023
539544d
Change gdas version in checkout.sh
ADCollard Oct 5, 2023
7acc651
Update UPP and GDAS version numbers
ADCollard Oct 5, 2023
e8fbf00
Changes required for NOAA-21 monitoring
KateFriedman-NOAA Oct 5, 2023
2ea74e0
Update FV3GFS tag in Externals.cfg
KateFriedman-NOAA Oct 5, 2023
2e19687
Update FV3GFS tag in checkout.sh
KateFriedman-NOAA Oct 5, 2023
f3ca94a
Update FV3GFS tag in Release_Notes.gfs.v16.3.10.md
KateFriedman-NOAA Oct 5, 2023
a4e9bce
Add prelude to Release_Notes.gfs.v16.3.10.md
KateFriedman-NOAA Oct 5, 2023
126079a
Add UPP release notes link to release notes
KateFriedman-NOAA Oct 6, 2023
683d07c
Merge pull request #1914 from KateFriedman-NOAA/release/gfs.v16.3.10
KateFriedman-NOAA Oct 6, 2023
c5b7596
Rename release notes for new v16.3.11 version
KateFriedman-NOAA Oct 12, 2023
0079e4b
Update version to v16.3.11
KateFriedman-NOAA Oct 12, 2023
b72a7ab
Merge pull request #1928 from KateFriedman-NOAA/release/gfs.v16.3.11
KateFriedman-NOAA Oct 12, 2023
62ea96b
Remove obsproc component from GFSv16.3.11 upgrade
KateFriedman-NOAA Oct 23, 2023
86f6cdd
Merge pull request #1961 from KateFriedman-NOAA/release/gfs.v16.3.11
KateFriedman-NOAA Oct 23, 2023
f3b576e
Sync merge with dev/gfs.v16 for GFSv16.3.10
KateFriedman-NOAA Oct 23, 2023
b54c7cc
Merge pull request #1962 from KateFriedman-NOAA/release/gfs.v16.3.11
KateFriedman-NOAA Oct 23, 2023
eac250f
Update version to v16.3.12
KateFriedman-NOAA Nov 6, 2023
36fbab5
Merge pull request #2034 from KateFriedman-NOAA/release/gfs.v16.3.12
KateFriedman-NOAA Nov 6, 2023
8eb9b63
Merge GSI and WAFS upgrades for GFSv16.3.11
KateFriedman-NOAA Nov 6, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions Externals.cfg
Original file line number Diff line number Diff line change
@@ -1,14 +1,14 @@
# External sub-modules of global-workflow

[FV3GFS]
tag = GFS.v16.3.0
tag = GFS.v16.3.1
local_path = sorc/fv3gfs.fd
repo_url = https://github.com/ufs-community/ufs-weather-model.git
protocol = git
required = True

[GSI]
tag = gfsda.v16.3.8
tag = gfsda.v16.3.10
local_path = sorc/gsi.fd
repo_url = https://github.com/NOAA-EMC/GSI.git
protocol = git
Expand All @@ -22,7 +22,7 @@ protocol = git
required = True

[UPP]
tag = upp_v8.2.0
tag = upp_v8.3.0
local_path = sorc/gfs_post.fd
repo_url = https://github.com/NOAA-EMC/UPP.git
protocol = git
Expand Down
50 changes: 33 additions & 17 deletions docs/Release_Notes.gfs.v16.3.11.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,14 +4,22 @@ GFS V16.3.11 RELEASE NOTES
PRELUDE
-------

At GFS v16.3 implementation, UPP and WAFS package were updated to be ready to produce high resolution WAFS output to meet 2023 ICAO milestone with one switch. The switch was turned off at GFS v16.3. Now that UKMO has started to produce their corresponding high resolution WAFS output, EMC will work with NCO to turn on the switch.
This upgrade to the GFS includes updates to both the GSI and WAFS packages:

Additionally, EMC is updating WAFS ecf definition file to:
1. trigger WAFS blending job 5 min later
from 4:25 to 4:30 to compensate for 5-10 min delay in receiving UKMO high resolution data;
2. stop producing blended 1.25 deg WAFS file per ICAO milestone.
GSI:

Both sides agreed that we sill stop waiting for data from the other side at T+4:45.
Enable the monitoring of NOAA-21 and GOES-18 radiances in the GFS. A new version of CRTM with new coefficient files is required and included in this change.

WAFS:

At GFS v16.3 implementation, UPP and WAFS package were updated to be ready to produce high resolution WAFS output to meet 2023 ICAO milestone with one switch.
The switch was turned off at GFS v16.3. Now that UKMO has started to produce their corresponding high resolution WAFS output, EMC will work with NCO to turn on the switch.

Additionally, EMC is updating WAFS ecf definition file to:
1. trigger WAFS blending job 5 min later from 4:25 to 4:30 to compensate for 5-10 min delay in receiving UKMO high resolution data;
2. stop producing blended 1.25 deg WAFS file per ICAO milestone.

Both sides agreed that we sill stop waiting for data from the other side at T+4:45.

IMPLEMENTATION INSTRUCTIONS
---------------------------
Expand All @@ -31,11 +39,11 @@ The checkout script extracts the following GFS components:

| Component | Tag | POC |
| --------- | ----------- | ----------------- |
| MODEL | GFS.v16.3.0 | [email protected] |
| MODEL | GFS.v16.3.1 | [email protected] |
| GLDAS | gldas_gfsv16_release.v.2.1.0 | [email protected] |
| GSI | gfsda.v16.3.8 | [email protected] |
| GSI | gfsda.v16.3.10 | [email protected] |
| UFS_UTILS | ops-gfsv16.3.0 | [email protected] |
| POST | upp_v8.2.0 | [email protected] |
| POST | upp_v8.3.0 | [email protected] |
| WAFS | gfs_wafs.v6.3.1 | [email protected] |

To build all the GFS components, execute:
Expand All @@ -55,10 +63,14 @@ cd ../ecf
./setup_ecf_links.sh
```

Additional release notes for `upp/8.3.0` installation on WCOSS2:
https://docs.google.com/document/d/18bUYWmsN7FuweyA2CQTBW1rk3FNRMHKPlYHZlbS8ODs/edit?pli=1

VERSION FILE CHANGES
--------------------

* `versions/run.ver` - change `version=v16.3.11`, and `gfs_ver=v16.3.11`
* `versions/build.ver` - change `crtm_ver=2.4.0.1`
* `versions/run.ver` - change `version=v16.3.11`, `gfs_ver=v16.3.11` and `crtm_ver=2.4.0.1`

SORC CHANGES
------------
Expand All @@ -78,16 +90,17 @@ PARM/CONFIG CHANGES
SCRIPT CHANGES
--------------

* update ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_blending_0p25.ecf to ICAO2023=yes
* update ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_grib2.ecf to ICAO2023=yes
* update ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_grib2_0p25.ecf to ICAO2023=yes
* update ecf/scripts/gfs/atmos/post_processing/jgfs_atmos_wafs_gcip.ecf to ICAO2023=yes
* Changes to sorc/gsi.fd/scripts/exglobal_atmos_analysis.sh
* Update ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_blending_0p25.ecf to ICAO2023=yes
* Update ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_grib2.ecf to ICAO2023=yes
* Update ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_grib2_0p25.ecf to ICAO2023=yes
* Update ecf/scripts/gfs/atmos/post_processing/jgfs_atmos_wafs_gcip.ecf to ICAO2023=yes
* In ecf/defs/gfs_v16_3.def, remove jgfs_atmos_wafs_blending task, delay trigger time of jgfs_atmos_wafs_blending_0p25 by 5 minutes

FIX CHANGES
-----------

* No changes from GFS v16.3.10
* Changes to `fix/fix_gsi/global_anavinfo.l127.txt`, `fix/fix_gsi/global_satinfo.txt` and add `fix/fix_gsi/Rcov_crisn21`

MODULE CHANGES
--------------
Expand All @@ -97,7 +110,7 @@ MODULE CHANGES
CHANGES TO FILE SIZES
---------------------

* There will be file size increases. Please see page 2 of the following Google slide:
* WAFS - There will be file size increases. Please see page 2 of the following Google slide:
https://docs.google.com/presentation/d/1VtPhyYXTe_PS9gXZGMrMPlQ32ELl-JJem-Vq8vO4j_U/edit#slide=id.g134dd9cf8ea_0_107

ENVIRONMENT AND RESOURCE CHANGES
Expand All @@ -109,7 +122,7 @@ PRE-IMPLEMENTATION TESTING REQUIREMENTS
---------------------------------------

* Which production jobs should be tested as part of this implementation?
* WAFS
* GSI & WAFS
* Does this change require a 30-day evaluation?
* No

Expand All @@ -136,5 +149,8 @@ DOCUMENTATION
PREPARED BY
-----------
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
6 changes: 3 additions & 3 deletions sorc/checkout.sh
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ echo $topdir
echo fv3gfs checkout ...
if [[ ! -d fv3gfs.fd ]] ; then
rm -f ${topdir}/checkout-fv3gfs.log
git clone --recursive --branch GFS.v16.3.0 https://github.com/ufs-community/ufs-weather-model.git fv3gfs.fd >> ${topdir}/checkout-fv3gfs.log 2>&1
git clone --recursive --branch GFS.v16.3.1 https://github.com/ufs-community/ufs-weather-model.git fv3gfs.fd >> ${topdir}/checkout-fv3gfs.log 2>&1
cd ${topdir}
else
echo 'Skip. Directory fv3gfs.fd already exists.'
Expand All @@ -35,7 +35,7 @@ fi
echo gsi checkout ...
if [[ ! -d gsi.fd ]] ; then
rm -f ${topdir}/checkout-gsi.log
git clone --recursive --branch gfsda.v16.3.8 https://github.com/NOAA-EMC/GSI.git gsi.fd >> ${topdir}/checkout-gsi.log 2>&1
git clone --recursive --branch gfsda.v16.3.10 https://github.com/NOAA-EMC/GSI.git gsi.fd >> ${topdir}/checkout-gsi.log 2>&1
cd gsi.fd
git submodule update --init
cd ${topdir}
Expand Down Expand Up @@ -64,7 +64,7 @@ fi
echo EMC_post checkout ...
if [[ ! -d gfs_post.fd ]] ; then
rm -f ${topdir}/checkout-gfs_post.log
git clone ${gtg_git_args:-} --branch upp_v8.2.0 https://github.com/NOAA-EMC/UPP.git gfs_post.fd >> ${topdir}/checkout-gfs_post.log 2>&1
git clone ${gtg_git_args:-} --branch upp_v8.3.0 https://github.com/NOAA-EMC/UPP.git gfs_post.fd >> ${topdir}/checkout-gfs_post.log 2>&1
################################################################################
# checkout_gtg
## yes: The gtg code at NCAR private repository is available for ops. GFS only.
Expand Down
2 changes: 1 addition & 1 deletion versions/build.ver
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ export netcdf_ver=4.7.4
export esmf_ver=8.0.1
export wgrib2_ver=2.0.7

export crtm_ver=2.4.0
export crtm_ver=2.4.0.1

export g2tmpl_ver=1.9.1
export bacio_ver=2.4.1
Expand Down
2 changes: 1 addition & 1 deletion versions/run.ver
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ export util_shared_ver=1.4.0
export grib_util_ver=1.2.3
export wgrib2_ver=2.0.7

export crtm_ver=2.4.0
export crtm_ver=2.4.0.1

export g2tmpl_ver=1.9.1
export bacio_ver=2.4.1
Expand Down