ccpp-physics #806, #807, #813, and ort modifications (#970)

- CCPP Physics changes: see Wrapper for ccpp-physics #806, #807, #813, NOAA-EMC/fv3atm#447. - UFS weather model changes for ORT updates following changes in Fix Auto-RT on Gaea, Jet and Orion #965
ufs-community · Dec 21, 2021 · 18becb9 · 18becb9
1 parent 4d613c5
commit 18becb9
Show file tree

Hide file tree

Showing 19 changed files with 3,396 additions and 2,660 deletions.
diff --git a/FV3 b/FV3
diff --git a/tests/OpnReqTests_hera.intel.log → tests/OpnReqTests_control_p7_hera.intel.log b/tests/OpnReqTests_hera.intel.log → tests/OpnReqTests_control_p7_hera.intel.log
@@ -1,19 +1,132 @@
+Sat Dec 18 03:12:52 UTC 2021
+Start Operation Requirement Test
 
-baseline dir = /scratch1/NCEPDEV/stmp4/Minsuk.Ji/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p7_rrtmgp_dbg_base
-working dir  = /scratch1/NCEPDEV/stmp2/Minsuk.Ji/FV3_OPNREQ_TEST/opnReqTest_29570/control_p7_rrtmgp_dbg_base
-Checking test dbg_base control_p7_rrtmgp results ....
-Moving baseline dbg_base control_p7_rrtmgp files ....
+Compile bit elapsed time 363 seconds. -DAPP=ATM -DCCPP_SUITES=FV3_GFS_v16,FV3_GFS_v15_thompson_mynn,FV3_GFS_v15_thompson_mynn_RRTMGP,FV3_GFS_v16_nsstNoahmpUGWPv1,FV3_GFS_v16_p7_rrtmgp -DMPI=ON -DCMAKE_BUILD_TYPE=Release
+Compile dbg elapsed time 167 seconds. -DAPP=ATM -DCCPP_SUITES=FV3_GFS_v16,FV3_GFS_v15_thompson_mynn,FV3_GFS_v15_thompson_mynn_RRTMGP,FV3_GFS_v16_nsstNoahmpUGWPv1,FV3_GFS_v16_p7_rrtmgp -D32BIT=ON -DDEBUG=ON -DMPI=ON -DCMAKE_BUILD_TYPE=Debug
+Compile std elapsed time 359 seconds. -DAPP=ATM -DCCPP_SUITES=FV3_GFS_v16,FV3_GFS_v15_thompson_mynn,FV3_GFS_v15_thompson_mynn_RRTMGP,FV3_GFS_v16_nsstNoahmpUGWPv1,FV3_GFS_v16_p7_rrtmgp -D32BIT=ON -DMPI=ON -DCMAKE_BUILD_TYPE=Release
+
+baseline dir = /scratch1/NCEPDEV/stmp4/Minsuk.Ji/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p7_bit_base
+working dir  = /scratch1/NCEPDEV/stmp2/Minsuk.Ji/FV3_OPNREQ_TEST/opnReqTest_7628/control_p7_bit_base
+Checking test bit_base control_p7 results ....
+Moving baseline bit_base control_p7 files ....
+ Moving sfcf000.nc .........OK
+ Moving sfcf021.nc .........OK
+ Moving sfcf024.nc .........OK
+ Moving atmf000.nc .........OK
+ Moving atmf021.nc .........OK
+ Moving atmf024.nc .........OK
+ Moving GFSFLX.GrbF00 .........OK
+ Moving GFSFLX.GrbF21 .........OK
+ Moving GFSFLX.GrbF24 .........OK
+ Moving GFSPRS.GrbF00 .........OK
+ Moving GFSPRS.GrbF21 .........OK
+ Moving GFSPRS.GrbF24 .........OK
+ Moving RESTART/coupler.res .........OK
+ Moving RESTART/fv_core.res.nc .........OK
+ Moving RESTART/fv_core.res.tile1.nc .........OK
+ Moving RESTART/fv_core.res.tile2.nc .........OK
+ Moving RESTART/fv_core.res.tile3.nc .........OK
+ Moving RESTART/fv_core.res.tile4.nc .........OK
+ Moving RESTART/fv_core.res.tile5.nc .........OK
+ Moving RESTART/fv_core.res.tile6.nc .........OK
+ Moving RESTART/fv_srf_wnd.res.tile1.nc .........OK
+ Moving RESTART/fv_srf_wnd.res.tile2.nc .........OK
+ Moving RESTART/fv_srf_wnd.res.tile3.nc .........OK
+ Moving RESTART/fv_srf_wnd.res.tile4.nc .........OK
+ Moving RESTART/fv_srf_wnd.res.tile5.nc .........OK
+ Moving RESTART/fv_srf_wnd.res.tile6.nc .........OK
+ Moving RESTART/fv_tracer.res.tile1.nc .........OK
+ Moving RESTART/fv_tracer.res.tile2.nc .........OK
+ Moving RESTART/fv_tracer.res.tile3.nc .........OK
+ Moving RESTART/fv_tracer.res.tile4.nc .........OK
+ Moving RESTART/fv_tracer.res.tile5.nc .........OK
+ Moving RESTART/fv_tracer.res.tile6.nc .........OK
+ Moving RESTART/phy_data.tile1.nc .........OK
+ Moving RESTART/phy_data.tile2.nc .........OK
+ Moving RESTART/phy_data.tile3.nc .........OK
+ Moving RESTART/phy_data.tile4.nc .........OK
+ Moving RESTART/phy_data.tile5.nc .........OK
+ Moving RESTART/phy_data.tile6.nc .........OK
+ Moving RESTART/sfc_data.tile1.nc .........OK
+ Moving RESTART/sfc_data.tile2.nc .........OK
+ Moving RESTART/sfc_data.tile3.nc .........OK
+ Moving RESTART/sfc_data.tile4.nc .........OK
+ Moving RESTART/sfc_data.tile5.nc .........OK
+ Moving RESTART/sfc_data.tile6.nc .........OK
+
+  0: The total amount of wall time                        = 166.734732
+
+Test bit_base control_p7 PASS
+
+
+baseline dir = /scratch1/NCEPDEV/stmp4/Minsuk.Ji/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p7_dbg_base
+working dir  = /scratch1/NCEPDEV/stmp2/Minsuk.Ji/FV3_OPNREQ_TEST/opnReqTest_7628/control_p7_dbg_base
+Checking test dbg_base control_p7 results ....
+Moving baseline dbg_base control_p7 files ....
  Moving sfcf001.nc .........OK
  Moving sfcf001.nc .........OK
 
-  0: The total amount of wall time                        = 191.178595
+  0: The total amount of wall time                        = 169.859978
+
+Test dbg_base control_p7 PASS
+
+
+baseline dir = /scratch1/NCEPDEV/stmp4/Minsuk.Ji/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p7_std_base
+working dir  = /scratch1/NCEPDEV/stmp2/Minsuk.Ji/FV3_OPNREQ_TEST/opnReqTest_7628/control_p7_dcp
+Checking test dcp control_p7 results ....
+ Comparing sfcf000.nc .........OK
+ Comparing sfcf021.nc .........OK
+ Comparing sfcf024.nc .........OK
+ Comparing atmf000.nc .........OK
+ Comparing atmf021.nc .........OK
+ Comparing atmf024.nc .........OK
+ Comparing GFSFLX.GrbF00 .........OK
+ Comparing GFSFLX.GrbF21 .........OK
+ Comparing GFSFLX.GrbF24 .........OK
+ Comparing GFSPRS.GrbF00 .........OK
+ Comparing GFSPRS.GrbF21 .........OK
+ Comparing GFSPRS.GrbF24 .........OK
+ Comparing RESTART/coupler.res .........OK
+ Comparing RESTART/fv_core.res.nc .........OK
+ Comparing RESTART/fv_core.res.tile1.nc .........OK
+ Comparing RESTART/fv_core.res.tile2.nc .........OK
+ Comparing RESTART/fv_core.res.tile3.nc .........OK
+ Comparing RESTART/fv_core.res.tile4.nc .........OK
+ Comparing RESTART/fv_core.res.tile5.nc .........OK
+ Comparing RESTART/fv_core.res.tile6.nc .........OK
+ Comparing RESTART/fv_srf_wnd.res.tile1.nc .........OK
+ Comparing RESTART/fv_srf_wnd.res.tile2.nc .........OK
+ Comparing RESTART/fv_srf_wnd.res.tile3.nc .........OK
+ Comparing RESTART/fv_srf_wnd.res.tile4.nc .........OK
+ Comparing RESTART/fv_srf_wnd.res.tile5.nc .........OK
+ Comparing RESTART/fv_srf_wnd.res.tile6.nc .........OK
+ Comparing RESTART/fv_tracer.res.tile1.nc .........OK
+ Comparing RESTART/fv_tracer.res.tile2.nc .........OK
+ Comparing RESTART/fv_tracer.res.tile3.nc .........OK
+ Comparing RESTART/fv_tracer.res.tile4.nc .........OK
+ Comparing RESTART/fv_tracer.res.tile5.nc .........OK
+ Comparing RESTART/fv_tracer.res.tile6.nc .........OK
+ Comparing RESTART/phy_data.tile1.nc .........OK
+ Comparing RESTART/phy_data.tile2.nc .........OK
+ Comparing RESTART/phy_data.tile3.nc .........OK
+ Comparing RESTART/phy_data.tile4.nc .........OK
+ Comparing RESTART/phy_data.tile5.nc .........OK
+ Comparing RESTART/phy_data.tile6.nc .........OK
+ Comparing RESTART/sfc_data.tile1.nc .........OK
+ Comparing RESTART/sfc_data.tile2.nc .........OK
+ Comparing RESTART/sfc_data.tile3.nc .........OK
+ Comparing RESTART/sfc_data.tile4.nc .........OK
+ Comparing RESTART/sfc_data.tile5.nc .........OK
+ Comparing RESTART/sfc_data.tile6.nc .........OK
+
+  0: The total amount of wall time                        = 139.691275
 
-Test dbg_base control_p7_rrtmgp PASS
+Test dcp control_p7 PASS
 
 
-baseline dir = /scratch1/NCEPDEV/stmp4/Minsuk.Ji/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p7_rrtmgp_std_base
-working dir  = /scratch1/NCEPDEV/stmp2/Minsuk.Ji/FV3_OPNREQ_TEST/opnReqTest_29570/control_p7_rrtmgp_dcp
-Checking test dcp control_p7_rrtmgp results ....
+baseline dir = /scratch1/NCEPDEV/stmp4/Minsuk.Ji/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p7_std_base
+working dir  = /scratch1/NCEPDEV/stmp2/Minsuk.Ji/FV3_OPNREQ_TEST/opnReqTest_7628/control_p7_mpi
+Checking test mpi control_p7 results ....
  Comparing sfcf000.nc .........OK
  Comparing sfcf021.nc .........OK
  Comparing sfcf024.nc .........OK
@@ -59,14 +172,14 @@ Checking test dcp control_p7_rrtmgp results ....
  Comparing RESTART/sfc_data.tile5.nc .........OK
  Comparing RESTART/sfc_data.tile6.nc .........OK
 
-  0: The total amount of wall time                        = 179.776276
+ 0: The total amount of wall time                        = 217.334560
 
-Test dcp control_p7_rrtmgp PASS
+Test mpi control_p7 PASS
 
 
-baseline dir = /scratch1/NCEPDEV/stmp4/Minsuk.Ji/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p7_rrtmgp_std_base
-working dir  = /scratch1/NCEPDEV/stmp2/Minsuk.Ji/FV3_OPNREQ_TEST/opnReqTest_29570/control_p7_rrtmgp_rst
-Checking test rst control_p7_rrtmgp results ....
+baseline dir = /scratch1/NCEPDEV/stmp4/Minsuk.Ji/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p7_std_base
+working dir  = /scratch1/NCEPDEV/stmp2/Minsuk.Ji/FV3_OPNREQ_TEST/opnReqTest_7628/control_p7_rst
+Checking test rst control_p7 results ....
  Comparing atmf024.nc .........OK
  Comparing GFSFLX.GrbF24 .........OK
  Comparing GFSPRS.GrbF24 .........OK
@@ -104,15 +217,15 @@ Checking test rst control_p7_rrtmgp results ....
  Comparing RESTART/sfc_data.tile6.nc .........OK
  Comparing sfcf024.nc .........OK
 
-  0: The total amount of wall time                        = 91.132039
+  0: The total amount of wall time                        = 71.330045
 
-Test rst control_p7_rrtmgp PASS
+Test rst control_p7 PASS
 
 
-baseline dir = /scratch1/NCEPDEV/stmp4/Minsuk.Ji/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p7_rrtmgp_std_base
-working dir  = /scratch1/NCEPDEV/stmp2/Minsuk.Ji/FV3_OPNREQ_TEST/opnReqTest_29570/control_p7_rrtmgp_std_base
-Checking test std_base control_p7_rrtmgp results ....
-Moving baseline std_base control_p7_rrtmgp files ....
+baseline dir = /scratch1/NCEPDEV/stmp4/Minsuk.Ji/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p7_std_base
+working dir  = /scratch1/NCEPDEV/stmp2/Minsuk.Ji/FV3_OPNREQ_TEST/opnReqTest_7628/control_p7_std_base
+Checking test std_base control_p7 results ....
+Moving baseline std_base control_p7 files ....
  Moving sfcf000.nc .........OK
  Moving sfcf021.nc .........OK
  Moving sfcf024.nc .........OK
@@ -158,14 +271,14 @@ Moving baseline std_base control_p7_rrtmgp files ....
  Moving RESTART/sfc_data.tile5.nc .........OK
  Moving RESTART/sfc_data.tile6.nc .........OK
 
-  0: The total amount of wall time                        = 173.604623
+  0: The total amount of wall time                        = 134.169554
 
-Test std_base control_p7_rrtmgp PASS
+Test std_base control_p7 PASS
 
 
-baseline dir = /scratch1/NCEPDEV/stmp4/Minsuk.Ji/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p7_rrtmgp_std_base
-working dir  = /scratch1/NCEPDEV/stmp2/Minsuk.Ji/FV3_OPNREQ_TEST/opnReqTest_29570/control_p7_rrtmgp_thr
-Checking test thr control_p7_rrtmgp results ....
+baseline dir = /scratch1/NCEPDEV/stmp4/Minsuk.Ji/FV3_OPNREQ_TEST/OPNREQ_TEST/control_p7_std_base
+working dir  = /scratch1/NCEPDEV/stmp2/Minsuk.Ji/FV3_OPNREQ_TEST/opnReqTest_7628/control_p7_thr
+Checking test thr control_p7 results ....
  Comparing sfcf000.nc .........OK
  Comparing sfcf021.nc .........OK
  Comparing sfcf024.nc .........OK
@@ -211,10 +324,10 @@ Checking test thr control_p7_rrtmgp results ....
  Comparing RESTART/sfc_data.tile5.nc .........OK
  Comparing RESTART/sfc_data.tile6.nc .........OK
 
- 0: The total amount of wall time                        = 222.729754
+ 0: The total amount of wall time                        = 166.629701
 
-Test thr control_p7_rrtmgp PASS
+Test thr control_p7 PASS
 
 OPERATION REQUIREMENT TEST WAS SUCCESSFUL
-Mon Dec  6 21:04:39 UTC 2021
-Elapsed time: 00h:39m:10s. Have a nice day!
+Sat Dec 18 03:32:33 UTC 2021
+Elapsed time: 00h:19m:41s. Have a nice day!
diff --git a/tests/OpnReqTests_cpld_bmark_p7_hera.intel.log b/tests/OpnReqTests_cpld_bmark_p7_hera.intel.log
@@ -0,0 +1,161 @@
+Sat Dec 18 04:20:27 UTC 2021
+Start Operation Requirement Test
+
+Compile std elapsed time 431 seconds. -DAPP=S2SW -DCCPP_SUITES=FV3_GFS_v16_coupled_nsstNoahmpUGWPv1,FV3_GFS_v16_coupled_p7_rrtmgp -DMPI=ON -DCMAKE_BUILD_TYPE=Release -DMOM6SOLO=ON
+
+baseline dir = /scratch1/NCEPDEV/stmp4/Minsuk.Ji/FV3_OPNREQ_TEST/OPNREQ_TEST/cpld_bmark_p7_std_base
+working dir  = /scratch1/NCEPDEV/stmp2/Minsuk.Ji/FV3_OPNREQ_TEST/opnReqTest_17870/cpld_bmark_p7_dcp
+Checking test dcp cpld_bmark_p7 results ....
+ Comparing sfcf006.nc .........OK
+ Comparing atmf006.nc .........OK
+ Comparing 20130401.060000.out_grd.gwes_30m .........OK
+ Comparing 20130401.060000.out_pnt.points .........OK
+ Comparing RESTART/coupler.res .........OK
+ Comparing RESTART/fv_core.res.nc .........OK
+ Comparing RESTART/fv_core.res.tile1.nc .........OK
+ Comparing RESTART/fv_core.res.tile2.nc .........OK
+ Comparing RESTART/fv_core.res.tile3.nc .........OK
+ Comparing RESTART/fv_core.res.tile4.nc .........OK
+ Comparing RESTART/fv_core.res.tile5.nc .........OK
+ Comparing RESTART/fv_core.res.tile6.nc .........OK
+ Comparing RESTART/fv_srf_wnd.res.tile1.nc .........OK
+ Comparing RESTART/fv_srf_wnd.res.tile2.nc .........OK
+ Comparing RESTART/fv_srf_wnd.res.tile3.nc .........OK
+ Comparing RESTART/fv_srf_wnd.res.tile4.nc .........OK
+ Comparing RESTART/fv_srf_wnd.res.tile5.nc .........OK
+ Comparing RESTART/fv_srf_wnd.res.tile6.nc .........OK
+ Comparing RESTART/fv_tracer.res.tile1.nc .........OK
+ Comparing RESTART/fv_tracer.res.tile2.nc .........OK
+ Comparing RESTART/fv_tracer.res.tile3.nc .........OK
+ Comparing RESTART/fv_tracer.res.tile4.nc .........OK
+ Comparing RESTART/fv_tracer.res.tile5.nc .........OK
+ Comparing RESTART/fv_tracer.res.tile6.nc .........OK
+ Comparing RESTART/phy_data.tile1.nc .........OK
+ Comparing RESTART/phy_data.tile2.nc .........OK
+ Comparing RESTART/phy_data.tile3.nc .........OK
+ Comparing RESTART/phy_data.tile4.nc .........OK
+ Comparing RESTART/phy_data.tile5.nc .........OK
+ Comparing RESTART/phy_data.tile6.nc .........OK
+ Comparing RESTART/sfc_data.tile1.nc .........OK
+ Comparing RESTART/sfc_data.tile2.nc .........OK
+ Comparing RESTART/sfc_data.tile3.nc .........OK
+ Comparing RESTART/sfc_data.tile4.nc .........OK
+ Comparing RESTART/sfc_data.tile5.nc .........OK
+ Comparing RESTART/sfc_data.tile6.nc .........OK
+ Comparing RESTART/MOM.res.nc .........OK
+ Comparing RESTART/MOM.res_1.nc .........OK
+ Comparing RESTART/MOM.res_2.nc .........OK
+ Comparing RESTART/MOM.res_3.nc .........OK
+ Comparing RESTART/iced.2013-04-01-21600.nc .........OK
+ Comparing RESTART/ufs.cpld.cpl.r.2013-04-01-21600.nc .........OK
+
+  0: The total amount of wall time                        = 1095.633498
+
+Test dcp cpld_bmark_p7 PASS
+
+
+baseline dir = /scratch1/NCEPDEV/stmp4/Minsuk.Ji/FV3_OPNREQ_TEST/OPNREQ_TEST/cpld_bmark_p7_std_base
+working dir  = /scratch1/NCEPDEV/stmp2/Minsuk.Ji/FV3_OPNREQ_TEST/opnReqTest_17870/cpld_bmark_p7_std_base
+Checking test std_base cpld_bmark_p7 results ....
+Moving baseline std_base cpld_bmark_p7 files ....
+ Moving sfcf006.nc .........OK
+ Moving atmf006.nc .........OK
+ Moving 20130401.060000.out_grd.gwes_30m .........OK
+ Moving 20130401.060000.out_pnt.points .........OK
+ Moving RESTART/coupler.res .........OK
+ Moving RESTART/fv_core.res.nc .........OK
+ Moving RESTART/fv_core.res.tile1.nc .........OK
+ Moving RESTART/fv_core.res.tile2.nc .........OK
+ Moving RESTART/fv_core.res.tile3.nc .........OK
+ Moving RESTART/fv_core.res.tile4.nc .........OK
+ Moving RESTART/fv_core.res.tile5.nc .........OK
+ Moving RESTART/fv_core.res.tile6.nc .........OK
+ Moving RESTART/fv_srf_wnd.res.tile1.nc .........OK
+ Moving RESTART/fv_srf_wnd.res.tile2.nc .........OK
+ Moving RESTART/fv_srf_wnd.res.tile3.nc .........OK
+ Moving RESTART/fv_srf_wnd.res.tile4.nc .........OK
+ Moving RESTART/fv_srf_wnd.res.tile5.nc .........OK
+ Moving RESTART/fv_srf_wnd.res.tile6.nc .........OK
+ Moving RESTART/fv_tracer.res.tile1.nc .........OK
+ Moving RESTART/fv_tracer.res.tile2.nc .........OK
+ Moving RESTART/fv_tracer.res.tile3.nc .........OK
+ Moving RESTART/fv_tracer.res.tile4.nc .........OK
+ Moving RESTART/fv_tracer.res.tile5.nc .........OK
+ Moving RESTART/fv_tracer.res.tile6.nc .........OK
+ Moving RESTART/phy_data.tile1.nc .........OK
+ Moving RESTART/phy_data.tile2.nc .........OK
+ Moving RESTART/phy_data.tile3.nc .........OK
+ Moving RESTART/phy_data.tile4.nc .........OK
+ Moving RESTART/phy_data.tile5.nc .........OK
+ Moving RESTART/phy_data.tile6.nc .........OK
+ Moving RESTART/sfc_data.tile1.nc .........OK
+ Moving RESTART/sfc_data.tile2.nc .........OK
+ Moving RESTART/sfc_data.tile3.nc .........OK
+ Moving RESTART/sfc_data.tile4.nc .........OK
+ Moving RESTART/sfc_data.tile5.nc .........OK
+ Moving RESTART/sfc_data.tile6.nc .........OK
+ Moving RESTART/MOM.res.nc .........OK
+ Moving RESTART/MOM.res_1.nc .........OK
+ Moving RESTART/MOM.res_2.nc .........OK
+ Moving RESTART/MOM.res_3.nc .........OK
+ Moving RESTART/iced.2013-04-01-21600.nc .........OK
+ Moving RESTART/ufs.cpld.cpl.r.2013-04-01-21600.nc .........OK
+
+  0: The total amount of wall time                        = 1093.658291
+
+Test std_base cpld_bmark_p7 PASS
+
+
+baseline dir = /scratch1/NCEPDEV/stmp4/Minsuk.Ji/FV3_OPNREQ_TEST/OPNREQ_TEST/cpld_bmark_p7_std_base
+working dir  = /scratch1/NCEPDEV/stmp2/Minsuk.Ji/FV3_OPNREQ_TEST/opnReqTest_17870/cpld_bmark_p7_thr
+Checking test thr cpld_bmark_p7 results ....
+ Comparing sfcf006.nc .........OK
+ Comparing atmf006.nc .........OK
+ Comparing 20130401.060000.out_grd.gwes_30m .........OK
+ Comparing 20130401.060000.out_pnt.points .........OK
+ Comparing RESTART/coupler.res .........OK
+ Comparing RESTART/fv_core.res.nc .........OK
+ Comparing RESTART/fv_core.res.tile1.nc .........OK
+ Comparing RESTART/fv_core.res.tile2.nc .........OK
+ Comparing RESTART/fv_core.res.tile3.nc .........OK
+ Comparing RESTART/fv_core.res.tile4.nc .........OK
+ Comparing RESTART/fv_core.res.tile5.nc .........OK
+ Comparing RESTART/fv_core.res.tile6.nc .........OK
+ Comparing RESTART/fv_srf_wnd.res.tile1.nc .........OK
+ Comparing RESTART/fv_srf_wnd.res.tile2.nc .........OK
+ Comparing RESTART/fv_srf_wnd.res.tile3.nc .........OK
+ Comparing RESTART/fv_srf_wnd.res.tile4.nc .........OK
+ Comparing RESTART/fv_srf_wnd.res.tile5.nc .........OK
+ Comparing RESTART/fv_srf_wnd.res.tile6.nc .........OK
+ Comparing RESTART/fv_tracer.res.tile1.nc .........OK
+ Comparing RESTART/fv_tracer.res.tile2.nc .........OK
+ Comparing RESTART/fv_tracer.res.tile3.nc .........OK
+ Comparing RESTART/fv_tracer.res.tile4.nc .........OK
+ Comparing RESTART/fv_tracer.res.tile5.nc .........OK
+ Comparing RESTART/fv_tracer.res.tile6.nc .........OK
+ Comparing RESTART/phy_data.tile1.nc .........OK
+ Comparing RESTART/phy_data.tile2.nc .........OK
+ Comparing RESTART/phy_data.tile3.nc .........OK
+ Comparing RESTART/phy_data.tile4.nc .........OK
+ Comparing RESTART/phy_data.tile5.nc .........OK
+ Comparing RESTART/phy_data.tile6.nc .........OK
+ Comparing RESTART/sfc_data.tile1.nc .........OK
+ Comparing RESTART/sfc_data.tile2.nc .........OK
+ Comparing RESTART/sfc_data.tile3.nc .........OK
+ Comparing RESTART/sfc_data.tile4.nc .........OK
+ Comparing RESTART/sfc_data.tile5.nc .........OK
+ Comparing RESTART/sfc_data.tile6.nc .........OK
+ Comparing RESTART/MOM.res.nc .........OK
+ Comparing RESTART/MOM.res_1.nc .........OK
+ Comparing RESTART/MOM.res_2.nc .........OK
+ Comparing RESTART/MOM.res_3.nc .........OK
+ Comparing RESTART/iced.2013-04-01-21600.nc .........OK
+ Comparing RESTART/ufs.cpld.cpl.r.2013-04-01-21600.nc .........OK
+
+  0: The total amount of wall time                        = 871.113511
+
+Test thr cpld_bmark_p7 PASS
+
+OPERATION REQUIREMENT TEST WAS SUCCESSFUL
+Sat Dec 18 05:16:36 UTC 2021
+Elapsed time: 00h:56m:09s. Have a nice day!