Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

First tag with PE layouts and testing for Derecho #2269

Merged
merged 71 commits into from
Dec 8, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
71 commits
Select commit Hold shift + click to select a range
1d432db
turn excess ice and meier roughness on by default, add LND_TUNING_MOD…
ekluzek Oct 17, 2023
34368e0
Update externals to cesm2_3_beta16
ekluzek Oct 19, 2023
5352462
Add finidat for ne30np4.pg3 from @olyson /glade/p/cgd/tss/people/oles…
ekluzek Oct 19, 2023
448fdda
Add testmod for clm51 cam6.0 lnd tuning mode
ekluzek Oct 19, 2023
d37408a
Add a PE layout for ne30 for derecho with the same number of nodes as…
ekluzek Oct 19, 2023
1126100
Add some tests on derecho for a new cesm3_dev testlist of two debug r…
ekluzek Oct 19, 2023
e5e1a72
Add derecho in
ekluzek Oct 19, 2023
e8e1f7e
Change cesm3_dev testlist to derecho
ekluzek Oct 19, 2023
2b01f9e
Fix resolution for cesm3_dev tests
ekluzek Oct 19, 2023
fbce574
Remove the inception=login option
ekluzek Oct 19, 2023
fb49cf0
Correct testmod
ekluzek Oct 19, 2023
16bcd3a
Add a f09 PE layout the same as the ne30 one so can also try it out
ekluzek Oct 19, 2023
1e09d6f
1850 lnd_tuning_mode=clm51_cam6.0 finidat file for all resolutions, u…
ekluzek Oct 20, 2023
e40ca1c
Add PE layout for ne30 on Cheyenne
ekluzek Oct 20, 2023
01abaee
Add more tests to deal with issue #2219, add a test that turns excess…
ekluzek Oct 21, 2023
071cf72
Add an LII test using the spunup 1850 ne30pg3_g17 file
ekluzek Nov 5, 2023
ab597dd
Adjust tests with tests expected to pass
ekluzek Nov 7, 2023
16ba201
Fix some of the filepaths
ekluzek Nov 9, 2023
12cf71b
Add issue number to expected fails
ekluzek Nov 9, 2023
c48a334
Update baseline directory for Derecho
ekluzek Nov 9, 2023
79f64df
Change queue and wallclock limit for Derecho
ekluzek Nov 10, 2023
0e8caee
Add 2000 and HIST tests for ne30np4.pg3 to cesm3_dev testlist, remove…
ekluzek Nov 10, 2023
0fa6ebc
Get finidat file working for 2000 ne30np4.pg3 clm5_1_cam6.0 working
ekluzek Nov 10, 2023
cae3667
Update ne30np4.pg3 1850 finidat file so LII tests work, and add in ne…
ekluzek Nov 10, 2023
910514d
Actually turn Meier off
ekluzek Nov 10, 2023
82800f0
Correct some namelist settings
ekluzek Nov 28, 2023
432a04b
Merge tag 'ctsm5.1.dev155' into derecho1
ekluzek Nov 28, 2023
8f3327c
The ne30pg3 finidat file needs to do interpolation to get started sin…
ekluzek Nov 28, 2023
3036183
Remove the ne30pg3 LII tests because they will fail as use_init_inter…
ekluzek Nov 28, 2023
ebb3e64
Add use_init_interp to the ne30pg3 finidat file, because it's needed …
ekluzek Nov 28, 2023
98cb379
Set init_interp_fill_missing_with_natveg for the ne30np4.pg3 grid
ekluzek Nov 28, 2023
508fc80
Remove tests that are passing and add new fail
ekluzek Nov 28, 2023
9f457db
Add a couple cesm3_dev tests to aux_clm
ekluzek Nov 28, 2023
3a3a97e
PE layouts for f45 and f10 for Derecho
ekluzek Nov 28, 2023
651ff5c
Lengthen test time
ekluzek Nov 29, 2023
a8c535a
Remove the nvhpc tests that are now passing
ekluzek Nov 29, 2023
f85fea8
First pass at adding derecho tests, also change the syntax for ones w…
ekluzek Nov 30, 2023
5c8f17b
Work on f09 f19 and nldas pe-layouts for Derecho
ekluzek Nov 30, 2023
f65c99c
Update externals for ccs_config which is needed for mpi-serial tests
ekluzek Dec 1, 2023
4ce2a9d
The same intel tests are failing on Derecho as were on Cheyenne
ekluzek Dec 1, 2023
14d666e
Fix pe-layouts for Derecho, remove new nvhpc tests on Derecho that we…
ekluzek Dec 1, 2023
ea31fb5
Merge tag 'ctsm5.1.dev156' into derecho1
ekluzek Dec 1, 2023
84bab54
Correct expected fail
ekluzek Dec 1, 2023
15c9527
Add two expected fails because of a build issue presumably in ccs_config
ekluzek Dec 1, 2023
11e706c
Add more mpi-serial intel debug failed tests
ekluzek Dec 1, 2023
24c088c
Remove two nvhpc tests that fail, one from Cheyenne that wasn't there…
ekluzek Dec 1, 2023
6c5c24d
Add NEON tests to Derecho
ekluzek Dec 1, 2023
7ccd479
Change some of the comments about Cheyenne to also include Derecho
ekluzek Dec 1, 2023
1a2f5e8
Move the Derecho intel/DEBUG tests to gnu keeping only one that's exp…
ekluzek Dec 3, 2023
a6e3db8
Add FUNITCTSM to the list of expected fails
ekluzek Dec 3, 2023
ad5c076
Remove references to Cheyenne and make it more explicit what to do on…
ekluzek Dec 4, 2023
9c4d186
Update /glade/p references
ekluzek Dec 4, 2023
fe97097
Update /glade/p path references
ekluzek Dec 4, 2023
12057ea
Update /glade/p paths
ekluzek Dec 4, 2023
8b249d5
First stab at getting the test/tools framework to work on Derecho, is…
ekluzek Dec 4, 2023
8085fa3
Update paths to use /glade/campaign/cesm/cesmdata/cseg/inputdata reso…
ekluzek Dec 4, 2023
02a71b8
Merge tag 'ctsm5.1.dev157' into derecho1
ekluzek Dec 5, 2023
7efee20
Update cdeps version to fix #2280 so NAG compiler can run
ekluzek Dec 6, 2023
6fccf68
Run through black
ekluzek Dec 6, 2023
90541f6
ignore black format
ekluzek Dec 6, 2023
d7cd648
Remove new ne30np4.pg3 finidat file from CTSM5.2 as incompatible with…
ekluzek Dec 6, 2023
af8ae7f
Restore perl CLMBuildNamelist back to ctsm5.1.dev157 version, the ne3…
ekluzek Dec 6, 2023
d610ac9
Point to the file location under /glade/campaign/cisl/dares/glade-p-d…
ekluzek Dec 6, 2023
2a15f58
Update paths in comments from /glade/p to new location where @olyson …
ekluzek Dec 7, 2023
fd20d7e
Change path in comments to where @olyson now has this data
ekluzek Dec 7, 2023
79af406
Remove comment that included a /glade/p source file
ekluzek Dec 7, 2023
5eb701a
Fix testname
ekluzek Dec 7, 2023
7be2976
Correct the finidat file settings for clm5_1_cam6 to point to the clm…
ekluzek Dec 7, 2023
77b2d7e
Correct finidat file for clm5_1 GSWP3
ekluzek Dec 8, 2023
aaf740c
Update Change files
ekluzek Dec 8, 2023
10d0538
Update changelog
ekluzek Dec 8, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .git-blame-ignore-revs
Original file line number Diff line number Diff line change
Expand Up @@ -23,3 +23,4 @@ e4d38681df23ccca0ae29581a45f8362574e0630
0bc3f00115d86d026a977918661c93779b3b19f9
540b256d1f3382f4619d7b0877c32d54ce5c40b6
8a168bb0895f4f2421608dd2589398e13a6663e6
6fccf682eaf718615407d9bacdd3903b8786a03d
2 changes: 1 addition & 1 deletion Externals.cfg
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,7 @@ local_path = components/cmeps
required = True

[cdeps]
tag = cdeps1.0.23
tag = cdeps1.0.24
protocol = git
repo_url = https://github.com/ESCOMP/CDEPS.git
local_path = components/cdeps
Expand Down
2 changes: 1 addition & 1 deletion bld/namelist_files/createMapEntry.pl
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@
my $scriptName;
($scriptName = $0) =~ s!(.*)/!!; # get name of script
my $cwd = getcwd();
my $CSMDATA = "/glade/p/cesm/cseg/inputdata";
my $CSMDATA = "/glade/campaign/cesm/cesmdata/cseg/inputdata";

if ($#ARGV != 0 ) {
usage();
Expand Down
38 changes: 33 additions & 5 deletions bld/namelist_files/namelist_defaults_ctsm.xml
Original file line number Diff line number Diff line change
Expand Up @@ -677,6 +677,7 @@ attributes from the config_cache.xml file (with keys converted to upper-case).
set up. If more finidat files are added you may need to add more of these.
Or one specific file will be chosen over another.
-->

<init_interp_attributes sim_year="1850" use_cndv=".false." use_fates=".false." lnd_tuning_mode="clm4_5_GSWP3v1"
>hgrid=0.9x1.25 maxpft=17 mask=gx1v7 use_cn=.true. use_crop=.false. irrigate=.true. glc_nec=10 do_transient_pfts=.false.
</init_interp_attributes>
Expand Down Expand Up @@ -721,6 +722,11 @@ attributes from the config_cache.xml file (with keys converted to upper-case).
>hgrid=0.9x1.25 maxpft=79 mask=gx1v7 use_cn=.true. use_crop=.true. irrigate=.false. glc_nec=10 do_transient_pfts=.false.
</init_interp_attributes>

<!-- 1850 spinup for CESM3 development for CLM5.1-->
<init_interp_attributes sim_year="1850" use_cndv=".false." use_fates=".false." lnd_tuning_mode="clm5_1_cam6.0"
>hgrid=0.9x1.25 maxpft=79 mask=gx1v7 use_cn=.true. use_crop=.true. irrigate=.false. glc_nec=10 do_transient_pfts=.false.
</init_interp_attributes>

<!-- present day -->
<init_interp_attributes sim_year="2000" use_cndv=".false." use_fates=".false." lnd_tuning_mode="clm4_5_GSWP3v1"
>hgrid=1.9x2.5 maxpft=79 mask=gx1v7 use_cn=.true. use_crop=.true. irrigate=.true. glc_nec=10 do_transient_pfts=.false.
Expand Down Expand Up @@ -819,6 +825,12 @@ attributes from the config_cache.xml file (with keys converted to upper-case).
>hgrid=0.9x1.25 maxpft=79 mask=gx1v7 use_cn=.true. use_crop=.true. irrigate=.true. glc_nec=10 do_transient_pfts=.false.
</init_interp_attributes>

<!-- clm5_1 physics -->
<init_interp_attributes sim_year="2000" use_cndv=".false." use_fates=".false." lnd_tuning_mode="clm5_1_cam6.0"
hgrid="ne30np4.pg3"
>hgrid=0.9x1.25 maxpft=79 mask=gx1v7 use_cn=.true. use_crop=.true. irrigate=.true. glc_nec=10 do_transient_pfts=.false.
</init_interp_attributes>

<!-- MPAS -->
<init_interp_attributes sim_year="2000" use_cndv=".false." use_fates=".false." lnd_tuning_mode="clm5_0_cam6.0"
hgrid="mpasa480"
Expand Down Expand Up @@ -877,7 +889,7 @@ attributes from the config_cache.xml file (with keys converted to upper-case).
hgrid="ne0np4.ARCTICGRIS.ne30x8" use_cn=".false." maxpft="17"
>hgrid=ne0np4.ARCTICGRIS.ne30x8 maxpft=17 mask=tx0.1v2 use_cn=.false. use_crop=.false. irrigate=.true. glc_nec=10 do_transient_pfts=.false.
</init_interp_attributes>
p

<!-- 2003 -->
<init_interp_attributes sim_year="2003" use_cndv=".false." use_fates=".false." lnd_tuning_mode="clm5_0_cam6.0"
hgrid="1.9x2.5" use_cn=".false." maxpft="17"
Expand All @@ -890,7 +902,6 @@ p
>hgrid=ne0np4CONUS.ne30x8 maxpft=17 mask=tx0.1v2 use_cn=.false. use_crop=.false. irrigate=.true. glc_nec=10 do_transient_pfts=.false.
</init_interp_attributes>


<!--
1850 preindustrial IC (if use_init_interp is added and set to .true. then MUST still interpolate even on an exact match)
(if it will work on an exact match, leave use_init_interp off)
Expand Down Expand Up @@ -970,6 +981,14 @@ p
>lnd/clm2/initdata_map/clmi.I1850Clm50BgcCrop-ciso.1366-01-01.0.9x1.25_gx1v7_simyr1850_c200428.nc
</finidat>

<!-- Use f09 clm5_0 cam6 spinup file for clm5_1 cam6-->
<finidat hgrid="0.9x1.25" maxpft="79" mask="gx1v7" use_cn=".true." use_cndv=".false." use_fates=".false."
ic_ymd="18500101" sim_year="1850" do_transient_pfts=".false."
ic_tod="0" glc_nec="10" use_crop=".true." irrigate=".false."
lnd_tuning_mode="clm5_1_cam6.0"
>lnd/clm2/initdata_map/clmi.B1850Clm50BgcCrop.0161-01-01.0.9x1.25_gx1v7_simyr1850_c200729.nc
</finidat>

<!--
Present day IC (if use_init_interp is set and .true. then MUST still interpolate even on an exact match)
(if it will work on an exact match, leave use_init_interp off)
Expand Down Expand Up @@ -1068,6 +1087,13 @@ p
>lnd/clm2/initdata_map/clmi.BHIST.2000-01-01.0.9x1.25_gx1v7_simyr2000_c200728.nc
</finidat>

<finidat hgrid="0.9x1.25" maxpft="79" mask="gx1v7" use_cn=".true." use_cndv=".false." use_fates=".false."
ic_ymd="20000101" sim_year="2000" do_transient_pfts=".false."
ic_tod="0" glc_nec="10" use_crop=".true." irrigate=".true."
lnd_tuning_mode="clm5_1_cam6.0" use_init_interp=".true."
>lnd/clm2/initdata_map/clmi.BHIST.2000-01-01.0.9x1.25_gx1v7_simyr2000_c200728.nc
</finidat>

<!-- 2003 -->
<finidat hgrid="1.9x2.5" maxpft="17" mask="gx1v7" use_cn=".false." use_cndv=".false." use_fates=".false."
ic_ymd="20030101" sim_year="2003" do_transient_pfts=".false."
Expand Down Expand Up @@ -1323,10 +1349,12 @@ lnd/clm2/surfdata_map/NEON/surfdata_1x1_NEON_TOOL_hist_78pfts_CMIP6_simyr2000_c2
use_crop=".false." >lnd/clm2/surfdata_map/release-clm5.0.18/landuse.timeseries_48x96_hist_16pfts_Irrig_CMIP6_simyr1850-2015_c190214.nc</flanduse_timeseries>


<flanduse_timeseries hgrid="ne30np4" sim_year_range="1850-2000" irrigate=".true."
use_crop=".false." >lnd/clm2/surfdata_map/landuse.timeseries_ne30np4_hist_16pfts_Irrig_CMIP6_simyr1850-2015_c170824.nc</flanduse_timeseries>
<flanduse_timeseries hgrid="ne30np4" sim_year_range="1850-2000"
>lnd/clm2/surfdata_map/release-clm5.0.30/landuse.timeseries_ne30np4_SSP5-8.5_78pfts_CMIP6_simyr1850-2100_c200426.nc</flanduse_timeseries>
<flanduse_timeseries hgrid="ne30np4.pg3" sim_year_range="1850-2000"
>lnd/clm2/surfdata_map/release-clm5.0.30/landuse.timeseries_ne30np4.pg3_SSP5-8.5_78pfts_CMIP6_simyr1850-2100_c200426.nc</flanduse_timeseries>
<flanduse_timeseries hgrid="ne0np4.ARCTIC.ne30x4" sim_year_range="1850-2000"
>lnd/clm2/surfdata_map/landuse.timeseries_ne0np4.ARCTIC.ne30x4_hist_78pfts_CMIP6_simyr1850-2015_c191023.nc</flanduse_timeseries>
>lnd/clm2/surfdata_map/release-clm5.0.30/landuse.timeseries_ne0np4.ARCTIC.ne30x4_SSP5-8.5_78pfts_CMIP6_simyr1850-2100_c200426.nc</flanduse_timeseries>

<!-- Dynamic PFT surface datasets for crop -->

Expand Down
2 changes: 1 addition & 1 deletion bld/namelist_files/namelist_definition_ctsm.xml
Original file line number Diff line number Diff line change
Expand Up @@ -2156,7 +2156,7 @@ Land mask description

<entry id="lnd_tuning_mode" type="char*20" category="default_settings"
group="default_settings"
valid_values="clm4_5_CRUv7,clm4_5_GSWP3v1,clm4_5_cam6.0,clm5_0_cam6.0,clm5_0_CRUv7,clm5_0_GSWP3v1,clm5_1_GSWP3v1">
valid_values="clm4_5_CRUv7,clm4_5_GSWP3v1,clm4_5_cam6.0,clm5_0_cam6.0,clm5_0_CRUv7,clm5_0_GSWP3v1,clm5_1_GSWP3v1,clm5_1_cam6.0">
General configuration of model version and atmospheric forcing to tune the model to run under.
This sets the model to run with constants and initial conditions that were set to run well under
the configuration of model version and atmospheric forcing. To run well constants would need to be changed
Expand Down
2 changes: 1 addition & 1 deletion bld/unit_testers/build-namelist_test.pl
Original file line number Diff line number Diff line change
Expand Up @@ -139,7 +139,7 @@ sub cat_and_create_namelistinfile {
$inputdata_rootdir = $ENV{'CSMDATA'};
} else {
# use yellowstone location as default
$inputdata_rootdir="/glade/p/cesm/cseg/inputdata";
$inputdata_rootdir="/glade/campaign/cesm/cesmdata/cseg/inputdata";
print("WARNING: -csmdata nor CSMDATA are set, using default yellowstone location: $inputdata_rootdir\n");
}

Expand Down
13 changes: 0 additions & 13 deletions bld/unit_testers/xFail/expectedClmTestFails.xml
Original file line number Diff line number Diff line change
Expand Up @@ -34,19 +34,6 @@
</goldbach>
</tools_test_driver>

<PTCLM>
<yellowstone>
<INTEL>
<entry testId="no_towerdata.-d+/glade/p/cesmdata/cseg/inputdata++-s+RF-Bra+--debug+--pftgrid+--soilgrid."
failType="FAIL">Doesn't check for valid values</entry>
</INTEL>
</yellowstone>
<goldbach>
<PGI>
</PGI>
</goldbach>
</PTCLM>

<unit_tests>
<yellowstone>
<INTEL>
Expand Down
3 changes: 2 additions & 1 deletion cime_config/config_component.xml
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@
<desc>Tuning parameters and initial conditions should be optimized for what CLM model version and what meteorlogical forcing combination?
</desc>
<default_value>UNSET</default_value>
<valid_values>clm5_0_cam6.0,clm5_0_GSWP3v1,clm5_0_CRUv7,clm4_5_CRUv7,clm4_5_GSWP3v1,clm4_5_cam6.0,clm5_1_GSWP3v1</valid_values>
<valid_values>clm5_0_cam6.0,clm5_0_GSWP3v1,clm5_0_CRUv7,clm4_5_CRUv7,clm4_5_GSWP3v1,clm4_5_cam6.0,clm5_1_GSWP3v1,clm5_1_cam6.0</valid_values>
<values>
<value compset= "CLM45" >clm4_5_CRUv7</value>
<value compset="DATM%CRUv7.+_CLM45" >clm4_5_CRUv7</value>
Expand All @@ -76,6 +76,7 @@
<value compset="CAM.+_CLM50" >clm5_0_cam6.0</value>
<value compset="DATM%CPLHIST.*_CLM50" >clm5_0_cam6.0</value>
<value compset= "_CLM51" >clm5_1_GSWP3v1</value>
<value compset="CAM.+_CLM51" >clm5_1_cam6.0</value>
</values>
</entry>

Expand Down
Loading
Loading