Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
47 commits
Select commit Hold shift + click to select a range
b98fb11
Update submodules to cesm3_0_alpha06c, just before the answer change …
ekluzek May 4, 2025
da1ad8a
Revert "Merge pull request #3067 from jedwards4b/st_arvchive_fix"
ekluzek May 1, 2025
9bba4e7
Update to ccs_config to beyond the 1.0.24 tag that changes answers on…
ekluzek May 5, 2025
c7a8f38
Update ccs_config to a branch that has a working build for derecho_gn…
ekluzek May 5, 2025
5122034
Get a working version of ccs_config for DEBUG derecho_gnu mpi-serial
ekluzek May 7, 2025
03cf139
Update ccs_config with a working cray-libsci library which I show wor…
ekluzek May 9, 2025
04409d7
Update submodules to cesm3_0_beta06 versions, still using the ccs_con…
ekluzek May 10, 2025
14245e2
Update to cesm3_0_alpha06e externals
ekluzek May 10, 2025
d7f67cc
Update to cesm3_0_alpha06f submodules
ekluzek May 11, 2025
0bb1c13
Move cmeps and ceps back to the cesm3_0_alpha06e version, this failed…
ekluzek May 11, 2025
93d0a2d
Backup cime and ccs_config
ekluzek May 11, 2025
2d5a10f
Advance ccs_config to 1.0.40
ekluzek May 11, 2025
f72d6ab
Update to cesm3_0_beta06 submodules again
ekluzek May 12, 2025
c703028
Remove the SMS_D_Ld5.f09_g17.ISSP126Clm50BgcCrop.derecho_intelclm-dat…
ekluzek May 14, 2025
b5e6c62
Update cime hash with the fix for the FUNIT and MKSURF tests
ekluzek May 14, 2025
d1baa64
Update ccs_config and cime to latest versions so testing will be vali…
ekluzek May 17, 2025
16c2810
Update ccs_config to the tag
ekluzek May 20, 2025
dd7ac24
Update cime with the latest from the branch that I think is the final…
ekluzek May 22, 2025
343046d
Merge branch 'update_to_alpha06f' into update_submodules_to_cesm30_be…
ekluzek May 22, 2025
82c08cf
Merge tag 'ctsm5.3.044' into update_submodules_to_cesm30_beta06
ekluzek May 22, 2025
27201f7
Update megan namelist fixing #2710
ekluzek Apr 28, 2025
69854a7
Update the MEGAN namelist fixing #2710
ekluzek Apr 28, 2025
e08cd49
Update drydep namelist fixing #3095
ekluzek May 1, 2025
ac83e0a
Allow for newlines in megan_specifier on input, but remove them so th…
ekluzek Apr 28, 2025
bf9455a
Create remove_newlines function and use it for both megan_specifier a…
ekluzek May 2, 2025
3529f04
Correct number of tests
ekluzek May 22, 2025
8926ed6
Update cime to an actual tag
ekluzek May 22, 2025
205d1a7
Add FTorch as an optional library, fixing #3135
ekluzek May 23, 2025
e36fdef
Merge tag 'ctsm5.3.045' into update_submodules_to_cesm30_beta06
ekluzek May 23, 2025
8517de6
Merge tag 'ctsm5.3.048' into update_submodules_to_cesm30_beta06
ekluzek May 27, 2025
617ee53
Merge tag 'ctsm5.3.049' into update_submodules_to_cesm30_beta06
ekluzek May 27, 2025
0181dee
Add SSPMATRIX to prealpha for Clm60, add LILACSMOKE to prealpha, and …
ekluzek May 27, 2025
0a519ba
Testing tweaks
ekluzek May 27, 2025
587042c
More tweaks to testing
ekluzek May 27, 2025
49d4693
Add a derecho_gnu mpi-serial test without DEBUG to help address #3108
ekluzek May 27, 2025
54e640b
Add a derecho_intel mpi-serial DEBUG test to aux_cime_baselines to he…
ekluzek May 27, 2025
851c481
Add three ctsm_sci SSP tests to expected fails, because they need #26…
ekluzek May 28, 2025
b9852ba
Fix phase
ekluzek May 28, 2025
3cbac00
Remove FATES_ERROR_EL to fix #2850
ekluzek May 28, 2025
629f285
Add note about nvhpc DEBUG test failing at SETUP
ekluzek May 28, 2025
f439a9a
Ask for more memory for FATES
ekluzek May 28, 2025
bc3d04f
Mark as expected fail
ekluzek May 28, 2025
8bb5a9a
Needs an ending return
ekluzek May 29, 2025
87396a7
Start change files
ekluzek May 29, 2025
f29eca0
update date
ekluzek May 29, 2025
9da7666
Merge tag 'ctsm5.3.050' into update_submodules_to_cesm30_beta06
ekluzek May 29, 2025
5b17d90
Update dates
ekluzek May 30, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
24 changes: 17 additions & 7 deletions .gitmodules
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ fxDONOTUSEurl = https://github.com/NGEET/fates
[submodule "cism"]
path = components/cism
url = https://github.com/ESCOMP/CISM-wrapper
fxtag = cismwrap_2_2_005
fxtag = cismwrap_2_2_006
fxrequired = ToplevelRequired
# Standard Fork to compare to with "git fleximod test" to ensure personal forks aren't committed
fxDONOTUSEurl = https://github.com/ESCOMP/CISM-wrapper
Expand Down Expand Up @@ -68,31 +68,31 @@ fxDONOTUSEurl = https://github.com/ESCOMP/mizuRoute
[submodule "ccs_config"]
path = ccs_config
url = https://github.com/ESMCI/ccs_config_cesm.git
fxtag = ccs_config_cesm1.0.23
fxtag = ccs_config_cesm1.0.43
fxrequired = ToplevelRequired
# Standard Fork to compare to with "git fleximod test" to ensure personal forks aren't committed
fxDONOTUSEurl = https://github.com/ESMCI/ccs_config_cesm.git

[submodule "cime"]
path = cime
url = https://github.com/ESMCI/cime
fxtag = cime6.1.72
fxtag = cime6.1.102
fxrequired = ToplevelRequired
# Standard Fork to compare to with "git fleximod test" to ensure personal forks aren't committed
fxDONOTUSEurl = https://github.com/ESMCI/cime

[submodule "cmeps"]
path = components/cmeps
url = https://github.com/ESCOMP/CMEPS.git
fxtag = cmeps1.0.39
fxtag = cmeps1.0.47
fxrequired = ToplevelRequired
# Standard Fork to compare to with "git fleximod test" to ensure personal forks aren't committed
fxDONOTUSEurl = https://github.com/ESCOMP/CMEPS.git

[submodule "cdeps"]
path = components/cdeps
url = https://github.com/ESCOMP/CDEPS.git
fxtag = cdeps1.0.70
fxtag = cdeps1.0.73
fxrequired = ToplevelRequired
# Standard Fork to compare to with "git fleximod test" to ensure personal forks aren't committed
fxDONOTUSEurl = https://github.com/ESCOMP/CDEPS.git
Expand All @@ -108,15 +108,15 @@ fxDONOTUSEurl = https://github.com/ESCOMP/CESM_share
[submodule "parallelio"]
path = libraries/parallelio
url = https://github.com/NCAR/ParallelIO
fxtag = pio2_6_3
fxtag = pio2_6_4
fxrequired = ToplevelRequired
# Standard Fork to compare to with "git fleximod test" to ensure personal forks aren't committed
fxDONOTUSEurl = https://github.com/NCAR/ParallelIO

[submodule "mpi-serial"]
path = libraries/mpi-serial
url = https://github.com/ESMCI/mpi-serial
fxtag = MPIserial_2.5.1
fxtag = MPIserial_2.5.4
fxrequired = ToplevelRequired
# Standard Fork to compare to with "git fleximod test" to ensure personal forks aren't committed
fxDONOTUSEurl = https://github.com/ESMCI/mpi-serial
Expand All @@ -128,3 +128,13 @@ fxtag = v2.2.6
fxrequired = ToplevelOptional
# Standard Fork to compare to with "git fleximod test" to ensure personal forks aren't committed
fxDONOTUSEurl = https://github.com/ESMCI/doc-builder

# FTorch is an optional library useful for AI and Machine Learning
# In order to use it -- it must be checked out with git-fleximod
[submodule "FTorch"]
path = libraries/FTorch
url = https://github.com/ESCOMP/FTorch_interface
fxtag = v0.0.5
fxrequired = ToplevelOptional
# Standard Fork to compare to with "git fleximod test" to ensure personal forks aren't committed
fxDONOTUSEurl = https://github.com/ESCOMP/FTorch_interface
18 changes: 17 additions & 1 deletion bld/CLMBuildNamelist.pm
Original file line number Diff line number Diff line change
Expand Up @@ -4043,6 +4043,7 @@ sub setup_logic_dry_deposition {
if ($opts->{'drydep'} ) {
add_default($opts, $nl_flags->{'inputdata_rootdir'}, $definition, $defaults, $nl, 'drydep_list');
add_default($opts, $nl_flags->{'inputdata_rootdir'}, $definition, $defaults, $nl, 'dep_data_file');
&remove_newlines( $nl, $definition, "drydep_list" );
}
if ( &value_is_true( $nl_flags->{'use_fates'}) ) {
foreach my $var ( @list ) {
Expand Down Expand Up @@ -4174,6 +4175,7 @@ sub setup_logic_megan {
$log->fatal_error("MEGAN can NOT be on when FATES is also on.\n" .
" Use the '-no-megan' option when '-bgc fates' is activated");
}
&remove_newlines( $nl, $definition, "megan_specifier" );
}
}

Expand Down Expand Up @@ -5743,7 +5745,21 @@ sub quote_string {
$str = "\'$str\'";
}
return $str;
}
}

#-------------------------------------------------------------------------------

sub remove_newlines {
Comment thread
ekluzek marked this conversation as resolved.
# Check for and remove line returns in the string, so that it will validate later
my ($nl, $definition, $var) = @_;

my $value = $nl->get_value($var);
if ( $value =~ /\n/) {
$value =~ s/\n//g;
my $group = $definition->get_group_name($var);
$nl->set_variable_value($group, $var, $value);
}
}

#-------------------------------------------------------------------------------

Expand Down
44 changes: 40 additions & 4 deletions bld/namelist_files/namelist_defaults_drydep.xml
Original file line number Diff line number Diff line change
Expand Up @@ -15,15 +15,51 @@ attributes from the config_cache.xml file (with keys converted to upper-case).

<!-- Defaults for drydep_inparm namelist namelists to test standalone CTSM with -->

<drydep_list>'O3','NO2','HNO3','NO','HO2NO2','CH3OOH','CH2O','CO','H2O2','CH3COOOH','PAN','MPAN','C2H5OOH','ONIT','POOH','C3H7OOH','ROOH','CH3COCHO','CH3COCH3','Pb','ONITR','MACROOH','XOOH','ISOPOOH','CH3OH','C2H5OH','CH3CHO','GLYALD','HYAC','HYDRALD','ALKOOH','MEKOOH','TOLOOH','TERPOOH','CH3COOH','CB1','CB2','OC1','OC2','SOA','SO2','SO4','NH3','NH4NO3'
<drydep_list>'BIGALK','C2H4','C2H5OH','C2H5OOH','C2H6','C3H6',
'C3H7OOH','C3H8','CH2O','CH3CHO','CH3COCH3','CH3COCHO','CH3COOH',
'CH3COOOH','CH3OH','CH3OOH','CO','DMS','EOOH','GLYALD','GLYOXAL',
'H2O2','H2SO4','HNO3','HO2NO2','HYAC','HYDRALD','ISOP','ISOPOOH',
'MACR','MACROOH','MPAN','MVK','N2O5','NH3','NH4','NO','NO2',
'NOA','O3','O3S','ONITR','PAN','POOH','ROOH','SO2','SOAG','XOOH'
</drydep_list>

<!-- effective Henry's coef data for wet and dry deposition -->
<dep_data_file>atm/cam/chem/trop_mozart/dvel/dep_data_c201019.nc</dep_data_file>
<dep_data_file>atm/cam/chem/trop_mozart/dvel/dep_data_c20221208.nc</dep_data_file>

<!-- Defaults for megan_emis_nl namelists to test standalone CTSM with -->
<!--
Defaults for megan_emis_nl namelists to test standalone CTSM with
This is from the CAM FHISTC_MTt4s compset namelist from 04/25/2025 EBK
-->

<megan_specifier>'ISOP = isoprene', 'C10H16 = pinene_a + carene_3 + thujene_a', 'CH3OH = methanol', 'C2H5OH = ethanol', 'CH2O = formaldehyde', 'CH3CHO = acetaldehyde', 'CH3COOH = acetic_acid', 'CH3COCH3 = acetone'</megan_specifier>
<megan_specifier>
'ISOP = isoprene',
'TERP = carene_3 + pinene_a + thujene_a + bornene + terpineol_4 + terpineol_a + terpinyl_ACT_a +',
' myrtenal + sabinene + pinene_b + camphene + fenchene_a + limonene + phellandrene_a + terpinene_a +',
' terpinene_g + terpinolene + phellandrene_b + linalool + ionone_b + geranyl_acetone + neryl_acetone +',
' jasmone + verbenene + ipsenol + myrcene + ocimene_t_b + ocimene_al + ocimene_c_b + 2met_nonatriene +',
' farnescene_a + caryophyllene_b + acoradiene + aromadendrene + bergamotene_a + bergamotene_b +',
' bisabolene_a + bisabolene_b + bourbonene_b + cadinene_d + cadinene_g + cedrene_a + copaene_a +',
' cubebene_a + cubebene_b + elemene_b + farnescene_b + germacrene_B + germacrene_D + gurjunene_b +',
' humulene_a + humulene_g + isolongifolene + longifolene + longipinene + muurolene_a + muurolene_g +',
' selinene_b + selinene_d + nerolidol_c + nerolidol_t',
'BIGALK = tricyclene + camphor + fenchone + thujone_a + thujone_b + cineole_1_8 + borneol + bornyl_ACT +',
' cedrol + decanal + heptanal + heptane + hexane + nonanal + octanal + octanol + oxopentanal + pentane +',
' hexanal + hexanol_1 + pentanal + heptanone',
'CH3OH = methanol', 'CH3COCH3 = acetone', 'CH3CHO = acetaldehyde', 'C2H5OH = ethanol',
'CH2O = formaldehyde', 'CH3COOH = acetic_acid', 'CO = carbon_monoxide',
'C2H6 = ethane', 'C2H4 = ethene', 'C3H8 = propane', 'C3H6 = propene',
'SOAE = 0.5954*isoprene + 5.1004*(carene_3 + pinene_a + thujene_a + bornene +',
' terpineol_4 + terpineol_a + terpinyl_ACT_a + myrtenal + sabinene + pinene_b + camphene +',
' fenchene_a + limonene + phellandrene_a + terpinene_a + terpinene_g + terpinolene +',
' phellandrene_b + linalool + ionone_b + geranyl_acetone + neryl_acetone + jasmone +',
' verbenene + ipsenol + myrcene + ocimene_t_b + ocimene_al + ocimene_c_b + 2met_nonatriene) + ',
' 12.3942*(farnescene_a + caryophyllene_b + acoradiene + aromadendrene + bergamotene_a +',
' bergamotene_b + bisabolene_a + bisabolene_b + bourbonene_b + cadinene_d + cadinene_g +',
' cedrene_a + copaene_a + cubebene_a + cubebene_b + elemene_b + farnescene_b +',
' germacrene_B + germacrene_D + gurjunene_b + humulene_a + humulene_g + isolongifolene +',
' longifolene + longipinene + muurolene_a + muurolene_g + selinene_b + selinene_d +',
' nerolidol_c + nerolidol_t)'
</megan_specifier>

<megan_factors_file phys="clm6_0" >atm/cam/chem/trop_mozart/emis/megan21_emis_factors_78pft_c20161108.nc</megan_factors_file>
<megan_factors_file phys="clm5_0" >atm/cam/chem/trop_mozart/emis/megan21_emis_factors_78pft_c20161108.nc</megan_factors_file>
Expand Down
4 changes: 2 additions & 2 deletions bld/unit_testers/build-namelist_test.pl
Original file line number Diff line number Diff line change
Expand Up @@ -163,10 +163,10 @@ sub cat_and_create_namelistinfile {
#
# Figure out number of tests that will run
#
my $ntests = 3264;
my $ntests = 3276;

if ( defined($opts{'compare'}) ) {
$ntests += 1980;
$ntests += 1987;
}
plan( tests=>$ntests );

Expand Down
2 changes: 1 addition & 1 deletion cime
Submodule cime updated 47 files
+1 −0 .git-blame-ignore-revs
+1 −1 .pre-commit-config.yaml
+4 −1 CIME/BuildTools/configure.py
+15 −5 CIME/SystemTests/err.py
+24 −13 CIME/SystemTests/system_tests_common.py
+15 −1 CIME/Tools/Makefile
+16 −7 CIME/Tools/standard_script_setup.py
+1 −1 CIME/XML/archive_base.py
+2 −1 CIME/XML/compsets.py
+21 −18 CIME/XML/env_batch.py
+13 −1 CIME/XML/files.py
+200 −23 CIME/XML/machines.py
+34 −7 CIME/bless_test_results.py
+22 −15 CIME/build.py
+3 −2 CIME/build_scripts/buildlib.mpi-serial
+1 −1 CIME/case/case.py
+49 −32 CIME/case/case_st_archive.py
+1 −1 CIME/case/case_submit.py
+8 −6 CIME/case/check_input_data.py
+1 −0 CIME/data/config/cesm/config_files.xml
+14 −4 CIME/data/config/xml_schemas/config_machines_version3.xsd
+4 −0 CIME/data/templates/gitignore.template
+57 −57 CIME/get_tests.py
+1 −0 CIME/hist_utils.py
+1 −1 CIME/non_py/cprnc
+40 −58 CIME/scripts/query_config.py
+2 −2 CIME/simple_compare.py
+79 −74 CIME/test_scheduler.py
+1 −1 CIME/tests/base.py
+4 −4 CIME/tests/test_sys_bless_tests_results.py
+1 −1 CIME/tests/test_sys_build_system.py
+20 −20 CIME/tests/test_sys_cime_case.py
+1 −1 CIME/tests/test_sys_full_system.py
+1 −1 CIME/tests/test_sys_save_timings.py
+1 −1 CIME/tests/test_sys_single_submit.py
+21 −23 CIME/tests/test_sys_test_scheduler.py
+11 −11 CIME/tests/test_unit_baselines_performance.py
+26 −1 CIME/tests/test_unit_bless_test_results.py
+4 −4 CIME/tests/test_unit_case.py
+49 −0 CIME/tests/test_unit_configure.py
+77 −0 CIME/tests/test_unit_fake_case.py
+17 −17 CIME/tests/test_unit_system_tests.py
+262 −0 CIME/tests/test_unit_xml_env_batch.py
+2 −2 CIME/tests/test_unit_xml_grids.py
+183 −1 CIME/tests/test_unit_xml_machines.py
+51 −41 CIME/utils.py
+1 −1 docker/entrypoint.sh
32 changes: 30 additions & 2 deletions cime_config/testdefs/ExpectedTestFails.xml
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,27 @@
</phase>
</test>

<test name="SMS_Ld5.f09_t232.ISSP245Clm60BgcCropCrujra.derecho_intel.clm-ciso_dec2050Start">
<phase name="SETUP">
<status>FAIL</status>
<issue>#2686</issue>
</phase>
</test>

<test name="SMS_Ld5.f09_t232.ISSP370Clm60BgcCropCrujra.derecho_intel.clm-ciso_dec2050Start">
<phase name="SETUP">
<status>FAIL</status>
<issue>#2686</issue>
</phase>
</test>

<test name="SMS_Ld5.f09_t232.ISSP585Clm60BgcCropCrujra.derecho_intel.clm-ciso_dec2050Start">
<phase name="SETUP">
<status>FAIL</status>
<issue>#2686</issue>
</phase>
</test>

<test name="SMS_Ld5.f09_g17.IHistClm50Sp.derecho_intel.clm-nofire">
<phase name="SHAREDLIB_BUILD">
<status>FAIL</status>
Expand Down Expand Up @@ -114,9 +135,9 @@
</test>

<test name="SMS_D.f10_f10_mg37.I2000Clm60BgcCrop.derecho_nvhpc.clm-crop">
<phase name="RUN">
<phase name="SETUP">
<status>FAIL</status>
<issue>#1733</issue>
<issue>#1733 and #3180</issue>
</phase>
</test>

Expand All @@ -138,6 +159,13 @@
</phase>
</test>

<test name="FUNITCTSM_P1x1.f10_f10_mg37.I2000Clm50Sp.izumi_intel"
<phase name="MODEL_BUILD">
<status>FAIL</status>
<issue>#3182</issue>
</phase>
</test>

<test name="SMS_Ld10_D_Mmpi-serial.CLM_USRDAT.I1PtClm60Bgc.izumi_nag.clm-default--clm-NEON-HARV--clm-matrixcnOn">
<phase name="RUN">
<status>FAIL</status>
Expand Down
Loading