Consolidate load_*_modules scripts into a generic load_modules.sh script

[Copilot]

✅ Consolidate load_*_modules scripts into a generic script - COMPLETE

All Acceptance Criteria Met

1. ✅ The script loads all of the same modules as the load_*_modules.sh scripts do.
2. ✅ All environmental variables currently set in the load_*_modules.sh are set in the new script based on application.
3. ✅ All J-Jobs are converted to the new script (91 files in dev/jobs/).
4. ⏳ All CI tests pass (pending automated CI run).

Implementation Summary

Created new consolidated module loading script:

• dev/ush/load_modules.sh - Single script to replace 5 separate module loading scripts
• Supports 6 module types: run, gsi, verif, ufsda, ufswm, setup
• Defaults to run if no argument provided
• Automatic fallback to gw_run when specific module type not available on a platform
• Simplified module detection using module is-avail command
• Full backwards compatibility with --eva and --gdas options for ufsda

Maintained backwards compatibility:

• Converted all 5 old scripts to lightweight wrappers that call the new consolidated script
• Old scripts remain functional for any external users

Updated all job files (91 total):

• 46 files: source "${HOMEgfs}/dev/ush/load_modules.sh" run
• 13 files: source "${HOMEgfs}/dev/ush/load_modules.sh" gsi
• 1 file: source "${HOMEgfs}/dev/ush/load_modules.sh" verif
• 22 files: source "${HOMEgfs}/dev/ush/load_modules.sh" ufsda
• 9 files: source "${HOMEgfs}/dev/ush/load_modules.sh" ufswm

Recent Changes (addressing review feedback)

• Simplified module loading logic: Replaced complex case block with straightforward logic that sets target_module="gw_${MODULE_TYPE}.${MACHINE_ID}" and automatically falls back to gw_run if module not available
• Added error handling: Added else block with FATAL ERROR message when target_module cannot be determined
• Removed deprecated symlink: Removed load_fv3gfs_modules.sh symlink creation from link_workflow.sh as it's no longer needed

Key Features

• Error handling: Comprehensive error messages and exit codes
• Platform support: All supported platforms (wcoss2, hera, orion, hercules, gaeac5, gaeac6, ursa, noaacloud, s4, jet, acorn)
• Special cases handled:
  • UFSDA with GDAS/EVA module selection
  • UFSWM with platform-specific module loading and UTILROOT export
  • Automatic fallback for modules not available on specific platforms
• Environment preservation: All environment variables from original scripts preserved
• PYTHONPATH setup: Automatic wxflow and ush/python path configuration
• Clean code: No shellcheck warnings, all syntax validated

Testing Results

• ✅ All 91 job files have valid syntax
• ✅ New consolidated script passes shellcheck with no warnings
• ✅ All 5 wrapper scripts have valid syntax
• ✅ Simplified logic maintains all functionality
• ✅ All files use the new script correctly

Benefits

1. Maintainability: Single script to maintain instead of 5 separate scripts
2. Consistency: All module loading follows the same pattern
3. Flexibility: Easy to add new module types or platforms
4. Backwards compatibility: Existing workflows continue to work
5. Documentation: Clear deprecation notices in wrapper scripts
6. Simplicity: Cleaner, more maintainable code with automatic fallback logic

Original prompt

---

This section details on the original issue you should resolve

<issue_title>Consolidate the load_*_modules scripts into a generic script</issue_title>
<issue_description>### What new functionality do you need?

The module loading scripts in dev/ush should be consolidated into a single generic script.

What are the requirements for the new functionality?

The script should take an argument signifying which module set to load (ufsda, setup, gsi, verif, run, etc). If an argument is not given, use the default module set (run). Not all module sets (e.g. gw_verif.<target>.lua) exist for all target machines, so the script should automatically detect if a that module file exists and if it doesn't, load the default set (gw_run.<target>.lua).

Acceptance Criteria

• The script loads all of the same modules as the load_*_modules.sh scripts do.
• All environmental variables currently set in the load_*_modules.sh are set in the new script based on application.
• All J-Jobs are converted to the new script.
• All CI tests pass.

Suggest a solution (optional)

No response</issue_description>

Comments on the Issue (you are @copilot in this section)

Fixes #4066

---

✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

[DavidHuber-NOAA]

All CI tests ran successfully on Ursa. Opening for review.

[DavidHuber-NOAA]

Clearing my review.

[DavidHuber-NOAA]

FYI @DavidNew-NOAA @JessicaMeixner-NOAA

[TerrenceMcGuinness-NOAA]

lg

[aerorahul]

Looks good, but leaving a few suggestions that should not alter results.

[aerorahul]

Sorry for the back and forth, but this looks good.
Thanks!

[DavidHuber-NOAA]

Merging based on successful tests on Ursa.