Skip to content

Atm File Rename to Standardized Form #4117

Merged
DavidHuber-NOAA merged 257 commits into
NOAA-EMC:developfrom
AntonMFernando-NOAA:main/atm_file_rename
Oct 28, 2025
Merged

Atm File Rename to Standardized Form #4117
DavidHuber-NOAA merged 257 commits into
NOAA-EMC:developfrom
AntonMFernando-NOAA:main/atm_file_rename

Conversation

@AntonMFernando-NOAA
Copy link
Copy Markdown
Contributor

@AntonMFernando-NOAA AntonMFernando-NOAA commented Oct 1, 2025

Description

Type of change

  • Bug fix (fixes something broken)
  • New feature (adds functionality)
  • Maintenance (code refactor, clean-up, new CI test, etc.)

Change characteristics

  • Is this a breaking change (a change in existing functionality)? YES/NO
  • Does this change require a documentation update? YES/NO
  • Does this change require an update to any of the following submodules? YES/NO (If YES, please add a link to any PRs that are pending.)
    • EMC verif-global
    • GDAS
    • GFS-utils
    • GSI
    • GSI-monitor
    • GSI-utils
    • UFS-utils
    • UFS-weather-model
    • wxflow

How has this been tested?

  • Run all the available tests on wcoss2

Checklist

  • Any dependent changes have been merged and published
  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have documented my code, including function, input, and output descriptions
  • My changes generate no new warnings
  • New and existing tests pass with my changes
  • This change is covered by an existing CI test or a new one has been added
  • Any new scripts have been added to the .github/CODEOWNERS file with owners
  • I have made corresponding changes to the system documentation if necessary

AntonMFernando-NOAA and others added 30 commits September 12, 2025 13:51
@NOAA-EMC NOAA-EMC deleted a comment from emcbot Oct 24, 2025
@NOAA-EMC NOAA-EMC deleted a comment from emcbot Oct 24, 2025
@NOAA-EMC NOAA-EMC deleted a comment from emcbot Oct 24, 2025
@NOAA-EMC NOAA-EMC deleted a comment from emcbot Oct 24, 2025
@NOAA-EMC NOAA-EMC deleted a comment from emcbot Oct 24, 2025
@NOAA-EMC NOAA-EMC deleted a comment from emcbot Oct 24, 2025
@emcbot

This comment was marked as duplicate.

Copy link
Copy Markdown
Contributor

@JessicaMeixner-NOAA JessicaMeixner-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The wave related changes here that I was tagged as a code-owner for review are okay. I'm not the best person to review the other changes, but I did look through them and did not see other red-flags beyond turning off tests.

Comment thread dev/ci/cases/pr/C96C48_ufs_hybatmDA.yaml
Copy link
Copy Markdown
Contributor

@WenMeng-NOAA WenMeng-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The updates in UPP and ATMOS_PRODUCT (pres_a and pres_b) look good to me, except for the missing pres_b dataset in the GDAS run, which will be addressed in a separate PR.

@DavidHuber-NOAA
Copy link
Copy Markdown
Contributor

@WenMeng-NOAA I have opened #4186 to handle turning on pres_b products for the gdas cycle. I will also add it to the description of this PR.

ecflow_client --event release_fcst
fi
echo "${rCDUMP} ${PDY}${cyc} atminc done at $(date)" > "${COMOUT_ATMOS_ANALYSIS}/${APREFIX}loginc.txt"
echo "${rCDUMP} ${PDY}${cyc} atminc done at $(date)" > "${COMOUT_ATMOS_ANALYSIS}/${APREFIX}analysis.done.txt"
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should have been increment.done.txt.

fi

echo "${rCDUMP} ${PDY}${cyc} atmanl and sfcanl done at $(date)" > "${COMOUT_ATMOS_ANALYSIS}/${APREFIX}loganl.txt"
echo "${rCDUMP} ${PDY}${cyc} atmanl and sfcanl done at $(date)" > "${COMOUT_ATMOS_ANALYSIS}/${APREFIX}done.txt"
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should have been analysis.done.txt

# Write analysis log file
formatted_date = datetime.now().strftime("%a %b %d %H:%M:%S %Z%Y")
log_file = os.path.join(self.task_config.COMOUT_ATMOS_ANALYSIS, f"{self.task_config.RUN}.t{self.task_config.cyc}z.loganl.txt")
log_file = os.path.join(self.task_config.COMOUT_ATMOS_ANALYSIS, f"{self.task_config.RUN}.t{self.task_config.cyc}z.done.txt")
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

analysis.done.txt

- "{{ COMIN_ATMOS_ANALYSIS | relpath(ROTDIR) }}/{{ head }}cnvstat.tar"
- "{{ COMIN_ATMOS_ANALYSIS | relpath(ROTDIR) }}/{{ head }}abias_int.txt"
- "{{ COMIN_ATMOS_ANALYSIS | relpath(ROTDIR) }}/{{ head }}analysis.dtf.a006.nc"
- "{{ COMIN_ATMOS_ANALYSIS | relpath(ROTDIR) }}/{{ head }}analysis.done.txt"
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

increment.done.txt

- "{{ COMIN_ATMOS_ANALYSIS | relpath(ROTDIR) }}/{{ head }}dtfanl.nc"
- "{{ COMIN_ATMOS_ANALYSIS | relpath(ROTDIR) }}/{{ head }}loginc.txt"
- "{{ COMIN_ATMOS_ANALYSIS | relpath(ROTDIR) }}/{{ head }}analysis.dtf.a006.nc"
- "{{ COMIN_ATMOS_ANALYSIS | relpath(ROTDIR) }}/{{ head }}analysis.done.txt"
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

increment.done.txt

Comment on lines -7 to +8
- "{{ COMIN_ATMOS_GEMPAK | relpath(ROTDIR) }}/gfs_{{ cycle_YMDH }}.sfc"
- "{{ COMIN_ATMOS_GEMPAK | relpath(ROTDIR) }}/gfs_{{ cycle_YMDH }}.snd"
- "{{ COMIN_ATMOS_GEMPAK | relpath(ROTDIR) }}/gfs_{{ cycle_YMDH }}.sfc.bufr"
- "{{ COMIN_ATMOS_GEMPAK | relpath(ROTDIR) }}/gfs_{{ cycle_YMDH }}.soundings.bufr"
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@JessicaMeixner-NOAA You are correct. #4271 is related to this update. The quick fix is to revert this change. However, the script that creates these files should be updated with the correct names.

FYI @BoCui-NOAA

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The script to create these files is ush/gfs_bfr2gpk.sh. The new correct names are gfs_{{ cycle_YMDH }}.sfc.bufr and gfs_{{ cycle_YMDH }}.soundings.bufr, right? @DavidHuber-NOAA @JessicaMeixner-NOAA

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I assume so, but am not the correct person to ask.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The script to create these files is ush/gfs_bfr2gpk.sh. The new correct names are gfs_{{ cycle_YMDH }}.sfc.bufr and gfs_{{ cycle_YMDH }}.soundings.bufr, right? @DavidHuber-NOAA @JessicaMeixner-NOAA

@BoCui-NOAA Yes, that is the correct naming convention.

@@ -4,11 +4,11 @@ gfs_downstream:
target: "{{ ATARDIR }}/{{ cycle_YMDH }}/gfs_downstream.tar"
required:
{% if DO_GEMPAK %}
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Amending my comment from #4271, this line should be modified to use DO_BUFRSND and eliminate singular dependence on DO_GEMPAK with the following:
{% if DO_BUFRSND and DO_GEMPAK %}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

With this PR being closed, the suggested revision could be accomplished through #4258.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will do, thanks @ChristopherHill-NOAA!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI-Gaeac6-Passed **Bot use only** CI testing on Gaea C6 for this PR has completed successfully CI-Hera-Passed (cm) Manual CI passed on Hera CI-Hercules-Passed **Bot use only** CI testing on Hercules for this PR has completed successfully CI-Ursa-Passed (cm) Manual CI passed on Ursa CI-Wcoss2-Passed CI testing on WCOSS for this PR has completed successfully

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Rename atm files to standardized form