Skip to content

Remove PIO as part of S2S model build in CMEPS and use hpc-stack#199

Merged
binli2337 merged 5 commits into
ufs-community:developfrom
aerorahul:feature/no-pio
Sep 30, 2020
Merged

Remove PIO as part of S2S model build in CMEPS and use hpc-stack#199
binli2337 merged 5 commits into
ufs-community:developfrom
aerorahul:feature/no-pio

Conversation

@aerorahul
Copy link
Copy Markdown
Contributor

@aerorahul aerorahul commented Sep 28, 2020

Description of changes

This PR:

  • loads the module pio/2.5.1 from hpc-stack
  • removes the building of Parallel IO within CMEPS

Specific notes

Issues Fixed (include github issue #):
closes #197

Are changes expected to change answers?

  • bit for bit (yes/no)
  • more substantial (yes/no)

Specific changes:

  • changes in module files: YES

Testing performed:

  • machines:
  • details:

Hashes used for testing:

Co-authored by:

Associated PRs:

CMEPS PR #16
#199

@JessicaMeixner-NOAA
Copy link
Copy Markdown
Collaborator

@arunchawla-NOAA didn't you request that PIO was built internally to CMEPS and not as an external library for ease of code delivery, as @rsdunlapiv mentioned in the issue #197

@arunchawla-NOAA
Copy link
Copy Markdown
Collaborator

Yes, we initially planned to have pio built as part of the model, but since pio is going to be used in multiple softwares we will get it installed as a library and have it included in WCOSS and RDHPCS

@junwang-noaa
Copy link
Copy Markdown
Collaborator

@aerorahul, we just had an s2s commit, would you please merge with the latest s2s, then we can run RT?

@aerorahul aerorahul marked this pull request as ready for review September 29, 2020 18:44
@binli2337
Copy link
Copy Markdown
Collaborator

@aerorahul, The regression tests have been run on Hera, Orion and WCOSS Dell 3. The log files are located at /scratch1/NCEPDEV/nems/Bin.Li/S2S/update/log_files_PR199.

@aerorahul
Copy link
Copy Markdown
Contributor Author

@aerorahul, The regression tests have been run on Hera, Orion and WCOSS Dell 3. The log files are located at /scratch1/NCEPDEV/nems/Bin.Li/S2S/update/log_files_PR199.

@binli2337
I cannot copy Orion logs.

1001 hfe01 ~ $ l /scratch1/NCEPDEV/nems/Bin.Li/S2S/update/log_files_PR199/*_orion.intel.log
total 20032
-rw-r----- 1 Bin.Li nems 6656036 Sep 30 06:33 Compile_orion.intel.log
-rw-r----- 1 Bin.Li nems   34686 Sep 30 06:33 RegressionTests_orion.intel.log

@binli2337
Copy link
Copy Markdown
Collaborator

@aerorahul Please try again. Thanks!

@aerorahul
Copy link
Copy Markdown
Contributor Author

@aerorahul Please try again. Thanks!

that worked. thanks @binli2337
Logs have been updated.

@binli2337 binli2337 merged commit 17b9668 into ufs-community:develop Sep 30, 2020
Comment thread .gitmodules
path = CMEPS
url = https://github.com/NOAA-EMC/CMEPS.git
branch = emc/develop
url = https://github.com/aerorahul/CMEPS.git
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry if I missed something, is it intentional to point to @aerorahul's CMEPS repo in the merged version of the code?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No. not intentional.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is a PR in CMEPS. NOAA-EMC/CMEPS#16
Are they waiting for that one to merge?
I don't know how this works across repos.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sorry I missed that merge. It is ready now.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Usually it works the other way round, from bottom (innermost nested submodule) to top. Someone merges cmeps, you update your submodule pointer in your ufs-s2s-model PR to point back to the (now merged) official cmeps repo, then merge ufs-s2s-model.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@climbfuji
What do you want me to do now?
Should I open another PR in ufs-s2s-model with the updated .gitmodules and the submodule pointer?

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@aerorahul Please submit a new PR. Thanks!

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

New PR issued. See #205

@aerorahul aerorahul deleted the feature/no-pio branch October 1, 2020 13:21
MinsukJi-NOAA pushed a commit to MinsukJi-NOAA/ufs-s2s-model that referenced this pull request Oct 7, 2020
* Use hpc-stack libraries in ufs-s2s-model (ufs-community#191)

* Update .gitmodules and submodule pointer for fv3atm for PR ufs-community#157 (RRTMG cloud overlap method update) (ufs-community#193)

* Bugfix/wave1dtest (ufs-community#195)

* fix MOM6 input template used by the cpld_fv3_ccpp_384_mom6_cice_cmeps_ww3_1d_bmark_rt test

* Remove PIO as part of S2S model build in CMEPS and use hpc-stack (ufs-community#199)

* update CMEPS submodule pointer (ufs-community#205)

* Merge with upstream and fix conflicts

Co-authored-by: BinLi-NOAA <bin.li@noaa.gov>
Co-authored-by: Dom Heinzeller <dom.heinzeller@icloud.com>
Co-authored-by: Denise Worthen <denise.worthen@noaa.gov>
Co-authored-by: Rahul Mahajan <aerorahul@users.noreply.github.com>
ShanSunNOAA pushed a commit to ShanSunNOAA/ufs-s2s-model that referenced this pull request Oct 28, 2020
* update to latest WW3, 
* update to latest NEMS and stochastic physics branches
* point to new baseline in rt.sh
* wcoss_dell_p3 log, wcoss_cray log, hera.intel log,* orion.intel log
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Load PIO as an external dependency.

7 participants