parallel netcdf writes, inpost with no thread #43
Merged
junwang-noaa merged 11 commits intoFeb 4, 2020
Conversation
junwang-noaa
changed the title
Collaborator
|
The files in the cmake directory need to have the PARALLEL_NETCDF option added |
yangfanglin
reviewed
Feb 2, 2020
|
|
||
| CPPDEFS += -Duse_libMPI -Duse_netCDF -DSPMD -DUSE_LOG_DIAG_FIELD_INFO -DUSE_GFSL63 -DGFS_PHYS -Duse_WRTCOMP | ||
| CPPDEFS += -DNEW_TAUCTMAX -DINTERNAL_FILE_NML | ||
| CPPDEFS += -DNEW_TAUCTMAX -DINTERNAL_FILE_NML -DNO_PARALLEL_NETCDF |
Collaborator
There was a problem hiding this comment.
Parallel netCDF not supported on Cray ? It is fine if it is the case. The global workflow needs to have different I/O settings on different platforms.
Collaborator
Author
|
I got some error when installing the hdf1.10.6 on cray. I am asking
George's help to see which cc compiler I should use on cray. So at this
time I disabled the parallel netcdf on cray.
…On Sat, Feb 1, 2020 at 9:45 PM Fanglin Yang ***@***.***> wrote:
***@***.**** commented on this pull request.
------------------------------
In conf/configure.fv3.wcoss_cray
<#43 (comment)>
:
> @@ -47,7 +47,7 @@ CFLAGS := $(INCLUDE)
FFLAGS := $(INCLUDE) -fno-alias -auto -safe-cray-ptr -ftz -assume byterecl -nowarn -sox -align array64byte
CPPDEFS += -Duse_libMPI -Duse_netCDF -DSPMD -DUSE_LOG_DIAG_FIELD_INFO -DUSE_GFSL63 -DGFS_PHYS -Duse_WRTCOMP
-CPPDEFS += -DNEW_TAUCTMAX -DINTERNAL_FILE_NML
+CPPDEFS += -DNEW_TAUCTMAX -DINTERNAL_FILE_NML -DNO_PARALLEL_NETCDF
Parallel netCDF not supported on Cray ? It is fine if it is the case. The
global workflow needs to have different I/O settings on different platforms.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<#43?email_source=notifications&email_token=AI7D6TKBTEC5PVUHXTQWBDTRAYXV7A5CNFSM4KOWMOUKYY3PNVWWK3TUL52HS4DFWFIHK3DMKJSXC5LFON2FEZLWNFSXPKTDN5WW2ZLOORPWSZGOCT4434A#pullrequestreview-351915504>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AI7D6TP342HC6RPADRQDU63RAYXV7ANCNFSM4KOWMOUA>
.
|
yangfanglin
approved these changes
Feb 2, 2020
Collaborator
yangfanglin
left a comment
yangfanglin
left a comment
There was a problem hiding this comment.
Read through the changes. I think they are all fine. Knowing the code helps me to think how to generalize the workflow scripts to run the model for various options and on different platforms.
|
@junwang-noaa Why do you need to install parallel-netcdf on cray? It is one of their standard modules, if it's not already on the system, you should be able to get support staff to install it. |
Collaborator
Author
|
This is for the new netcdf lib with parallel writing compressed data. We
cant ask system adm to install a non public release version on operational
machine. we install it ourselves for the testing purpose.
…On Sunday, February 2, 2020, jedwards4b ***@***.***> wrote:
@junwang-noaa <https://github.com/junwang-noaa> Why do you need to
install parallel-netcdf on cray? It is one of their standard modules, if
it's not already on the system, you should be able to get support staff to
install it.
Cray supported netcdf and parallel-netcdf modules are:
cray-parallel-netcdf
and cray-netcdf
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#43?email_source=notifications&email_token=AI7D6TNGBYZYMWJREZH5UDLRA3RJRA5CNFSM4KOWMOUKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEKRZOQQ#issuecomment-581146434>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AI7D6TML7QBFBU4SINCVN4TRA3RJRANCNFSM4KOWMOUA>
.
|
junwang-noaa
changed the title
DusanJovic-NOAA
approved these changes
Feb 4, 2020
climbfuji
added a commit
to climbfuji/ufs-weather-model
that referenced
this pull request
Jun 7, 2020
Adding regression test for FV3_RRFS_v0 from @panll (ufs-community#43) with submodule updates
XiaSun-Atmos
pushed a commit
to XiaSun-Atmos/ufs-weather-model
that referenced
this pull request
Aug 8, 2020
climbfuji
pushed a commit
to climbfuji/ufs-weather-model
that referenced
this pull request
Nov 19, 2020
…leanup Unified UGWP wrapper PR around ufs-community#43
bensonr
added a commit
to bensonr/ufs-weather-model
that referenced
this pull request
Aug 20, 2021
* new fv3atm (PR ufs-community#374 3fef1582038a90eb117ada9b62cd546740b335a2) * updated stochastic_physics (PR ufs-community#43 2dfaec8ca47cea9397c1c1e6e6836ce1acaa421a) updates fv3_conf/compile_slurm.IN_gaea to use proper queue with ecflow
14 tasks
epic-cicd-jenkins
pushed a commit
that referenced
this pull request
Apr 17, 2023
JiliDong-NOAA
added a commit
to JiliDong-NOAA/ufs-weather-model
that referenced
this pull request
Oct 7, 2025
* update for rrfsens restart bitwise reproducibility --------- Co-authored-by: jili dong <jili.dong@dlogin08.dogwood.wcoss2.ncep.noaa.gov> Co-authored-by: jili dong <jili.dong@clogin07.cactus.wcoss2.ncep.noaa.gov> Co-authored-by: jili dong <jili.dong@clogin09.cactus.wcoss2.ncep.noaa.gov>
JiliDong-NOAA
added a commit
to JiliDong-NOAA/ufs-weather-model
that referenced
this pull request
Oct 7, 2025
REFS ensemble restart fix (ufs-community#43)
MatthewPyle-NOAA
pushed a commit
that referenced
this pull request
Jan 20, 2026
…crash issues for RRFSv1 operational implementation (#2925) * Update .gitmodules * Fix rrfs (conus13km) decomp and restart tests * update .gitmodules * Update FV3 * update for rrfsens restart bitwise reproducibility * update FV3 * revert FV3 * update FV3 * REFS ensemble restart fix (#43) * update for rrfsens restart bitwise reproducibility --------- * update FV3 and stochastic_physics; fix DEBUG crash for REFS * update FV3 * update FV3 to fix C3 compiling error * bl_date update * WCOSS2 RRFS Tests Pass * add hercules RT log: passed * remove unused conf file * revert ufsatm and stochastic_physics back to community * update ufsatm and stochastic_physics ---------
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
5 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This pull request has following code changes
1)fv3atm pull request 41: parallel netcdf IO. fv3tam issue 23 parallel netcdf writes.
2) update post lib to not compile with "openmp". fv3atm issue 49:inline post does not reproduce with threads.
FV3ATM pull request 41: NOAA-EMC/ufsatm#41
#43: