Skip to content

Add new XML variables for flexible controls of GPU configuration#363

Merged
jedwards4b merged 6 commits into
ESCOMP:mainfrom
sjsprecious:add_gpu_gust
Aug 9, 2023
Merged

Add new XML variables for flexible controls of GPU configuration#363
jedwards4b merged 6 commits into
ESCOMP:mainfrom
sjsprecious:add_gpu_gust

Conversation

@sjsprecious
Copy link
Copy Markdown
Contributor

@sjsprecious sjsprecious commented Apr 17, 2023 •
edited
Loading

This PR introduces four new XML variables for a more flexible control of GPU configuration:

  • GPU_TYPE: the type of GPU device to be used, such as NVIDIA A100 GPU, AMD MI250, etc.
  • GPU_OFFLOAD: the type of GPU programming model for GPU offload, such as OpenACC, OpenMP target offload, etc.
  • MAX_CPUTASKS_PER_GPU_NODE: the maximum number of CPU cores / MPI ranks per GPU node that can be used for simulation. This variable is needed for machines (e.g., Gust at NCAR) where CPU and GPU nodes have different number of CPU cores.
  • MPI_GPU_WRAPPER_SCRIPT: the wrapper script that will be attached to the MPI run command and map different MPI ranks to different GPUs within the same compute node.

This PR will work properly with the PRs in CIME (ESMCI/cime#4396) and ccs_config_cesm (ESMCI/ccs_config_cesm#97).

@sjsprecious
Add Jim's changes for new GPU options based on his branch: https://gi…
18e5075 
…thub.com/jedwards4b/CMEPS/compare/ff8726f..79d6fa7

	modified:   cime_config/config_component.xml
@sjsprecious
Add MAX_CPUTASKS_PER_GPU_NODE XML variable
ebb0818 
Update nvhpc compiler for GPU settings
Remove PGI compiler

	modified:   cime_config/config_component.xml
@sjsprecious
Remove default_values and valid_values for GPU_TYPE and GPU_OFFLOAD
72c1230 
so that they could assign multiple values to the config_machines.xml
file

	modified:   cime_config/config_component.xml
@sjsprecious
Merge branch 'main' into add_gpu_gust
8cccca6
This was referenced Apr 17, 2023
Merged
Merged
@jedwards4b jedwards4b self-requested a review April 17, 2023 16:10
@sjsprecious
Copy link
Copy Markdown
Contributor Author

sjsprecious commented May 26, 2023

@jedwards4b will issue a separate PR to introduce these changes.

@sjsprecious sjsprecious reopened this Aug 8, 2023
@sjsprecious sjsprecious requested a review from jedwards4b August 8, 2023 16:33
@jedwards4b jedwards4b merged commit e951fdc into ESCOMP:main Aug 9, 2023
@sjsprecious sjsprecious mentioned this pull request Aug 10, 2023
Merged
@sjsprecious sjsprecious deleted the add_gpu_gust branch October 4, 2024 07:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jedwards4b jedwards4b jedwards4b approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@sjsprecious @jedwards4b