Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kokkos Atomics in v3.6.01 #720

Open
Yurlungur opened this issue Aug 22, 2022 · 0 comments
Open

Kokkos Atomics in v3.6.01 #720

Yurlungur opened this issue Aug 22, 2022 · 0 comments
Labels
build configuration discussion Error Documenting Errors, may or may not be a bug, could be user setttings, env settings etc. Kokkos Kokkos infrastructure/feature related

Comments

@Yurlungur
Copy link
Collaborator

Yurlungur commented Aug 22, 2022

I recently discovered that on our local Cray cluster, I need to build with

-DKokkos_ENABLE_IMPL_DESUL_ATOMICS=OFF

or I encounter several difficulties:

  • In downstream codes with relocatable device code, Kokkos::initialize fails immediately
  • Even with no downstream RDC, with cuda-aware MPI, a code path eventually triggers, which causes an error.

In both cases, the error looks like

terminate called after throwing an instance of 'std::runtime_error'
  what():  Desul::Error: init_lock_arrays_cuda: post init kernel error(cudaErrorIllegalAddress): an illegal memory access was encountered

I've reported this issue to the Kokkos team. I'm not sure if we need to do anything about this, but I think it's worth documenting for posterity.

@Yurlungur Yurlungur added Kokkos Kokkos infrastructure/feature related Error Documenting Errors, may or may not be a bug, could be user setttings, env settings etc. discussion build configuration labels Aug 22, 2022
@Yurlungur Yurlungur pinned this issue Aug 22, 2022
@lroberts36 lroberts36 unpinned this issue Sep 6, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build configuration discussion Error Documenting Errors, may or may not be a bug, could be user setttings, env settings etc. Kokkos Kokkos infrastructure/feature related
Projects
None yet
Development

No branches or pull requests

1 participant