➜ athenapk git:(BenWibking/restart-reproducer) ✗ ./reproducer.sh + rm -rf build + mkdir build + cd build + cmake .. -DPARTHENON_ENABLE_PYTHON_MODULE_CHECK=OFF CMake Warning at external/parthenon/cmake/MachineCfg.cmake:61 (message): Not using any machine configuration. Consider creating a configuration file following the examples in /cmake/machine_cfgs/ and then point the MACHINE_CFG cmake or environment variable to your custom file.Note, that the machine file can be placed in any directory (also outside the repo). Call Stack (most recent call first): CMakeLists.txt:9 (include) -- The CXX compiler identification is AppleClang 15.0.0.15000100 -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/c++ - skipped -- Detecting CXX compile features -- Detecting CXX compile features - done -- Setting build type to 'Release' as none was specified. -- clang-format --version: 19.1.2 -- Found MPI_CXX: /opt/homebrew/Cellar/open-mpi/5.0.5/lib/libmpi.dylib (found version "3.1") -- Found MPI: TRUE (found version "3.1") found components: CXX CMake Warning at external/parthenon/cmake/MachineCfg.cmake:61 (message): Not using any machine configuration. Consider creating a configuration file following the examples in /Users/benwibking/athenapk/cmake/machine_cfgs/ and then point the MACHINE_CFG cmake or environment variable to your custom file.Note, that the machine file can be placed in any directory (also outside the repo). Call Stack (most recent call first): external/parthenon/CMakeLists.txt:21 (include) -- The C compiler identification is AppleClang 15.0.0.15000100 -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/cc - skipped -- Detecting C compile features -- Detecting C compile features - done -- Looking for C++ include filesystem -- Looking for C++ include filesystem - found -- Performing Test CXX_FILESYSTEM_NO_LINK_NEEDED -- Performing Test CXX_FILESYSTEM_NO_LINK_NEEDED - Success -- Performing Test CMAKE_HAVE_LIBC_PTHREAD -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success -- Found Threads: TRUE -- Found HDF5: hdf5-shared (found version "1.14.4") found components: C -- Setting default Kokkos CXX standard to 17 -- Kokkos version: 4.4.0 -- The project name is: Kokkos -- Using internal gtest for testing -- Configured git information in /Users/benwibking/athenapk/build/generated/Kokkos_Version_Info.cpp -- SERIAL backend is being turned on to ensure there is at least one Host space. To change this, you must enable another host execution space and configure with -DKokkos_ENABLE_SERIAL=OFF or change CMakeCache.txt -- Using -std=c++17 for C++17 standard as feature -- Built-in Execution Spaces: -- Device Parallel: NoTypeDefined -- Host Parallel: NoTypeDefined -- Host Serial: SERIAL -- -- Architectures: -- Found TPLLIBDL: /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX14.2.sdk/usr/include -- Using internal desul_atomics copy -- Experimental mdspan support is enabled -- Looking for C++ include experimental/mdspan -- Looking for C++ include experimental/mdspan - not found -- Looking for C++ include mdspan -- Looking for C++ include mdspan - not found -- Using internal mdspan directory /Users/benwibking/athenapk/external/Kokkos/core/src/../../tpls/mdspan/include -- Kokkos Backends: SERIAL -- Using Kokkos source from Kokkos_ROOT=/Users/benwibking/athenapk/external/Kokkos -- PAR_LOOP_LAYOUT='SIMDFOR_LOOP' (default par_for wrapper layout) -- PAR_LOOP_INNER_LAYOUT='SIMDFOR_INNER_LOOP' (default par_for_inner wrapper layout) -- Found Python3: /opt/homebrew/Frameworks/Python.framework/Versions/3.13/bin/python3.13 (found version "3.13.0") found components: Interpreter -- Found Git: /opt/homebrew/bin/git (found version "2.47.0") -- Checking for Python modules (numpy;unyt;matplotlib;h5py;scipy) required for regression tests. Check can be disabled by setting PARTHENON_ENABLE_PYTHON_MODULE_CHECK=OFF but then tests are not guaranteed to work anymore. -- Configuring done (2.4s) -- Generating done (0.1s) -- Build files have been written to: /Users/benwibking/athenapk/build + cmake --build . [0/2] Re-checking globbed directories... [12/134] cd /Users/benwibking/athenapk/build/parthenon/Kokkos && /opt/home...s -P /Users/benwibking/athenapk/external/Kokkos/cmake/build_env_info.cmake -- Configured git information in /Users/benwibking/athenapk/build/parthenon/Kokkos/generated/Kokkos_Version_Info.cpp [133/134] Linking CXX executable bin/athenaPK + cd .. + mpirun -np 8 ./build/bin/athenaPK -i inputs/restart_reproducer.in Applying norm factor of 1 to B field. Orig mean E_mag = 5e-05 Starting up hydro driver # Variables in use: # Package: parthenon::resolved_state # --------------------------------------------------- # Variables: # Name Metadata flags # --------------------------------------------------- turbulence_phases_k None,Provides,Real,Derived,OneCopy,Hydro,parthenon::resolved_state turbulence_phases_j None,Provides,Real,Derived,OneCopy,Hydro,parthenon::resolved_state acc Cell,Provides,Real,Derived,OneCopy,Hydro,parthenon::resolved_state turbulence_phases_i None,Provides,Real,Derived,OneCopy,Hydro,parthenon::resolved_state prim Cell,Provides,Real,Derived,Hydro,parthenon::resolved_state cons Cell,Provides,Real,Independent,FillGhost,WithFluxes,Hydro,parthenon::resolved_state bnd_flux::cons Face,Provides,Real,Derived,OneCopy,Flux,CellMemAligned,parthenon::resolved_state # --------------------------------------------------- # Sparse Variables: # Name sparse id Metadata flags # --------------------------------------------------- # --------------------------------------------------- # Swarms: # Swarm Value metadata # --------------------------------------------------- Setup complete, executing driver... cycle=0 time=0.0000000000000000e+00 dt=4.6870313203007836e-03 zone-cycles/wsec_step=0.00e+00 wsec_total=4.97e-02 wsec_step=1.42e-01 -------------- New Mesh structure after (de)refinement ------------- Number of Trees = 1 Total number of MeshBlocks = 8 Number of physical refinement levels = 0 Number of logical refinement levels = 1 Physical level = 0 (logical level = 1): 8 MeshBlocks, cost = 8 -------------------------------------------------------------------- cycle=1 time=4.6870313203007836e-03 dt=4.6624369596770087e-03 zone-cycles/wsec_step=5.62e+06 wsec_total=9.64e-02 wsec_step=4.67e-02 cycle=2 time=9.3494682799777924e-03 dt=4.6475826353307237e-03 zone-cycles/wsec_step=9.33e+06 wsec_total=1.25e-01 wsec_step=2.81e-02 cycle=3 time=1.3997050915308517e-02 dt=4.6304703306495427e-03 zone-cycles/wsec_step=7.21e+06 wsec_total=1.61e-01 wsec_step=3.64e-02 cycle=4 time=1.8627521245958061e-02 dt=4.6132081779462920e-03 zone-cycles/wsec_step=8.70e+06 wsec_total=1.91e-01 wsec_step=3.01e-02 cycle=5 time=2.3240729423904351e-02 dt=4.5971622706348228e-03 zone-cycles/wsec_step=8.65e+06 wsec_total=2.21e-01 wsec_step=3.03e-02 cycle=6 time=2.7837891694539173e-02 dt=4.5752638005413550e-03 zone-cycles/wsec_step=8.12e+06 wsec_total=2.54e-01 wsec_step=3.23e-02 cycle=7 time=3.2413155495080531e-02 dt=4.5559103547534209e-03 zone-cycles/wsec_step=8.76e+06 wsec_total=2.84e-01 wsec_step=2.99e-02 cycle=8 time=3.6969065849833949e-02 dt=4.5388251679880651e-03 zone-cycles/wsec_step=8.43e+06 wsec_total=3.15e-01 wsec_step=3.11e-02 cycle=9 time=4.1507891017822013e-02 dt=4.5237400510637939e-03 zone-cycles/wsec_step=8.39e+06 wsec_total=3.46e-01 wsec_step=3.12e-02 cycle=10 time=4.6031631068885803e-02 dt=4.5073506817405124e-03 zone-cycles/wsec_step=8.67e+06 wsec_total=3.76e-01 wsec_step=3.02e-02 cycle=11 time=5.0538981750626315e-02 dt=4.4939801471017265e-03 zone-cycles/wsec_step=1.30e+06 wsec_total=5.78e-01 wsec_step=2.02e-01 cycle=12 time=5.5032961897728043e-02 dt=4.4776615612851581e-03 zone-cycles/wsec_step=8.87e+06 wsec_total=6.08e-01 wsec_step=2.95e-02 cycle=13 time=5.9510623459013201e-02 dt=4.4588413770902139e-03 zone-cycles/wsec_step=7.58e+06 wsec_total=6.42e-01 wsec_step=3.46e-02 cycle=14 time=6.3969464836103412e-02 dt=4.4412086471860256e-03 zone-cycles/wsec_step=8.77e+06 wsec_total=6.72e-01 wsec_step=2.99e-02 cycle=15 time=6.8410673483289441e-02 dt=4.4240265524509255e-03 zone-cycles/wsec_step=8.29e+06 wsec_total=7.04e-01 wsec_step=3.16e-02 cycle=16 time=7.2834700035740371e-02 dt=4.4067011249979858e-03 zone-cycles/wsec_step=8.69e+06 wsec_total=7.34e-01 wsec_step=3.02e-02 cycle=17 time=7.7241401160738354e-02 dt=4.3857137773867022e-03 zone-cycles/wsec_step=9.22e+06 wsec_total=7.63e-01 wsec_step=2.84e-02 cycle=18 time=8.1627114938125050e-02 dt=4.3655668326488348e-03 zone-cycles/wsec_step=8.86e+06 wsec_total=7.92e-01 wsec_step=2.96e-02 cycle=19 time=8.5992681770773891e-02 dt=4.3450763048707031e-03 zone-cycles/wsec_step=7.99e+06 wsec_total=8.25e-01 wsec_step=3.28e-02 cycle=20 time=9.0337758075644592e-02 dt=4.3236974411924823e-03 zone-cycles/wsec_step=8.83e+06 wsec_total=8.55e-01 wsec_step=2.97e-02 cycle=21 time=9.4661455516837079e-02 dt=4.3029533533498147e-03 zone-cycles/wsec_step=8.48e+06 wsec_total=8.86e-01 wsec_step=3.09e-02 cycle=22 time=9.8964408870186898e-02 dt=4.2849535907396839e-03 zone-cycles/wsec_step=8.85e+06 wsec_total=9.15e-01 wsec_step=2.96e-02 cycle=23 time=1.0324936246092659e-01 dt=4.2685147059390244e-03 zone-cycles/wsec_step=1.22e+06 wsec_total=1.13e+00 wsec_step=2.16e-01 cycle=24 time=1.0751787716686562e-01 dt=4.2517412563356618e-03 zone-cycles/wsec_step=8.39e+06 wsec_total=1.16e+00 wsec_step=3.12e-02 cycle=25 time=1.1176961842320128e-01 dt=4.2343424771396536e-03 zone-cycles/wsec_step=9.86e+06 wsec_total=1.19e+00 wsec_step=2.66e-02 cycle=26 time=1.1600396090034093e-01 dt=4.2156621156818168e-03 zone-cycles/wsec_step=8.93e+06 wsec_total=1.22e+00 wsec_step=2.94e-02 cycle=27 time=1.2021962301602275e-01 dt=4.1978085715226165e-03 zone-cycles/wsec_step=8.47e+06 wsec_total=1.25e+00 wsec_step=3.10e-02 cycle=28 time=1.2441743158754537e-01 dt=4.1792295510571205e-03 zone-cycles/wsec_step=8.39e+06 wsec_total=1.28e+00 wsec_step=3.12e-02 cycle=29 time=1.2859666113860249e-01 dt=4.1620256904312848e-03 zone-cycles/wsec_step=7.54e+06 wsec_total=1.32e+00 wsec_step=3.48e-02 cycle=30 time=1.3275868682903377e-01 dt=4.1465725248014344e-03 zone-cycles/wsec_step=8.11e+06 wsec_total=1.35e+00 wsec_step=3.23e-02 cycle=31 time=1.3690525935383521e-01 dt=4.1328340718331420e-03 zone-cycles/wsec_step=8.07e+06 wsec_total=1.38e+00 wsec_step=3.25e-02 cycle=32 time=1.4103809342566836e-01 dt=4.1199352618365940e-03 zone-cycles/wsec_step=7.82e+06 wsec_total=1.41e+00 wsec_step=3.35e-02 cycle=33 time=1.4515802868750496e-01 dt=4.1062392363615434e-03 zone-cycles/wsec_step=7.99e+06 wsec_total=1.45e+00 wsec_step=3.28e-02 cycle=34 time=1.4926426792386652e-01 dt=7.3573207613347735e-04 zone-cycles/wsec_step=8.23e+06 wsec_total=1.48e+00 wsec_step=3.18e-02 cycle=35 time=1.4999999999999999e-01 dt=1.4714641522669547e-03 zone-cycles/wsec_step=1.27e+06 wsec_total=1.68e+00 wsec_step=2.06e-01 Driver completed. time=1.50e-01 cycle=35 tlim=1.50e-01 nlim=100000 walltime used = 1.68e+00 zone-cycles/wallsecond = 5.45e+06 ^C+ mkdir first_run + mv parthenon.out1.hst parthenon.prim.00000.phdf parthenon.prim.00000.phdf.xdmf parthenon.prim.00001.phdf parthenon.prim.00001.phdf.xdmf parthenon.prim.00002.phdf parthenon.prim.00002.phdf.xdmf parthenon.prim.final.phdf parthenon.prim.final.phdf.xdmf parthenon.restart.00000.rhdf parthenon.restart.00000.rhdf.xdmf parthenon.restart.00001.rhdf parthenon.restart.00001.rhdf.xdmf parthenon.restart.00002.rhdf parthenon.restart.00002.rhdf.xdmf parthenon.restart.final.rhdf parthenon.restart.final.rhdf.xdmf first_run + rm '*.csv' rm: cannot remove '*.csv': No such file or directory + mpirun -np 8 ./build/bin/athenaPK -r first_run/parthenon.restart.00000.rhdf Blocks assigned to rank 6: 6:6 Blocks assigned to rank 7: 7:7 Blocks assigned to rank 0: 0:0 Blocks assigned to rank 3: 3:3 Blocks assigned to rank 1: 1:1 Var: cons:9 Blocks assigned to rank 4: 4:4 Blocks assigned to rank 2: 2:2 Blocks assigned to rank 5: 5:5 Starting up hydro driver # Variables in use: # Package: parthenon::resolved_state # --------------------------------------------------- # Variables: # Name Metadata flags # --------------------------------------------------- turbulence_phases_k None,Provides,Real,Derived,OneCopy,Hydro,parthenon::resolved_state turbulence_phases_j None,Provides,Real,Derived,OneCopy,Hydro,parthenon::resolved_state acc Cell,Provides,Real,Derived,OneCopy,Hydro,parthenon::resolved_state turbulence_phases_i None,Provides,Real,Derived,OneCopy,Hydro,parthenon::resolved_state prim Cell,Provides,Real,Derived,Hydro,parthenon::resolved_state cons Cell,Provides,Real,Independent,FillGhost,WithFluxes,Hydro,parthenon::resolved_state bnd_flux::cons Face,Provides,Real,Derived,OneCopy,Flux,CellMemAligned,parthenon::resolved_state # --------------------------------------------------- # Sparse Variables: # Name sparse id Metadata flags # --------------------------------------------------- # --------------------------------------------------- # Swarms: # Swarm Value metadata # --------------------------------------------------- Setup complete, executing driver... cycle=0 time=0.0000000000000000e+00 dt=4.6870313203007836e-03 zone-cycles/wsec_step=0.00e+00 wsec_total=4.49e-02 wsec_step=1.26e-01 -------------- New Mesh structure after (de)refinement ------------- Number of Trees = 1 Total number of MeshBlocks = 8 Number of physical refinement levels = 0 Number of logical refinement levels = 1 Physical level = 0 (logical level = 1): 8 MeshBlocks, cost = 8 -------------------------------------------------------------------- cycle=1 time=4.6870313203007836e-03 dt=4.6624369596770087e-03 zone-cycles/wsec_step=9.27e+06 wsec_total=7.32e-02 wsec_step=2.83e-02 cycle=2 time=9.3494682799777924e-03 dt=4.6475826353307237e-03 zone-cycles/wsec_step=6.83e+06 wsec_total=1.12e-01 wsec_step=3.84e-02 cycle=3 time=1.3997050915308517e-02 dt=4.6304703306495427e-03 zone-cycles/wsec_step=6.88e+06 wsec_total=1.50e-01 wsec_step=3.81e-02 cycle=4 time=1.8627521245958061e-02 dt=4.6132081779462920e-03 zone-cycles/wsec_step=8.54e+06 wsec_total=1.80e-01 wsec_step=3.07e-02 cycle=5 time=2.3240729423904351e-02 dt=4.5971622706348228e-03 zone-cycles/wsec_step=9.73e+06 wsec_total=2.07e-01 wsec_step=2.69e-02 cycle=6 time=2.7837891694539173e-02 dt=4.5752638005413550e-03 zone-cycles/wsec_step=8.73e+06 wsec_total=2.37e-01 wsec_step=3.00e-02 cycle=7 time=3.2413155495080531e-02 dt=4.5559103547534209e-03 zone-cycles/wsec_step=8.12e+06 wsec_total=2.70e-01 wsec_step=3.23e-02 cycle=8 time=3.6969065849833949e-02 dt=4.5388251679880651e-03 zone-cycles/wsec_step=7.53e+06 wsec_total=3.05e-01 wsec_step=3.48e-02 cycle=9 time=4.1507891017822013e-02 dt=4.5237400510637939e-03 zone-cycles/wsec_step=7.76e+06 wsec_total=3.38e-01 wsec_step=3.38e-02 cycle=10 time=4.6031631068885803e-02 dt=4.5073506817405124e-03 zone-cycles/wsec_step=9.06e+06 wsec_total=3.67e-01 wsec_step=2.89e-02 cycle=11 time=5.0538981750626315e-02 dt=4.4939801471017265e-03 zone-cycles/wsec_step=9.07e+06 wsec_total=3.96e-01 wsec_step=2.89e-02 cycle=12 time=5.5032961897728043e-02 dt=4.4776615612851581e-03 zone-cycles/wsec_step=9.14e+06 wsec_total=4.25e-01 wsec_step=2.87e-02 cycle=13 time=5.9510623459013201e-02 dt=4.4588413770902139e-03 zone-cycles/wsec_step=7.59e+06 wsec_total=4.60e-01 wsec_step=3.45e-02 cycle=14 time=6.3969464836103412e-02 dt=4.4412086471860256e-03 zone-cycles/wsec_step=9.17e+06 wsec_total=4.88e-01 wsec_step=2.86e-02 cycle=15 time=6.8410673483289441e-02 dt=4.4240265524509255e-03 zone-cycles/wsec_step=9.01e+06 wsec_total=5.17e-01 wsec_step=2.91e-02 cycle=16 time=7.2834700035740371e-02 dt=4.4067011249979858e-03 zone-cycles/wsec_step=8.74e+06 wsec_total=5.47e-01 wsec_step=3.00e-02 cycle=17 time=7.7241401160738354e-02 dt=4.3857137773867022e-03 zone-cycles/wsec_step=9.89e+06 wsec_total=5.74e-01 wsec_step=2.65e-02 cycle=18 time=8.1627114938125050e-02 dt=4.3655668326488348e-03 zone-cycles/wsec_step=9.12e+06 wsec_total=6.03e-01 wsec_step=2.87e-02 cycle=19 time=8.5992681770773891e-02 dt=4.3450763048707031e-03 zone-cycles/wsec_step=9.18e+06 wsec_total=6.31e-01 wsec_step=2.85e-02 cycle=20 time=9.0337758075644592e-02 dt=4.3236974411924823e-03 zone-cycles/wsec_step=8.84e+06 wsec_total=6.61e-01 wsec_step=2.97e-02 cycle=21 time=9.4661455516837079e-02 dt=4.3029533533498147e-03 zone-cycles/wsec_step=7.73e+06 wsec_total=6.95e-01 wsec_step=3.39e-02 cycle=22 time=9.8964408870186898e-02 dt=4.2849535907396839e-03 zone-cycles/wsec_step=9.00e+06 wsec_total=7.24e-01 wsec_step=2.91e-02 cycle=23 time=1.0324936246092659e-01 dt=4.2685147059390244e-03 zone-cycles/wsec_step=1.27e+06 wsec_total=9.30e-01 wsec_step=2.06e-01 cycle=24 time=1.0751787716686562e-01 dt=4.2517412563356618e-03 zone-cycles/wsec_step=8.46e+06 wsec_total=9.61e-01 wsec_step=3.10e-02 cycle=25 time=1.1176961842320128e-01 dt=4.2343424771396536e-03 zone-cycles/wsec_step=8.70e+06 wsec_total=9.91e-01 wsec_step=3.01e-02 cycle=26 time=1.1600396090034093e-01 dt=4.2156621156818168e-03 zone-cycles/wsec_step=7.88e+06 wsec_total=1.02e+00 wsec_step=3.33e-02 cycle=27 time=1.2021962301602275e-01 dt=4.1978085715226165e-03 zone-cycles/wsec_step=8.50e+06 wsec_total=1.06e+00 wsec_step=3.08e-02 cycle=28 time=1.2441743158754537e-01 dt=4.1792295510571205e-03 zone-cycles/wsec_step=7.71e+06 wsec_total=1.09e+00 wsec_step=3.40e-02 cycle=29 time=1.2859666113860249e-01 dt=4.1620256904312848e-03 zone-cycles/wsec_step=7.32e+06 wsec_total=1.13e+00 wsec_step=3.58e-02 cycle=30 time=1.3275868682903377e-01 dt=4.1465725248014344e-03 zone-cycles/wsec_step=8.11e+06 wsec_total=1.16e+00 wsec_step=3.23e-02 cycle=31 time=1.3690525935383521e-01 dt=4.1328340718331420e-03 zone-cycles/wsec_step=8.78e+06 wsec_total=1.19e+00 wsec_step=2.99e-02 cycle=32 time=1.4103809342566836e-01 dt=4.1199352618365940e-03 zone-cycles/wsec_step=7.42e+06 wsec_total=1.22e+00 wsec_step=3.53e-02 cycle=33 time=1.4515802868750496e-01 dt=4.1062392363615434e-03 zone-cycles/wsec_step=6.17e+06 wsec_total=1.27e+00 wsec_step=4.25e-02 cycle=34 time=1.4926426792386652e-01 dt=7.3573207613347735e-04 zone-cycles/wsec_step=8.62e+06 wsec_total=1.30e+00 wsec_step=3.04e-02 cycle=35 time=1.4999999999999999e-01 dt=1.4714641522669547e-03 zone-cycles/wsec_step=1.23e+06 wsec_total=1.51e+00 wsec_step=2.14e-01 Driver completed. time=1.50e-01 cycle=35 tlim=1.50e-01 nlim=100000 walltime used = 1.51e+00 zone-cycles/wallsecond = 6.08e+06 ^C+ rm '*.csv' rm: cannot remove '*.csv': No such file or directory + h5diff first_run/parthenon.restart.00000.rhdf parthenon.restart.00001.rhdf attribute: > and > 1 differences found attribute: > and > 23468 differences found + h5diff first_run/parthenon.restart.00001.rhdf parthenon.restart.00002.rhdf attribute: > and > 1 differences found attribute: