- ReMPI is a record-and-replay tool for MPI applications.
- (Optional) ReMPI implements Clock Delta Compression (CDC) for compressing records
-
$ git clone --recursive ssh://[email protected]:7999/prun/rempi.git
OR
$ git clone ssh://[email protected]:7999/prun/rempi.git
$ git submodule update --init
-
$ cd <rempi directory>
$ ./autogen.sh
$ tar zxvf ./rempi_xxxxx.tar.bz
$ cd <rempi directory>
./configure --prefix=<path to installation directory>
make
make install
./configure --prefix=<path to installation directory> --with-bluegene --with-zlib-static=/usr/local/tools/zlib-1.2.6/ MPICC=/usr/local/tools/compilers/ibm/mpicxx-fastmpi-mpich-312 MPIFC=/usr/local/tools/compilers/ibm/mpif90-fastmpi-mpich-312
make
make install
Assuming SLURM
cd example
sh ./example_x86.sh 16
ls -ltr .rempi # lists record files
For more details, run ./configure -h
--enable-cdc
: (Optional) enables CDC (clock delta compression), and output librempix.a and .so. When CDC is enabled, ReMPI requires MPI3 and below two software *--with-stack-pmpi
: (Required when--enable-cdc
is specified) path to stack_pmpi directory (STACKP) *--with-clmpi
: (Required when--enable-cdc
is specified) path to CLMPI directory--with-bluegene
: (Required in BG/Q) build codes with static library for BG/Q system--with-zlib-static
: (Required in BG/Q) path to installation directory for libz.a
When the --enable-cdc
option is specified, ReMPI require dependent software below:
- STACKP: A static MPI tool enabling to run multiple PMPI tools.
- CLMPI: A PMPI tool for piggybacking Lamport clocks.
REMPI_MODE
: Record mode OR Replay mode0
: Record mode1
: Replay mode
REMPI_DIR
: Directory path for record filesREMPI_ENCODE
: Encoding mode0
: Simple recording1
:0
+ record format optimization2
and3
: (Experimental encoding)4
: Clock Delta Compression (only when built with--enable-cdc
option)5
: Same as4
(only when built with--enable-cdc
option)
REMPI_GZIP
: Enable gzip compression0
: Disable zlib1
: Enable zlib
REMPI_TEST_ID
: Enable Matching Function (MF) Identification0
: Disable MF Identification1
: Enable MF Identification
- Kento Sato, Dong H. Ahn, Ignacio Laguna, Gregory L. Lee, and Martin Schulz. 2015. Clock delta compression for scalable order-replay of non-deterministic parallel applications. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC '15). ACM, New York, NY, USA, , Article 62 , 12 pages. DOI=http://dx.doi.org/10.1145/2807591.2807642