Distributed execution of data processing projects based on the number of data.
- Automatically import project to generate dockerfile.
- Start the plural container to process the divided data.
python 3.6.9
Ubuntu 18.04
- Copy project of data processing to this directory.
- Create a bash script named "start" in the project to be processed and write the execution command.
- Execute Docker_maker
bash Docker_maker your_other_project your_log_file
- conatainer status monitoring (In development)