Copier

Tool for using Spark to copy URLs to a cluster in parallel.

Getting started

Builds using Apache Maven. Run mvn package to build, and run with spark-submit --class net.fnothaft.copier.Copier target/copier*.jar.