MAD SCIENCE realtime boot of remote docker images using bittorrent
npm install -g torrent-docker
torrent-docker --help
Docker images are HUGE. A simple hello world
node app easily takes up > 600MB
space.
Downloading/uploading these images can a looong time.
To fix this torrent-docker
implements a union file system that allows you to mount a docker image
shared using bittorrent and boot a container - all in realtime!
First create a docker image
FROM ubuntu:14.04
RUN apt-get update && apt-get install -qy curl vim
Then build it
docker build -t test-image .
Now all we need to do is create a torrent from the docker image
torrent-docker create test-image
This creates a file test-image.torrent
and a data folder test-image/
.
Share this torrent using your favorite torrent client or do
torrent-docker seed test-image.torrent # will print a activity log
Now copy test-image.torrent
to another machine.
To boot the image do
torrent-docker boot test-image.torrent my-container
This will mount the torrent as a union file system (that is writable!) and boot the docker image. In addition it will also seed the torrent which means the more containers you boot the more the torrent will be seeded.
You can attach to the debug log to see download speed, how many peers your are connected to, which files are being accessed etc using
nc localhost 10000 # will tail the debug log from the boot process
After a couple of seconds (depending on your internet connection, ymmw) you should be attached to a bash process running in your image! If for some reason your boot process cannot find a seeder you can specify them doing
torrent-docker boot test-image.torrent my-container --peer 128.199.33.21:6441
Optionally you can start your own tracker
torrent-docker tracker --port 8080
torrent-docker boot test-image.torrent my-container --tracker 127.0.0.1:8080
On OSX you'll need the following
- boot2docker, https://github.com/boot2docker/boot2docker
- osx fuse, http://sourceforge.net/projects/osxfuse/files/latest/download?source=files
- pkg-config,
brew install pkg-config
To make /var
, /etc
belong to root you need to run the following after installing boot2docker
boot2docker ssh
sudo umount /Users
sudo mount -t vboxsf Users /Users/
You need to run this everytime you boot boot2docker
THIS IS HIGHLY EXPERIMENTAL.
Currently I have only tested this on OSX using OSX fuse and boot2docker.