Archivehost - Wayback machine downloader & server

Program to batch download and serve the wayback machine archives.

Pre-requisite

To build and run this program, you need to have the following installed:

• Node.js
• pnpm
• Rust

Install

Currently, binary is not available. You can install by running:

$ git clone https://github.com/nazo6/archivehost
$ cd archivehost
$ pnpm i
$ pnpm inst

Usage

You can see the help message by command:

$ archivehost --help

Download

Download command just downloads the archive of the given url. It is useful when you just want to download the archive of the url.

$ archivehost download <url> [--concurrency <concurrency>] [--from <from>] [--to <to>]

File will be save to ~/.local/share/archivehost on Linux and ~/AppData/Roaming/archivehost on Windows. This can be changed by using the --root flag.

Serve

Serve command starts the server to serve the download manager and the archives (this includes sites that downloaded by download command). This can be used as self-hosted wayback machine.

$ archivehost serve [--port <port>] [--host <host>]

By default, the server will run on port 3000. You can change the port by using the --port flag.

Serve url

/web/latest/<url>

Show the latest archive of the url.

/web/<timestamp>/<url>

Show the archive of the url before the timestamp.

TODO

• Download

  • Download the archive
  • Save downloaded info to sqlite database
  • Add database cleanup feature
  • Be able to export the downloaded archive

• Serve

  • Basic server
  • Add manager web ui frontend and api
  • Add banner to archive page so that user can see archive info
  • On-demand download
  • Return dummy response even if the archive is not found
    • Basic dummy response
    • Make dummy configurable
  • Better url rewriting