Skip to content

Latest commit

 

History

History
29 lines (20 loc) · 752 Bytes

README.md

File metadata and controls

29 lines (20 loc) · 752 Bytes

Mastosearch

This is a 2 part toolset to index the Mastodon federated network.

cmd/watcher

  • Downloads a list of Mastodon server and connects to their public stream to watch for local status.
  • Send status update and delete requests to a NSQ server
  • Keeps track of timeline download process in a local sqlite datatbase

cmd/indexer

  • Connects to NSQ
  • Indexes and deletes status received from cmd/watcher

Environment variables

  • MASTODON_SERVER To watch a single instance, unset watches all
  • ES_SERVER Elasticsearch address
  • NSQD_SERVER NSQD server

Build & run

# Minimum max_map_acount for elasticsearch :
sudo sysctl vm.max_map_count=262144
# Build and run from docker-compose.yaml
docker-compose up --build
```