Skip to content

v1.2.0

Compare
Choose a tag to compare
@kelindar kelindar released this 13 Nov 09:30
· 50 commits to master since this release
8818924

This version adds a support for multiple tables and ultimately introduces ability to re-partition data automatically by multiple different dimensions, during the ingestion process. For example, data can be partitioned by event, booking, and user_id by providing a following configuration:

tables:
  events:
    hashBy: "event"
    sortBy: "ingested_at"
  bookings: 
    hashBy: "booking_id"
    sortBy: "ingested_at"
  users: 
    hashBy: "user_id"
    sortBy: "ingested_at"

Breaking changes:

  • Environment variable configuration TALARIA_CONF prefix is replaced with TALARIA
  • Table configuration has been revamped (see /config/sample_config.yaml)
  • Removed the ability to configure logs and nodes tables as they were never actually changed
  • Compaction configuration is now per table