Release v0.216.0

[0.216.0] - 2024-12-30

Changed

• Flight SQL protocol now supports anonymous and bearer token authentication
• The kamu notebook command now defaults to DataFusion engine for speed, but you can switch to Spark with --engine spark argument
• The kamu notebook command uses new image based on latest Jupyter and new kamu-client-python library
• The kamu sql server command now defaults to DataFusion engine with interface changed to use --engine datafusion/spark, removing the --flight-sql flag
• Examples in examples/flightsql/python were updated to new auth and showcasing kamu Python library
• Most notebooks in examples/ directory are using kamu Python library with DataFusion engine, with Spark still in use for GIS extensions

Release v0.215.1

[0.215.1] - 2024-12-30

Fixed

• GraphQL: in a multi-tenant workspace, datasets.createEmpty and datasets.createFromSnapshot mutations now return dataset aliases prefixed with account name.
• Fix DB transaction error in /verify REST endpoint (cherry-picked from 0.214.1)

Release v0.214.1

[0.214.1] - 2024-12-28

Fixed

• Transaction error on /verify REST endpoint

Release v0.215.0

[0.215.0] - 2024-12-27

Added

• New entity FlowTrigger which is now responsible for flow activation and schedules

Changed

• DatasetFlowConfigsMut now has only one method setConfig for all types of configurations

Release v0.214.0

[0.214.0] - 2024-12-23

Added

• New kamu system decode command that can decode an arbitrary block file for debugging
• export command for bulk data exporting

Changed

• sql command now allows to export query command results to file(s)
• FlightSQL session state management improvements

Release v0.213.1

[0.213.1] - 2024-12-18

Fixed

• Removed all occurrences of DataWriterMetadataState from telemetry spans (too much pressure)

Release v0.213.0

[0.213.0] - 2024-12-18

Added

• kamu-adapter-graphql: added macros (from_catalog_n!() & unsafe_from_catalog_n!())
  that simplify the extraction of components from the DI catalog
• database-common: the logic for pagination of data processing is generalized in EntityPageStreamer

Changed

• Speed up project build time by removing unused dependencies which were not detected by automated tools
• Extracted "planner" and "executor" for compacting, reset, set watermark, push ingest, partially polling ingest.
• Renamed long-running "executors" to "agents".
• Introduced MetadataQueryService to absorb simple queries that do not have to be defined at the level of metadata chian from the interface point of view.

Fixed

• DatasetEnvVar entity now deletes during deleting DatasetEntry entity

Release v0.212.0

[0.212.0] - 2024-12-11

Changed

• Upgraded to datafusion v43

Fixed

• Ingest was sometimes producing Parquet files with non-sequential offset column which violated the ODF spec

Release v0.211.0

[0.211.0] - 2024-12-02

Changed

• Dataset dependency graph is now backed with a database, removing need in dependendency scanning at startup.

Release v0.210.0

[0.210.0] - 2024-11-28

Added

• Console warning when deleting datasets which are out of sync with their push remotes

Changed

• Separated Web UI runtime and UI configuration flags. UI configuration is now provided by API server too.

Fixed

• Typo in feature flags (enableDatasetEnvVarsManagement)
  ^