Skip to content

Commit

Permalink
Merge branch 'master' into chore/merge-master
Browse files Browse the repository at this point in the history
# Conflicts:
#	CHANGELOG.md
#	Cargo.lock
#	Cargo.toml
#	src/adapter/graphql/src/queries/datasets/dataset.rs
#	src/adapter/graphql/src/utils.rs
#	src/adapter/oauth/Cargo.toml
#	src/app/cli/src/app.rs
#	src/domain/accounts/domain/Cargo.toml
#	src/domain/core/Cargo.toml
#	src/domain/datasets/domain/src/repos/dataset_entry_repository.rs
#	src/domain/datasets/domain/src/services/dataset_entry_service.rs
#	src/domain/datasets/services/src/dataset_entry_service_impl.rs
#	src/domain/datasets/services/src/dependency_graph_service_impl.rs
#	src/domain/opendatafabric/Cargo.toml
#	src/infra/accounts/inmem/Cargo.toml
#	src/infra/auth-rebac/postgres/Cargo.toml
#	src/infra/core/Cargo.toml
#	src/infra/datasets/inmem/Cargo.toml
#	src/infra/datasets/inmem/src/repos/inmem_dateset_entry_repository.rs
#	src/infra/datasets/postgres/src/repos/postgres_dataset_entry_repository.rs
#	src/infra/ingest-datafusion/Cargo.toml
#	src/utils/database-common/Cargo.toml
#	src/utils/database-common/src/entities.rs
#	src/utils/database-common/src/helpers.rs
#	src/utils/database-common/src/lib.rs
#	src/utils/database-common/tests/tests/mod.rs
#	src/utils/event-sourcing/Cargo.toml
#	src/utils/init-on-startup/Cargo.toml
  • Loading branch information
s373r committed Dec 19, 2024
2 parents 99251e7 + 3213a90 commit c104a8c
Show file tree
Hide file tree
Showing 385 changed files with 8,757 additions and 4,519 deletions.
42 changes: 38 additions & 4 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,8 +12,6 @@ Recommendation: for ease of reading, use the following order:
-->

## [Unreleased]
### Added
- Console warning when deleting datasets which are out of sync with their push remotes
### Changed
- Private Datasets:
- OSO: using user actors / dateset resources that come from the database
Expand All @@ -26,6 +24,42 @@ Recommendation: for ease of reading, use the following order:
- E2E: Using the correct account in multi-tenant mode
- And also the possibility of set it up

## [0.213.1] - 2024-12-18
### Fixed
- Removed all occurrences of `DataWriterMetadataState` from telemetry spans (too much pressure)

## [0.213.0] - 2024-12-18
### Added
- kamu-adapter-graphql: added macros (`from_catalog_n!()` & `unsafe_from_catalog_n!()`)
that simplify the extraction of components from the DI catalog
- database-common: the logic for pagination of data processing is generalized in `EntityPageStreamer`
### Changed
- Speed up project build time by removing unused dependencies which were not detected by automated tools
- Extracted "planner" and "executor" for compacting, reset, set watermark, push ingest, partially polling ingest.
- Renamed long-running "executors" to "agents".
- Introduced `MetadataQueryService` to absorb simple queries that do not have to be defined at the level of metadata chian from the interface point of view.
### Fixed
- `DatasetEnvVar` entity now deletes during deleting `DatasetEntry` entity

## [0.212.0] - 2024-12-11
### Changed
- Upgraded to `datafusion v43`
### Fixed
- Ingest was sometimes producing Parquet files with non-sequential `offset` column which violated the ODF spec

## [0.211.0] - 2024-12-02
### Changed
- Dataset dependency graph is now backed with a database, removing need in dependency scanning at startup.

## [0.210.0] - 2024-11-28
### Added
- Console warning when deleting datasets which are out of sync with their push remotes
### Changed
- Separated Web UI runtime and UI configuration flags. UI configuration is now provided by API server too.
### Fixed
- Typo in feature flags (enableDatasetEnvVarsManagement)
^

## [0.209.0] - 2024-11-25
### Changed
- Improved OpenAPI integration
Expand Down Expand Up @@ -230,7 +264,7 @@ Introduced `DatasetRegistry` abstraction, encapsulating listing and resolution o
- Outbox refactoring towards true parallelism via Tokio spaned tasks instead of futures
### Fixed
- Failed flows should still propagate `finishedAt` time
- Eliminate span.enter, replaced with instrument everywhere
- Eliminate `span.enter`, replaced with instrument everywhere

## [0.201.0] - 2024-09-18
### Added
Expand All @@ -245,7 +279,7 @@ Introduced `DatasetRegistry` abstraction, encapsulating listing and resolution o
- Revised implementation of flow scheduling to avoid in-memory time wheel:
- recording `FlowEventScheduledForActivation` event (previously, placement moment into the time wheel)
- replaced binary heap based time wheel operations with event store queries
- Postgres/SQlite event stores additionally track activation time for the waiting flows
- Postgres/SQLite event stores additionally track activation time for the waiting flows
- in-memory event store keeps prepared map-based lookup structures for activation time

## [0.200.0] - 2024-09-13
Expand Down
Loading

0 comments on commit c104a8c

Please sign in to comment.