[FLUSS-2262][lake] Improved Stability for Iceberg Log Table Compaction Test#2265

Closed

rionmonster wants to merge 109 commits intoapache:mainfrom

rionmonster:fluss-2262

Commits on Dec 27, 2025

[FLUSS-2262][lake] Improved Stability for Iceberg Log Table Compaction Test
rionmonster
committed

Commits on Jan 10, 2026

[FLUSS-2262][lake][server] Address lake table tiering stability during state handling
rionmonster
committed
[FLUSS-2262][lake][server] Ensure pending tiering tables are removed during table removal
rionmonster
committed

Commits on Jan 28, 2026

[lake/iceberg] Removal and clean-up for previous approaches
rionmonster
committed
[lake/iceberg] Continued clean-up from previous iterations
rionmonster
committed
[common] switch to at.yawk.lz4:lz4-java due to CVE-2025-12183 (#2136)

sd4324530
authored and
rionmonster
committed
[lake] Support ADD COLUMN AT LAST for dataLake enabled tables (#2189)

buvb
authored and
rionmonster
committed
[lake/paimon] Support NestedRow types for tiering paimon (#2260)

XuQianJin-Stars
authored and
rionmonster
committed
[docs] Use the "docker compose ps" to show the running containers (#2229)

zuston
authored and
rionmonster
committed
[server] Introduce new rebalance API (#1380)

authored and
rionmonster
committed
[Docs] Document the TypedAPI #2230 (#2261)

Prajwal-banakar
authored and
rionmonster
committed
[flink] Add RuntimeContext adapter for Flink 2.x compatibility (#2241)

sd4324530
authored and
rionmonster
committed
[server] Support AddServerTag and RemoveServerTag (#1400)

swuferhong
authored and
rionmonster
committed
[client] Change SchemaNotExistException as retriable exception. (#2193)

loserwang1024
authored and
rionmonster
committed
[hotfix] Use CatalogTableAdapter rather than CatalogTable.newBuilder in flink catalog. (#2275)

loserwang1024
authored and
rionmonster
committed
[flink] Flink Source need to check tableId on recovery in case that table is recreated. (#2154)

loserwang1024
authored and
rionmonster
committed
[common] Fix IndexOutOfBoundsException in ArrowArrayWriter when element count exceeds INITIAL_CAPACITY (#2165)

binary-signal
authored and
rionmonster
committed
[common Improve ArrowArrayWriter performance by replacing hardcoded handleSafe=true with dynamic check based on fieldIndex

platinumhamburg
authored and
rionmonster
committed
[lake] Record a file path storing log offsets in lake snapshot property (#2223)

luoyuxia
authored and
rionmonster
committed
[kv] Implement basic Aggregate Merge Engine (#2255)

authored and
rionmonster
committed
[hotfix]: Build expected results with partitions value, not hard coded value. (#2295)

SML0127
authored and
rionmonster
committed
[docs] update datatypes & paimon datatype mapping document (#2283)

Jackeyzhe
authored and
rionmonster
committed
[spark] support spark batch write (#2277)

YannByron
authored and
rionmonster
committed
[common] Introduce MAP type for ARROW, COMPACTED and INDEXED formats (#2190)

authored and
rionmonster
committed
[hotfix] Fix compile problem of InternalRow#getMap() interface in Spark connector

wuchong
authored and
rionmonster
committed
[hotfix] Fix spotless checkstyle problems

wuchong
authored and
rionmonster
committed
[lake/iceberg] Support tier array type for iceberg (#2266)

XuQianJin-Stars
authored and
rionmonster
committed
[hotfix] Fix compilation error: implement missing getMap method in IcebergArrayAsFlussArray (#2306)

XuQianJin-Stars
authored and
rionmonster
committed
[kv] Support to report rocksdb metrics (#2282)

platinumhamburg
authored and
rionmonster
committed
[docs] Move 'Merge Engine' to the top-level of 'Table Design' (#2300)

Aditya41150
authored and
rionmonster
committed
[spark] Add unit tests for spark SHOW TABLES command (#2304)

Yohahaha
authored and
rionmonster
committed
[docs] Document COMPACTED table format (#2264)

authored and
rionmonster
committed
[server] Not permitted to enable datalake for tables created prior to the cluster being set to datalake format (#2100)

LiebingYu
authored and
rionmonster
committed
[lake/paimon] Support map types for tiering paimon (#2308)

XuQianJin-Stars
authored and
rionmonster
committed
[server] Fix ConcurrentModificationException when access getTable concurrently (#2319)

LiebingYu
authored and
rionmonster
committed
[server] Servers with PERMANENT_OFFLINE tag are no longer assigned replicas (#1538)

LiebingYu
authored and
rionmonster
committed
[lake] fix potential dirty commit on re-create table (#2316)

zuston
authored and
rionmonster
committed
[hotfix] use ltz_millis as paimon system column for timestamp datatype (#2320)

luoyuxia
authored and
rionmonster
committed
[hotfix] Fix union read can't restore issue (#2321)

luoyuxia
authored and
rionmonster
committed
[server] Support generate and execute reblance plan (#1452)

swuferhong
authored and
rionmonster
committed
[common] Add field_id for Nested Row. (#2322)

loserwang1024
authored and
rionmonster
committed
[flink] Refactor CALL procedure "sys.xxx_cluster_config" to support multiple conifg keys (#2279)

sd4324530
authored and
rionmonster
committed
[hotfix] Fix the rebalance status cannot reach complete when the rebalance plan is empty (#2329)

swuferhong
authored and
rionmonster
committed
[docs] Add MAP type to data types and Paimon integration documentation (#2332)

XuQianJin-Stars
authored and
rionmonster
committed
[test] Add BucketingFunctionTest, this allows rust client side to also run the same test and ensures consistency. (#2274)

leekeiabstraction
authored and
rionmonster
committed
[lake/iceberg] Support nested row types for Iceberg tiering (#2278)

SML0127
authored and
rionmonster
committed
[hotfix] Add authentication for rebalance and controlled shutdown. (#2335)

LiebingYu
authored and
rionmonster
committed
[docs]: updated data type mapping in iceberg (#2336)

SML0127
authored and
rionmonster
committed
[NOTICE] Update copyright NOTICE year to 2026 (#2343)

wuchong
authored and
rionmonster
committed
[spark] Fix spark desc command output with partition info (#2313)

Yohahaha
authored and
rionmonster
committed
[kv] include hidden potential internal flush time in KV flush latency (#2206)

zuston
authored and
rionmonster
committed
[Task] Enhance tests for cluster rebalancing (#2315) (#2337)

Prajwal-banakar
authored and
rionmonster
committed
[docs] Add alter table feature link in getting-started.md (#2348)

swuferhong
authored and
rionmonster
committed
[hotfix] Add authentication to the admin APIs that currently lack it (#2350)

swuferhong
authored and
rionmonster
committed
[doc] fix typo of 'table.datalake.enabled' in options.md (#2366)

zhaomin1423
authored and
rionmonster
committed
[lake] Re-initial tiering splits for tables if reader failover happen (#1984)

beryllw
authored and
rionmonster
committed
[paimon] Add IT case for union read with evolved schema for Paimon (#2368)

ZuebeyirEser
authored and
rionmonster
committed
Rebalance procedure docs (#2355)

swuferhong
authored and
rionmonster
committed
[Flink] Support Partial Updates to the Flink Sink (#2042)

polyzos
authored and
rionmonster
committed
Change the ListRebalanceProcessProcedure result from String[] to row[] (#2341)

sd4324530
authored and
rionmonster
committed
[spark] Add Spark show/add/drop partition support (#2314)

Yohahaha
authored and
rionmonster
committed
[lake/lance] Refactor LanceArrowWriter to reuse fluss-common ArrowWriters (#2345)

XuQianJin-Stars
authored and
rionmonster
committed
[kv] Add basic implementation of AUTO_INCREMENT column (#2161)

beryllw
authored and
rionmonster
committed
[kv] Improve the implementation of AUTO_INCREMENT column

wuchong
authored and
rionmonster
committed
[server] Prevent remote log TTL expiration until tiering completes (#1940)

LiebingYu
authored and
rionmonster
committed
[spark] Add spark streaming write support (#2357)

Yohahaha
authored and
rionmonster
committed
Add RocksDB block cache configuration options for index and filter blocks (#2394)

platinumhamburg
authored and
rionmonster
committed
[test] Fix unstable test RebalanceITCase#testRebalanceForLogTable (#2407)

swuferhong
authored and
rionmonster
committed
[flink] Support PARTITION_DYNAMIC sink dynamic shuffle based on partition traffics (#1784)

loserwang1024
authored and
rionmonster
committed
[flink] Optimize sink statistics calculation to run only when necessary

wuchong
authored and
rionmonster
committed
[flink] Fix the distribution mode support for FlussSink for DataStream API

wuchong
authored and
rionmonster
committed
[tests] Cleanup ZK state in TableChangeWatcherTest to not let current tests be impacted by leftover events from previous tests. (#2249)

vamossagar12
authored and
rionmonster
committed
[hotfix] Fix union read fail when from timestamp and projection enabled (#2383)

luoyuxia
authored and
rionmonster
committed
[docs] Add docs for rebalance (#2382)

swuferhong
authored and
rionmonster
committed
[lake] Support alter table.datalake.freshness (#2365)

zhaomin1423
authored and
rionmonster
committed
[flink] Flink integration with Aggregation Merge Engine (#2307)

platinumhamburg
authored and
rionmonster
committed
[kv] Add roaring bitmap aggregate function for aggregation merge engine (#2390)

platinumhamburg
authored and
rionmonster
committed
[client] move OffsetsInitializer to fluss-client (#2424)

YannByron
authored and
rionmonster
committed
[hotfix] Catalog related lake options should overwrite table lake related options (#2432)

luoyuxia
authored and
rionmonster
committed
[test] Support manually trigger and wait for KV snapshots for FlussClusterExtension (#2429)

wuchong
authored and
rionmonster
committed
[spark] support batch read from fluss cluster (#2377)

YannByron
authored and
rionmonster
committed
[website] Update Fluss messaging (#2428)

polyzos
authored and
rionmonster
committed
[minor][flink] Remove unnecessary java notes (#2444)

leonardBang
authored and
rionmonster
committed
[docs] Add client feature support matrix documentation (#2445)

leekeiabstraction
authored and
rionmonster
committed
[lake] report pending records even though no tiering is finished (#2453)

luoyuxia
authored and
rionmonster
committed
[hotfix][helm] Update image repository to use 'apache/fluss' instead of 'fluss' (#2340)

morazow
authored and
rionmonster
committed
[coordinator] Refactor SchemaUpdate to delegate schema changes to Schema.Builder (#2416)

authored and
rionmonster
committed
[flink] changelog read support for pk table without pushdown optimizations (#2347)

authored and
rionmonster
committed
[lake] Make FlussLakeTiering pluggable to customize tiering job construct (#2364)

luoyuxia
authored and
rionmonster
committed
[server] Fix FirstRowMergeEngine hang caused by empty log entries in projection pushdown queries (#2370)

loserwang1024
authored and
rionmonster
committed
[server] Update tablet server metadata cache when TableRegistration changed (#2378)

LiebingYu
authored and
rionmonster
committed
[test] Fix failed testPkCompactedPollFromLatestNoRecords. (#2465)

SML0127
authored and
rionmonster
committed
[hotfix] Remove unstable "latest" scan startup mode test in ChangelogVirtualTableITCase (#2470)

wuchong
authored and
rionmonster
committed
[flink] changelog read support for log table without pushdown optimizations (#2467)

MehulBatra
authored and
rionmonster
committed
[helm] Remove `tablet-server.id` from coordinator configuration options (#2458)

morazow
authored and
rionmonster
committed
[test] Fix flaky AdjustIsrITCase#testIsrShrinkAndExpand by using acks=1 (#2468)

ZuebeyirEser
authored and
rionmonster
committed
[doc/website] virtual tables documentation - $changelog for PK/Log Tables (#2476)

authored and
rionmonster
committed
[test] Fix unstable test ReplicaTest.testRestore (#2469)

wuchong
authored and
rionmonster
committed
[spark] Add Spark SQL ALTER table support for set/remove table properties (#2437)

Yohahaha
authored and
rionmonster
committed
[hotfix] update messaging on github page (#2478)

polyzos
authored and
rionmonster
committed
[build] Upgrade GitHub Actions for Node 24 compatibility (#2349)

sd4324530
authored and
rionmonster
committed
[lake] Tiering service support commit by time (#2185)

luoyuxia
authored and
rionmonster
committed
[kv] Add Producer Offset Snapshot for Exactly-Once semantics (#2434)

platinumhamburg
authored and
rionmonster
committed
[hotfix] Fix unstable tiering source enumerator test (#2490)

luoyuxia
authored and
rionmonster
committed
[test] Add additional assertion to tests for TimestampLtz/Ntz to partition string conversion (#2481)

leekeiabstraction
authored and
rionmonster
committed
[fs/azure] Support Azure Blob Storage (#1941)

gkatzioura
authored and
rionmonster
committed
[flink] Fix Flink connector failure caused by unknown table options (#2431)

LiebingYu
authored and
rionmonster
committed
[spark] Add sparksql lake table catalog DDL suite for paimon (#2438)

Yohahaha
authored and
rionmonster
committed
[s3] fix the size of fluss-fs-s3 is too big (#2419)

sd4324530
authored and
rionmonster
committed