feat(datafusion): implement the partitioning node for DataFusion to define the partitioning#1620

Merged

liurenjie1024 merged 11 commits intoapache:mainfrom

fvaleye:feature/implement-repartition-node-for-insert-into-datafusion

Oct 31, 2025

Commits on Oct 28, 2025

feat(datafusion): implement repartition node for DataFusion, setting the best partition strategy for Iceberg for writing
fvaleye
committed
feat(datafusion): remove spark-specific distribution-mode, use round-robin for range partitions
fvaleye
committed
feat(datafusion): adapt the repartition to determine only the best partitioning strategy
fvaleye
committed
feat(datafusion): remove sort order from partition strategy and remove unused parameters
fvaleye
committed
feat(datafusion): adapt repartition to use project new _partition column
fvaleye
committed
feat(datafusion): change visibility of repartition and adapt the partitioning strategy logic
fvaleye
committed
feat(datafusion): simplify repartition by being only integrated in DataFusion plan and requiring the _partition column
fvaleye
committed
Merge branch 'main' into feature/implement-repartition-node-for-insert-into-datafusion
fvaleye
authored

Commits on Oct 29, 2025

Merge branch 'main' into feature/implement-repartition-node-for-insert-into-datafusion
fvaleye
authored

Commits on Oct 31, 2025