[EPIC] Redesign the modeling module with DataFusion and Rust

[goldmedal]

Description

Our goal is redesigning the modeling part of Wren Engine using DataFusion. Make it be more portable and composable. With DataFusion at the helm, we expect to deliver full SQL support an query planning.

Todo Lists

• Model
  • TableReference Redesign Modeling Module in Rust and DataFusion #570
  • ReferSql
  • Fix the format of TableReference #591
• Column
  • Expression Redesign Modeling Module in Rust and DataFusion #570
  • Calculated Field
• Relationship
  • MDL Lineage Introduce MDL lineage analysis #588
  • Relationship Column Introduce the TO_ONE relationship used by the calculated field #595
  • Used by Calculated Field
    • TO_ONE Introduce the TO_ONE relationship used by the calculated field #595 Fix the to_one relationship and enhance the testing #613
    • TO_MANY
    • Use the calculated field in another related model Allow to invoke a calculation belong to another models #676
• View
  • Query View Introduce the View of MDL #645
  • Cycling View Check Introduce the View of MDL #645
• Macro (https://docs.rs/minijinja/latest/minijinja/)
• Python API (PyO3)
  • Make ibis server be a mixed rust/python project #614
• CI workflow (We can follow how DataFusion do it)
  • Cargo Build Test
  • Unit test
  • Cargo fmt check
  • Cargo clippy check
  • e2e test Add sqllogictest for modeling-rs end-to-end test #604
• type enhancement Mapping WrenType to ArrowType #590

[goldmedal]

All tickets have been finished. The beta version will be released soon.