Timestamp millis repair#14120

Closed

yihua wants to merge 29 commits intoapache:masterfrom

jonvex:timestamp_millis_repair

Commits on Oct 16, 2025

current progress
Jonathan Vexler
committed

Commits on Oct 17, 2025

seems to be working for spark non vectorized and avro
Jonathan Vexler
committed
filters working
Jonathan Vexler
committed
prevent overflow
Jonathan Vexler
committed

Commits on Oct 20, 2025

use read support instead of mapping function
Jonathan Vexler
committed
use repaired schema instead of doing operations after we read the data
Jonathan Vexler
committed
add spark log support
Jonathan Vexler
committed
remove find cols to multiply class
Jonathan Vexler
committed

Commits on Oct 21, 2025

log file changes as requested and set up the read supports for spark and avro
Jonathan Vexler
committed
hive working
Jonathan Vexler
committed

Commits on Oct 22, 2025

add individual test and fix issue with dropping messagetype logical
Jonathan Vexler
committed
revert calls for rewrite avro with extra param
Jonathan Vexler
committed
revert config to prevent timestamp evolutions
Jonathan Vexler
committed
A few fixes
Jonathan Vexler
committed
fix bug with field reuse in avro schema repair
Jonathan Vexler
committed
fix read parquet log block timestamp ntz
Jonathan Vexler
committed
allow long to timestampntz without cast
Jonathan Vexler
committed

Commits on Oct 23, 2025

refactor AvroSchemaRepair for performance and add unit tests
Jonathan Vexler
committed
refactor schema repair for performance and add testing
Jonathan Vexler
committed
try fix other spark versions
Jonathan Vexler
committed

Commits on Oct 24, 2025

fix spark 3.3 build
Jonathan Vexler
committed
fix spark3.4 build
Jonathan Vexler
committed
hopefully fix spark4
Jonathan Vexler
committed
fix issue with union schema, add table schema to cdc in missing place
Jonathan Vexler
committed
add spark cow read testing for repair
Jonathan Vexler
committed
building, and add spark mor tests
Jonathan Vexler
committed
forgot to add the zips
Jonathan Vexler
committed

Commits on Oct 25, 2025

cow write testing
Jonathan Vexler
committed
add mor testing
Jonathan Vexler
committed