[SPARK-40474][SQL] Correct CSV schema inference and data parsing behavior on columns with mixed dates and timestamps#37933

Closed

xiaonanyang-db wants to merge 27 commits intoapache:masterfrom

xiaonanyang-db:SPARK-40474

Commits on Sep 19, 2022

SPARK-40474 Infer columns with mixed date and timestamp as String in CSV schema inference
xiaonanyang-db
committed
[SPARK-40474] remove unused imports
xiaonanyang-db
committed
[SPARK-40474] Resolve test failures
xiaonanyang-db
committed

Commits on Sep 23, 2022

[SPARK-40474] revert code causing behavior change
xiaonanyang-db
committed
[SPARK-40474] revert changes
xiaonanyang-db
committed
SPARK-40474 reduce diff
xiaonanyang-db
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[SPARK-40474][SQL] Correct CSV schema inference and data parsing behavior on columns with mixed dates and timestamps#37933

[SPARK-40474][SQL] Correct CSV schema inference and data parsing behavior on columns with mixed dates and timestamps#37933
xiaonanyang-db wants to merge 27 commits intoapache:masterfrom
xiaonanyang-db:SPARK-40474

Commits on Sep 19, 2022

SPARK-40474 Infer columns with mixed date and timestamp as String in CSV schema inference

[SPARK-40474] remove unused imports

[SPARK-40474] Resolve test failures

Commits on Sep 20, 2022

[SPARK-40474] fix test failures

[SPARK-40474] handle edge cases

[SPARK-40474] handle edge cases

SPARK-40474 revert part of CSVOptions changes

SPARK-40474 revert part of CSVOptions changes

[SPARK-40474] fix test failures

Commits on Sep 21, 2022

[SPARK-40474] handle columns with mixing dates and timestamps inference properly when lenient timestamp formatter is used

[SPARK-40474] remove unnecessary changes

[SPARK-40474] small changes

Merge remote-tracking branch 'origin' into SPARK-40474

[SPARK-40474] remove new line added by mistake

[SPARK-40474] address comments

[SPARK-40474] small changes

[SPARK-40474] fix test failures

Commits on Sep 22, 2022

[SPARK-40474] address review comments

[SPARK-40474] fix test failures

[SPARK-40474] update doc

[SPARK-40474] disable prefersDate when leagcyTimeParser is enabled

[SPARK-40474] fix test failures

[SPARK-40474] fix test failures

[SPARK-40474] fix tests

Commits on Sep 23, 2022

[SPARK-40474] revert code causing behavior change

[SPARK-40474] revert changes

SPARK-40474 reduce diff

[SPARK-40474][SQL] Correct CSV schema inference and data parsing behavior on columns with mixed dates and timestamps#37933xiaonanyang-db wants to merge 27 commits intoapache:masterapache/spark:masterfrom xiaonanyang-db:SPARK-40474xiaonanyang-db/spark:SPARK-40474Copy head branch name to clipboard

Commits

Commits on Sep 19, 2022

Commits on Sep 20, 2022

Commits on Sep 21, 2022

Commits on Sep 22, 2022

Commits on Sep 23, 2022

[SPARK-40474][SQL] Correct CSV schema inference and data parsing behavior on columns with mixed dates and timestamps#37933
xiaonanyang-db wants to merge 27 commits intoapache:masterfrom
xiaonanyang-db:SPARK-40474