Spark 3.2: Allow disabling HiddenPathFilter in RemoveOrphansFiles#4307

Closed

ulmako wants to merge 15 commits intoapache:masterfrom

Commits on Mar 10, 2022

Spark 3.2: Add property to allow disabling HiddenPathFilter in RemoveOrphansFiles
ulmako
committed

Commits on Mar 14, 2022

Merge branch 'apache:master' into master
ulmako
authored
Spark 3.2: Use option to ignore hidden paths in DeleteOrphanFiles
ulmako
committed
Spark 3.2: Include IGNORE_HIDDEN_PATHS option to JavaDocs of BaseDeleteOrphanFilesSparkAction
ulmako
committed

Commits on Mar 15, 2022

Spark 3.2: Exclude paths that are part of the partition spec from HiddenPathFilter in DeleteOrphanFiles
ulmako
committed

Commits on Mar 17, 2022

Commits on Mar 22, 2022

Spark 3.2: Change Set creation to stream and add test for partition change
ulmako
committed

Commits on Apr 1, 2022

Commits on Apr 4, 2022

Spark 3.2: add waitUntilAfter method to remove orphan files test
ulmako
committed

Commits on Apr 5, 2022

Spark 3.2: Make code more readable in BaseDeleteOrphanFilesSparkAction.java
ulmako
committed

Commits on Apr 14, 2022

Spark 3.2: remove waiting time in TestRemoveOrphanFilesAction
ulmako
committed

Commits on Apr 25, 2022

Spark 3.2: change formatting
ulmako
committed

Commits on Apr 27, 2022

Spark 3.2: Move Javadoc to class
ulmako
authored