[GOBBLIN-1945] Implement Distributed Data Movement (DDM) Gobblin-on-Temporal `WorkUnit` evaluation#3816

Merged

Will-Lo merged 8 commits intoapache:masterfrom

phet:temporal-wu-eval

Nov 1, 2023

Commits on Nov 1, 2023

Implement Distributed Data Movement (DDM) Gobblin-on-Temporal `WorkUnit` evaluation
phet
committed
Adjust work unit processing tuning for start-to-close timeout and nested execution branching
phet
committed
Rework `ProcessWorkUnitImpl` and fix `FileSystem` misuse; plus convenience abstractions to load `FileSystem`, `JobState`, and `StateStore<TaskState>`
phet
committed
Fix `FileSystem` resource lifecycle, uniquely name each workflow, and drastically reduce worker concurrent task execution
phet
committed
Heed findbugs advice
phet
committed
prep before commit
phet
committed
Improve processing of required props
phet
committed
Update comment in response to PR feedback
phet
committed