Actorpool progress bar

[ayushdg]

Description

• Adds a progress bar using TQDM for actor pool workflows (regular tasks + shuffle inserts).
• Doesn't cover extract & write or insert finished since they aren't typically map style tasks.
• Helpful for long running deduplication jobs where progress isn't obvious without the dashboard. The ray dashboard also seems to have a limit of 10000 tasks for map_unordered.

Usage

# Add snippet demonstrating usage

Checklist

• I am familiar with the Contributing Guide.
• New or Existing tests cover these changes.
• The documentation is up to date with these changes.

[greptile-apps]

_{1 file reviewed, 2 comments}

_{Edit Code Review Agent Settings | Greptile}

[greptile-apps]

[P1] tqdm import may not be declared dependency for this backend

This adds from tqdm import tqdm, but if tqdm isn’t in this repo’s declared runtime deps for the experimental ray actor pool backend, users will hit ModuleNotFoundError at import time. Consider either adding tqdm to the appropriate dependency set, or making the progress bar optional via a lazy import / fallback when show_progress=True.

[greptile-apps]

[P2] progress_interval accepts invalid values

tqdm(..., mininterval=self.progress_interval) will raise or behave unexpectedly if progress_interval is <= 0 or non-finite. Since this is a public constructor arg, it’s worth either validating it (e.g., > 0) or documenting constraints.

[greptile-apps]

_{1 file reviewed, no comments}

_{Edit Code Review Agent Settings | Greptile}

[greptile-apps]

_{1 file reviewed, no comments}

_{Edit Code Review Agent Settings | Greptile}