Add pinned_max_pool_size and unbounded_file_read_cache to StreamingOptions

[madsbk]

Description

• Expose two RapidsMPF options:
  • pinned_max_pool_size (RAPIDSMPF_PINNED_MAX_POOL_SIZE)
  • unbounded_file_read_cache (RAPIDSMPF_UNBOUNDED_FILE_READ_CACHE)

[coderabbitai]

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: a5c7769a-0360-48a6-a392-d1f0a28c9cce

📥 Commits

Reviewing files that changed from the base of the PR and between 9a85bda and d33b398.

📒 Files selected for processing (2)

• python/cudf_polars/cudf_polars/experimental/rapidsmpf/frontend/options.py
• python/cudf_polars/tests/experimental/test_options.py

---

📝 Walkthrough

Summary by CodeRabbit

• New Features

  • Added two new RapidsMPF configuration parameters: pinned-max-pool-size and unbounded-file-read-cache
  • Both parameters are now configurable via command-line arguments and environment variables
  • Parameters default to unspecified when not explicitly provided

• Tests

  • Added test coverage for new configuration options and environment variable support

Walkthrough

Added pinned_max_pool_size and unbounded_file_read_cache configuration fields to StreamingOptions with environment variable support, CLI argument wiring, and test coverage for serialization, env var resolution, and argparse parsing.

Changes

RapidsMPF Configuration Fields Addition

Layer / File(s)	Summary
Field definitions and CLI wiring python/cudf_polars/cudf_polars/experimental/rapidsmpf/frontend/options.py	Extended StreamingOptions dataclass with pinned_max_pool_size and unbounded_file_read_cache fields, added docstrings documenting env vars and defaults, updated _from_argparse to extract these fields from the CLI namespace, and added --pinned-max-pool-size and --unbounded-file-read-cache CLI argument definitions.
Test coverage for new configuration fields python/cudf_polars/tests/experimental/test_options.py	Updated serialization test to include the new fields and added tests for environment variable resolution (RAPIDSMPF_PINNED_MAX_POOL_SIZE and RAPIDSMPF_UNBOUNDED_FILE_READ_CACHE), and extended CLI roundtrip test to verify argparse integration of the new arguments.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~12 minutes

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name	Status	Explanation	Resolution
Docstring Coverage	⚠️ Warning	Docstring coverage is 25.00% which is insufficient. The required threshold is 80.00%.	Write docstrings for the functions missing them to satisfy the coverage threshold.

✅ Passed checks (4 passed)

Check name	Status	Explanation
Title check	✅ Passed	The title directly and clearly describes the main change: adding two new configuration options to StreamingOptions.
Description check	✅ Passed	The description is directly related to the changeset, explaining which RapidsMPF options are being exposed and their corresponding environment variables.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

Warning

Review ran into problems

🔥 Problems

Stopped waiting for pipeline failures after 30000ms. One of your pipelines takes longer than our 30000ms fetch window to run, so review may not consider pipeline-failure results for inline comments if any failures occurred after the fetch window. Increase the timeout if you want to wait longer or run a @coderabbit review after the pipeline has finished.

---

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[madsbk]

/merge