Allow local packages in requirements.txt dependency list.

[robertwb]

We pull these out and install them with the extra local packages infrastructure.

---

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

• Choose reviewer(s) and mention them in a comment (R: @username).
• Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
• Update CHANGES.md with noteworthy changes.
• If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI.

[robertwb]

R: @chamikaramj

[github-actions]

Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control

[codecov]

Codecov Report

Merging #23684 (77dd157) into master (a138a4f) will increase coverage by 0.00%.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##           master   #23684   +/-   ##
=======================================
  Coverage   73.17%   73.17%           
=======================================
  Files         720      720           
  Lines       96044    96076   +32     
=======================================
+ Hits        70277    70305   +28     
- Misses      24455    24459    +4     
  Partials     1312     1312           

Flag	Coverage Δ
python	82.94% <100.00%> (+<0.01%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
...s/python/apache_beam/runners/portability/stager.py	86.27% <100.00%> (+0.72%)	⬆️
sdks/python/apache_beam/internal/gcp/auth.py	79.16% <0.00%> (-3.70%)	⬇️
.../python/apache_beam/transforms/periodicsequence.py	98.38% <0.00%> (-1.62%)	⬇️
sdks/python/apache_beam/runners/direct/executor.py	96.46% <0.00%> (-0.55%)	⬇️
...hon/apache_beam/runners/worker/bundle_processor.py	93.30% <0.00%> (-0.38%)	⬇️
sdks/python/apache_beam/io/gcp/gcsio.py	92.12% <0.00%> (-0.14%)	⬇️
sdks/python/apache_beam/runners/common.py	88.59% <0.00%> (-0.13%)	⬇️
sdks/python/apache_beam/io/gcp/bigquery.py	71.34% <0.00%> (+0.03%)	⬆️
...on/apache_beam/runners/dataflow/dataflow_runner.py	80.80% <0.00%> (+0.13%)	⬆️
...ks/python/apache_beam/runners/worker/sdk_worker.py	89.24% <0.00%> (+0.16%)	⬆️
... and 4 more

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

[AnandInguva]

How is this different from using --extra_package?

[robertwb]

Because the user can place these directly inside their requirements file rather than listing them individually. This is particularly valuable for cross-language, or where one wants to keep the construction-time and execution-time environments in sync via a single file.

[AnandInguva]

Because the user can place these directly inside their requirements file rather than listing them individually. This is particularly valuable for cross-language, or where one wants to keep the construction-time and execution-time environments in sync via a single file.

Do we want to update the documentation to reflect this change? https://beam.apache.org/documentation/sdks/python-pipeline-dependencies/

[robertwb]

Failure due to #21104

[robertwb]

Run Python PreCommit

[robertwb]

Run Python_PVR_Flink PreCommit

[robertwb]

Good call. Updated the docs.

[chamikaramj]

Can we also add a unit test for this feature ?

[robertwb]

Done.

[AnandInguva]

cc : @tvalentyn

[chamikaramj]

LGTM. Thanks.