Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Split Beam Python base image into a 'slim' version and 'regular/extended' version #20605

Open
damccorm opened this issue Jun 4, 2022 · 1 comment

Comments

@damccorm
Copy link
Contributor

damccorm commented Jun 4, 2022

Beam container image includes several dependencies that are not essential to Beam, but may be commonly used by some users. Some dependencies may be relevant only for particular runners.

Installing dependencies in Beam containers increases image size. For example, installing TensorFlow adds ~1G or so of space into the unpacked image.

Some Beam users may be size conscious, and would prefer an image with minimal dependencies.

Some Beam users and Beam runner maintainers may prefer an image that includes additional dependencies. These extended images may provide better user experience in some scenarios, but the overall image would be larger.

We should consider splitting beam image into slim and regular version to accommodate these different usage scenarios.

Imported from Jira BEAM-11166. Original Jira may contain additional context.
Reported by: tvalentyn.

@raghu5910
Copy link

raghu5910 commented Oct 12, 2023

Glad that you guys removed tf from dependencies ( release 2.51.0). Till now i am using custom built image to avoid tensorflow.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants