Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bypass 8MB limit to allow file to be uploaded in single request #1273

Open
nitishxp opened this issue May 11, 2024 · 1 comment
Open

Bypass 8MB limit to allow file to be uploaded in single request #1273

nitishxp opened this issue May 11, 2024 · 1 comment
Assignees
Labels
api: storage Issues related to the googleapis/python-storage API. priority: p3 Desirable enhancement or fix. May not be included in next release. type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design.

Comments

@nitishxp
Copy link

Hi Team,

I am using the cloud function to upload the file to GCS, I am finding latency to upload the file due to so many resumable API calls being made, the file size is approx between 100-300 MB,

The Google doc suggests [1] that if the internet is good we can have large size of files that can be uploaded in a single request
but in [2] the python lib has put a cap of 8MB when using this approach.

Since we live in fast internet time can we have this limit added as parameters rather than making hardcode in the code?

[1] https://cloud.google.com/storage/docs/uploads-downloads#size
[2] https://cloud.google.com/storage/docs/resumable-uploads#client-libraries
[3] https://issuetracker.google.com/issues/339567442

@product-auto-label product-auto-label bot added the api: storage Issues related to the googleapis/python-storage API. label May 11, 2024
@vishwarajanand vishwarajanand added type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design. priority: p3 Desirable enhancement or fix. May not be included in next release. labels May 11, 2024
@cojenco
Copy link
Contributor

cojenco commented May 16, 2024

Thank you for the feature request. We're already tracking this internally on our roadmap and will provide an update when one is available.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: storage Issues related to the googleapis/python-storage API. priority: p3 Desirable enhancement or fix. May not be included in next release. type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design.
Projects
None yet
Development

No branches or pull requests

3 participants