Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support specifying batch_size when submitting batch predict jobs #525

Closed
steve-marmalade opened this issue Jul 8, 2021 · 0 comments · Fixed by #1194
Closed

Support specifying batch_size when submitting batch predict jobs #525

steve-marmalade opened this issue Jul 8, 2021 · 0 comments · Fixed by #1194
Assignees
@jaycee-li
Labels
api: vertex-ai Issues related to the googleapis/python-aiplatform API. priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design.

Comments

@steve-marmalade
Copy link

steve-marmalade commented Jul 8, 2021 •
edited
Loading

The BatchPredictionJob REST API supports configuring the number of records sent to the machine replica in each batch via ManualBatchTuningParameters.

While ManualBatchTuningParameters is implemented in this library, I don't see any way to specify it when submitting a batch predict job.

Describe the solution you'd like

Add batch_size kwarg to models.Model.batch_predict and jobs.BatchPredictionJob.create and add it to the gapic_batch_prediction_job instance.
@product-auto-label product-auto-label bot added the api: aiplatform Issues related to the AI Platform API. label Jul 8, 2021
@yoshi-automation yoshi-automation added 🚨 This issue needs some love. triage me I really want to be triaged. labels Jul 13, 2021
@vinnysenthil vinnysenthil self-assigned this Jul 20, 2021
@vinnysenthil vinnysenthil added priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design. and removed 🚨 This issue needs some love. triage me I really want to be triaged. labels Oct 1, 2021
@morgandu morgandu removed their assignment Mar 30, 2022
@morgandu morgandu self-assigned this Apr 12, 2022
@jaycee-li jaycee-li self-assigned this May 2, 2022
@jaycee-li jaycee-li mentioned this issue May 4, 2022
Merged
@product-auto-label product-auto-label bot added api: vertex-ai Issues related to the googleapis/python-aiplatform API. and removed api: aiplatform Issues related to the AI Platform API. labels May 5, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jaycee-li jaycee-li

Labels
api: vertex-ai Issues related to the googleapis/python-aiplatform API. priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Feat: add batch_size kwarg for batch prediction jobs jaycee-li/python-aiplatform
5 participants
@morgandu @vinnysenthil @yoshi-automation @steve-marmalade @jaycee-li