-
Notifications
You must be signed in to change notification settings - Fork 417
Closed
Labels
api: vertex-aiIssues related to the googleapis/python-aiplatform API.Issues related to the googleapis/python-aiplatform API.priority: p1Important issue which blocks shipping the next release. Will be fixed prior to next release.Important issue which blocks shipping the next release. Will be fixed prior to next release.type: feature request‘Nice-to-have’ improvement, new feature or different behavior or design.‘Nice-to-have’ improvement, new feature or different behavior or design.
Description
The BatchPredictionJob REST API supports configuring the number of records sent to the machine replica in each batch via ManualBatchTuningParameters.
While ManualBatchTuningParameters is implemented in this library, I don't see any way to specify it when submitting a batch predict job.
Describe the solution you'd like
Add batch_size kwarg to models.Model.batch_predict and jobs.BatchPredictionJob.create and add it to the gapic_batch_prediction_job instance.
rlucioni
Metadata
Metadata
Assignees
Labels
api: vertex-aiIssues related to the googleapis/python-aiplatform API.Issues related to the googleapis/python-aiplatform API.priority: p1Important issue which blocks shipping the next release. Will be fixed prior to next release.Important issue which blocks shipping the next release. Will be fixed prior to next release.type: feature request‘Nice-to-have’ improvement, new feature or different behavior or design.‘Nice-to-have’ improvement, new feature or different behavior or design.