-
Notifications
You must be signed in to change notification settings - Fork 89
Closed
Labels
api: bigquerystorageIssues related to the googleapis/java-bigquerystorage API.Issues related to the googleapis/java-bigquerystorage API.priority: p2Moderately-important priority. Fix may not be included in next release.Moderately-important priority. Fix may not be included in next release.type: bugError or flaw in code with unintended results or allowing sub-optimal usage patterns.Error or flaw in code with unintended results or allowing sub-optimal usage patterns.
Description
Thanks for stopping by to let us know something could be better!
Environment details
- Specify the API at the beginning of the title. For example, "BigQuery: ..."): BigQuery
- OS type and version: ALL
- Java version: ALL
- version(s): Latest 2.41.0
Steps to reproduce
- Using Spark BigQuery connector
- Write a huge dataset to BigQuery
- Debug why it's super slow, the workers are waiting in
com.google.cloud.bigquery.storage.v1.ConnectionWorker#calculateSleepTimeMilli
Looking at the code, the retry steps are too aggressive (1 milliseconds, 2 milliseconds, ..., 60 seconds), I suspect this is a bug and it was not intended to be this aggressive when retrying (the first 7 retries will happen in less than 256 milliseconds!)
Metadata
Metadata
Assignees
Labels
api: bigquerystorageIssues related to the googleapis/java-bigquerystorage API.Issues related to the googleapis/java-bigquerystorage API.priority: p2Moderately-important priority. Fix may not be included in next release.Moderately-important priority. Fix may not be included in next release.type: bugError or flaw in code with unintended results or allowing sub-optimal usage patterns.Error or flaw in code with unintended results or allowing sub-optimal usage patterns.