Skip to content

Tune JDBC fetch-size automatically based on column count#16643

Closed
findepi wants to merge 1 commit intotrinodb:masterfrom
findepi:findepi/auto-fetch-size-v2
Closed

Tune JDBC fetch-size automatically based on column count#16643
findepi wants to merge 1 commit intotrinodb:masterfrom
findepi:findepi/auto-fetch-size-v2

Conversation

@findepi
Copy link
Copy Markdown
Member

@findepi findepi commented Mar 21, 2023

PostgreSQL, Redshift and Oracle connectors had hard-coded fetch-size value of 1000. The value was found not to be optimal when server is far (high latency) or when number of columns selected is low. This commit improves in the latter case by picking fetch size automatically based on number of columns projected.

Fixes #16153
Alternative to #16269

PostgreSQL, Redshift and Oracle connectors had hard-coded fetch-size
value of 1000. The value was found not to be optimal when server is far
(high latency) or when number of columns selected is low. This commit
improves in the latter case by picking fetch size automatically based on
number of columns projected.
@cla-bot cla-bot bot added the cla-signed label Mar 21, 2023
@findepi findepi closed this Mar 21, 2023
@findepi findepi deleted the findepi/auto-fetch-size-v2 branch March 21, 2023 09:44
@findepi
Copy link
Copy Markdown
Member Author

findepi commented Mar 21, 2023

Resubmitted the PR #16644 differently, so that Redshift tests get exercised.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

Change FetchSize from 1k to 10k

1 participant