Skip to content

Improve some default config values of fault-tolerant execution#12646

Merged
arhimondr merged 1 commit intotrinodb:masterfrom
linzebing:tardigrade-configs
Jun 9, 2022
Merged

Improve some default config values of fault-tolerant execution#12646
arhimondr merged 1 commit intotrinodb:masterfrom
linzebing:tardigrade-configs

Conversation

@linzebing
Copy link
Copy Markdown
Member

@linzebing linzebing commented Jun 2, 2022

Description

Is this change a fix, improvement, new feature, refactoring, or other?

Improvement

Is this a change to the core query engine, a connector, client library, or the SPI interfaces? (be specific)

Configs

How would you describe this change to a non-technical end user or system administrator?

The new values were found better during our testing of batch workloads.

Related issues, pull requests, and links

Documentation

() No documentation is needed.
(x) Sufficient documentation is included in this PR.
( ) Documentation PR is available with #prnumber.
( ) Documentation issue #issuenumber is filed, and can be handled later.

Release notes

() No release notes entries required.
(x) Release notes entries required with the following suggested text:

# Section
* Improve execution performance by updating default values for configuration options related to task sizing 
when fault-tolerant execution is used (`retry_mode` is set to `TASK`).

@cla-bot cla-bot bot added the cla-signed label Jun 2, 2022
@linzebing linzebing requested review from arhimondr and losipiuk June 2, 2022 00:12
@github-actions github-actions bot added the docs label Jun 2, 2022
@linzebing linzebing force-pushed the tardigrade-configs branch from d89ead0 to 5137ef0 Compare June 2, 2022 01:07
// enforced against user + system memory allocations (default is maxQueryMemory * 2)
private DataSize maxQueryTotalMemory;
private DataSize faultTolerantExecutionTaskMemory = DataSize.of(4, GIGABYTE);
private DataSize faultTolerantExecutionTaskMemory = DataSize.of(5, GIGABYTE);
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what a weird base. Maybe 8? ;)

Copy link
Copy Markdown
Member Author

@linzebing linzebing Jun 2, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Copy Markdown
Member

@losipiuk losipiuk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

Maybe put sth for the release notes. Maybe sth like:

Improve execution performance by updating default values 
for configuration options related to task sizing 
when fault-tolerant execution is used (`retry_mode` is set to `TASK`).

@arhimondr arhimondr merged commit 99ff1c6 into trinodb:master Jun 9, 2022
@github-actions github-actions bot added this to the 386 milestone Jun 9, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

3 participants