Skip to content

Avoid using futures to collect DFs on workers#12801

Merged
arhimondr merged 1 commit intotrinodb:masterfrom
raunaqmorarka:remove-future
Jun 16, 2022
Merged

Avoid using futures to collect DFs on workers#12801
arhimondr merged 1 commit intotrinodb:masterfrom
raunaqmorarka:remove-future

Conversation

@raunaqmorarka
Copy link
Copy Markdown
Member

@raunaqmorarka raunaqmorarka commented Jun 10, 2022

For collecting DFs for fault tolerant execution it is necessary
to update the final version of dynamic filters in DynamicFiltersCollector
before completion of the task. This ensures that the coordinator will be
aware about the need to fetch dynamic filters from a worker even after
the task has finished running.

Documentation

(x) No documentation is needed.
( ) Sufficient documentation is included in this PR.
( ) Documentation PR is available with #prnumber.
( ) Documentation issue #issuenumber is filed, and can be handled later.

Release notes

(x) No release notes entries required.
( ) Release notes entries required with the following suggested text:

@electrum
Copy link
Copy Markdown
Member

Nit: the description wrapping seems quite narrow

For collecting DFs for fault tolerant execution it is necessary
to update the final version of dynamic filters in DynamicFiltersCollector
before completion of the task. This ensures that the coordinator will be
aware about the need to fetch dynamic filters from a worker even after
the task has finished running.
@raunaqmorarka
Copy link
Copy Markdown
Member Author

I've run TPC benchmarks and verified that there's no significant changes in results.

@arhimondr arhimondr merged commit 8935a09 into trinodb:master Jun 16, 2022
@github-actions github-actions bot added this to the 387 milestone Jun 16, 2022
@raunaqmorarka raunaqmorarka deleted the remove-future branch February 13, 2023 03:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

3 participants