Add docs for 'use-preferred-write-partitioning'#7043
Merged
sopel39 merged 1 commit intotrinodb:masterfrom Mar 2, 2021
Merged
Conversation
sopel39
reviewed
Feb 26, 2021
Member
There was a problem hiding this comment.
Also add:
As a result, for some connectors (e.g Hive) a single new file per partition will be created instead of multiple ones. Partition writer assignments are distributed across worker nodes.
skrzypo987
force-pushed
the
skrzypo/020-preferred-partitioning-docs
branch
from
17c6b80 to
3e88c72
Compare
sopel39
approved these changes
Feb 26, 2021
mosabua
reviewed
Feb 27, 2021
Member
There was a problem hiding this comment.
Avoid future tense, commas and such .. how about something like this
Enable preferred write partitioning. When set to ``true`` each partition is written be a separate writer. As a result, for some connectors such as the Hive connector, only a single new file is written per partition, instead of multiple files. Partition writer assignments are distributed across worker nodes for parallel processing.
mosabua
requested changes
Feb 27, 2021
Member
mosabua
left a comment
mosabua
left a comment
There was a problem hiding this comment.
I propose an improve, and hopefully correct version. Please take all of it or parts into account .
skrzypo987
force-pushed
the
skrzypo/020-preferred-partitioning-docs
branch
from
3e88c72 to
60db37c
Compare
Member
Author
|
Redacted (copy-pasted) according to @mosabua remarks |
skrzypo987
force-pushed
the
skrzypo/020-preferred-partitioning-docs
branch
from
60db37c to
9d6fa79
Compare
mosabua
approved these changes
Mar 1, 2021
sopel39
approved these changes
Mar 2, 2021
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.