HDDS-8047. [hsync] Make Putblock performance acceptable #5628
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Change-Id: I3f83695dab9441887f004e15cb6825229f01fb15 (cherry picked from commit 560eab7)
Change-Id: Ic4bea8a76071c20cea273fef78065541506147b1 (cherry picked from commit b196ab2)
Change-Id: Iae1aa5b0fbe69d2028b92891687829438fa646d4
Change-Id: Ib413c284911f50ecdc741dc35a4b3234271c0daf
Change-Id: Ie1d31c96d121f54fd3fde2530169099900513f7d
Change-Id: If2a40db0dbc9e82bc13e150ef7e666f46c35b714
Change-Id: Ia6eddc7ac8203c29b2f6444c01c67431d3e9111a
Change-Id: I896bc0a7aae65293cb72b3f20797ccbed2df457c
Change-Id: I7ba56a16071c7f51ebc2eaa87bb956eed14e3fb8
Change-Id: I9e2a0acd0a5e174f3087de47d8edfdf2520c15e1
Change-Id: I46859d6f7b4846948a790d0e55d50ec74f2851e0
Change-Id: Ife865a2509160f9263c2402d1476db3f874c1051
Change-Id: I45e68b52de65f8db8654a5d322305dd134e7215d
Change-Id: I90c477b557ca0f699fb420c1b6764c6bdb6c20b2
Contributor
|
@ChenSammi can you please take a look? |
Contributor
|
@jojochuang I assume this PR is split into #5662 and #5663. If so, can we close this? |
Contributor
Author
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What changes were proposed in this pull request?
HDDS-8047. [hsync] Make Putblock performance acceptable
Please describe your PR in detail:
Merge small, incomplete chunks in order to reduce metadata overhead.
Preliminary write-only ycsb benchmarks shows it improves HBase throughput by 3-4x.
This is a draft. I'll split it up into several smaller ones. Will also attach the design doc for review later.
What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-8047
How was this patch tested?
Additional unit tests, ran freon test and ycsb tests.