HDDS-1391 : Add ability in OM to serve delta updates through an API.#1033
HDDS-1391 : Add ability in OM to serve delta updates through an API.#1033arp7 merged 10 commits intoapache:trunkfrom
Conversation
|
/label ozone |
|
💔 -1 overall
This message was automatically generated. |
|
💔 -1 overall
This message was automatically generated. |
hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/DataNotFoundException.java
Outdated
Show resolved
Hide resolved
|
|
||
| boolean flag = true; | ||
|
|
||
| while (transactionLogIterator.isValid()) { |
There was a problem hiding this comment.
Does this imply flush to sst can happen while iterating the log?
There was a problem hiding this comment.
yes, flushes can happen from memtables to SST anytime. If the WAL is deleted while it is being read, we will still be handle it through a retry mechanism from Recon side.
There was a problem hiding this comment.
So this means we need to at least configure the flushes defensively to maybe 3 * recon sync internal. Will that be a separate Jira or is already correctly configured?
|
💔 -1 overall
This message was automatically generated. |
|
💔 -1 overall
This message was automatically generated. |
|
+1 LGTM, needs rebase. |
|
💔 -1 overall
This message was automatically generated. |
|
💔 -1 overall
This message was automatically generated. |
|
@arp7 Can you please review/commit this PR? |
hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/DBUpdatesWrapper.java
Outdated
Show resolved
Hide resolved
hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/RDBStore.java
Outdated
Show resolved
Hide resolved
hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/RDBStore.java
Outdated
Show resolved
Hide resolved
hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/RDBStore.java
Outdated
Show resolved
Hide resolved
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/TestOzoneManager.java
Show resolved
Hide resolved
|
💔 -1 overall
This message was automatically generated. |
|
The test failures seem unrelated to the patch. |
|
+1 The failures look unrelated. |
Added an RPC end point to serve the set of updates in OM RocksDB from a given sequence number.
This will be used by Recon (HDDS-1105) to push the data to all the tasks that will keep their aggregate data up to date.