HBase-28001: Backport #6245
Closed
HBase-28001: Backport #6245
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Andrew Purtell <[email protected]> (cherry picked from commit ced1d64)
…rvlet.java (apache#4816) Signed-off-by: Wellington Chevreuil <[email protected]>
…t cache writers queue by introducing wait time - addendum added mistakenly removed in-memory flag
Signed-off-by: Andrew Purtell <[email protected]> (cherry picked from commit 63cdd02) Conflicts: hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java hbase-client/src/main/java/org/apache/hadoop/hbase/HRegionLocation.java hbase-client/src/main/java/org/apache/hadoop/hbase/client/Append.java hbase-client/src/main/java/org/apache/hadoop/hbase/client/Mutation.java hbase-client/src/main/java/org/apache/hadoop/hbase/client/Scan.java hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueExcludeFilter.java hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueFilter.java hbase-client/src/main/java/org/apache/hadoop/hbase/security/visibility/VisibilityClient.java hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/RequestConverter.java hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestReplication.java hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteTable.java hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManager.java hbase-server/src/main/java/org/apache/hadoop/hbase/HBaseServerBase.java hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java hbase-server/src/main/java/org/apache/hadoop/hbase/mob/MobUtils.java hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/flush/RegionServerFlushTableProcedureManager.java hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Region.java hbase-server/src/main/java/org/apache/hadoop/hbase/replication/HBaseReplicationEndpoint.java hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/MetricsSource.java hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtil.java hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestBulkLoadHFilesSplitRecovery.java hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftUtilities.java
(cherry picked from commit 4b45256)
Signed-off-by: Duo Zhang <[email protected]> Signed-off-by: Nick Dimiduk <[email protected]>
Signed-off-by: Andrew Purtell <[email protected]> (cherry picked from commit 79f853e)
Jettison versions <= 1.5.0 are subject to CVE-2022-40149 and CVE-2022-40150. Move jettison.version to 1.5.1. Signed-off-by: Duo Zhang <[email protected]>
…rver (apache#4823) Include the remote server name in the logged exception message when the connection setup fails in BlockingRpcConnection. Add an equivalent log line in NettyRpcConnection. Signed-off-by: Viraj Jasani <[email protected]> Conflicts: hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcConnection.java
…ter (apache#4819) Signed-off-by: Andrew Purtell <[email protected]> Signed-off-by: Viraj Jasani <[email protected]> Co-authored-by: Sanjeet Malhotra <[email protected]>
…e unhelpful javadoc stubs' rule (apache#4824) Signed-off-by: Xiaolin Ha <[email protected]> (cherry picked from commit 0d260f5)
…ster connection (apache#2514) (apache#4826) Co-authored-by: Ankit Singhal <[email protected]> Signed-off-by: Xiaolin Ha <[email protected]>
…nd RELEASENOTES.md Signed-off-by: Andrew Purtell <[email protected]>
Signed-off-by: Andrew Purtell <[email protected]>
…ster connection (apache#2514) (apache#4826) Co-authored-by: Ankit Singhal <[email protected]> Signed-off-by: Xiaolin Ha <[email protected]> (cherry picked from commit 66873ca)
Backport HBASE-25166: MobFileCompactionChore is closing the master's shared cluster connection
Signed-off-by: Duo Zhang <[email protected]>
Signed-off-by: Andrew Purtell <[email protected]>
apache#4829) Signed-off-by: Andrew Purtell <[email protected]> Signed-off-by: Viraj Jasani <[email protected]> Co-authored-by: Victor Li <[email protected]>
…he#4830) Signed-off-by: Andrew Purtell <[email protected]>
…nd RELEASENOTES.md Signed-off-by: Andrew Purtell <[email protected]>
Signed-off-by: Andrew Purtell <[email protected]>
Signed-off-by: Peter Somogyi <[email protected]> Signed-off-by: Duo Zhang <[email protected]> (cherry picked from commit c8e2d80)
…ly when compaction is failed (apache#4840)
…it easier to control the version from command line (apache#4836) Signed-off-by: GeorryHuang <[email protected]> (cherry picked from commit 2fc879e)
…che#4838) Signed-off-by: Duo Zhang <[email protected]> (cherry picked from commit d187f69)
Signed-off-by: Nick Dimiduk <[email protected]> (cherry picked from commit 792f12b)
…#4852) Signed-off-by: Duo Zhang <[email protected]> (cherry picked from commit d9713bf)
…ting report (apache#4848) Signed-off-by: Guanghao Zhang <[email protected]> (cherry picked from commit d800536)
Signed-off-by: Guanghao Zhang <[email protected]> (cherry picked from commit cdabfd3)
…ed (apache#5713) Signed-off-by: Bryan Beaudreault <[email protected]>
…frequently (apache#5686) (#83) Signed-off-by: Bryan Beaudreault <[email protected]>
Co-authored-by: Ray Mattingly <[email protected]>
…che#5768) Signed-off-by: Bryan Beaudreault <[email protected]>
… for the same timestamp is in different hfiles (apache#5775) Signed-off-by: Nick Dimiduk <[email protected]> Signed-off-by: Duo Zhang <[email protected]>
…ntal backup restore (apache#5776) Contributed-by: Ruben Van Wanzeele <[email protected]> Signed-off-by: Bryan Beaudreault <[email protected]>
…ter (#85) Co-authored-by: Johnny Sohn <[email protected]>
… HBase backup (apache#5445) Make the hostname parsing in BackupUtils#parseHostFromOldLog more lenient by not making any assumptions about the name of the file other than that it starts with a org.apache.hadoop.hbase.ServerName. Signed-off-by: Duo Zhang <[email protected]>
…les (apache#5782) Signed-off-by: Bryan Beaudreault <[email protected]>
…apache#5795) Signed-off-by: Bryan Beaudreault <[email protected]>
* Build with and for AlmaLinux9 * only one build target, different REPO_NAME * missed some spots --------- Co-authored-by: Charles Connell <[email protected]>
…x for performance (#88)
…with merge region (apache#3981) (#93) Signed-off-by: Duo Zhang <[email protected]> Co-authored-by: meiyi <[email protected]>
…he#5871) (#95) In older versions of HBase's backup mechanism, a manifest was written per table being backed up. This was since refactored to one manifest per backup, but the manifest code was not updated. A concrete issue with the old code was that the manifest for full backups did not correctly list the tables included in the backup. Reviewed-by: Ray Mattingly <[email protected]> Signed-off-by: Nick Dimiduk <[email protected]> Co-authored-by: DieterDP <[email protected]>
…tFormat2 to avoid always call getTableRelativePath method (apache#5888) (#98) Signed-off-by: Duo Zhang <[email protected]> Co-authored-by: szucsvillo <[email protected]>
… pile up indefinitely (apache#6006) (#101) We have been trying to setup daily incremental backups for hundreds of clusters at my day job. Recently we discovered that old WALs were piling up across many clusters inline with when we began running incremental backups. This led to the realization that the BackupLogCleaner will always skip archived HMaster WALs. This is a problem because, if a cleaner is skipping a given file, then the CleanerChore will never delete it. This seems like a misunderstanding of what it means to "skip" a WAL in a BaseLogCleanerDelegate, and, instead, we should always return these HMaster WALs as deletable from the perspective of the BackupLogCleaner. We could subject them to the same scrutiny as RegionServer WALs: are they older than the most recent successful backup? But, if I understand correctly, HMaster WALs do not contain any data relevant to table backups, so that would be unnecessary. Signed-off-by: Nick Dimiduk <[email protected]> Co-authored-by: Ray Mattingly <[email protected]>
…ld ensure system tables are enabled (apache#6018) (#102) Signed-off-by: Bryan Beaudreault <[email protected]> Signed-off-by: Nick Dimiduk <[email protected]> Co-authored-by: Ray Mattingly <[email protected]>
…ly shrink (apache#5876) (#97) * HubSpot Backport: HBASE-28568 Incremental backup set does not correctly shrink (apache#5876) The incremental backup set is the set of tables included when an incremental backup is created, it is managed per backup root dir and contains all tables that are present in at least one backup (in that root dir). The incremental backup set can only shrink when backups are deleted. However, the implementation was incorrect, causing this set to never be able to shrink. Reviewed-by: Ray Mattingly <[email protected]> Signed-off-by: Nick Dimiduk <[email protected]> * HubSpot Backport: HBASE-28568 Incremental backup set does not correctly shrink (addendum) (apache#5917) Import the correct shaded Guava and run spotless:apply. Signed-off-by: Duo Zhang <[email protected]> --------- Signed-off-by: Nick Dimiduk <[email protected]> Signed-off-by: Duo Zhang <[email protected]> Co-authored-by: DieterDP <[email protected]>
…ly blocked by quotas (#104) Co-authored-by: Ray Mattingly <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Backport changes from #6076 to branch-2