Skip to content

Conversation

@InvisibleProgrammer
Copy link
Contributor

@InvisibleProgrammer InvisibleProgrammer commented Dec 14, 2022

Ticket: Port Iceberg catalog changes

That port contains a huge spotless refactor so we do the porting in three steps:

  • first, we port the changes between the last port and the spotless refactor
  • after that, we port the spotless refactor
  • and the remaining changes

That PR contains the first pack of those

Changes contained in the port:

apache/iceberg#4456 - Hive: Expose Snapshot Stats in HMS.
apache/iceberg#4546 - Hive: Expose default partition spec and sort order in HMS. #4546
apache/iceberg#4681 - Core: Log the new metadata location in commit. #4681
apache/iceberg#5212 - Arrow/AWS/Core/Hive: Fix ErrorProne warnings #5212
apache/iceberg#5222 - Don't throw from finally block #5222

apache/iceberg#4585 - Core : Strip trailing slash from tableLocation in LocationProvider #4585
apache/iceberg#4011 - Allow table defaults to be configured and/ or enforced at catalog level using catalog properties. #4011
apache/iceberg#4803 - Catalog: Use ImmutableMap for catalog properties #4803
apache/iceberg#4946 - API: Support registering filesystem tables to metastore based catalogs #4946
apache/iceberg#5210 - Build: Upgrade test dependencies to latest version #5210
apache/iceberg#5221 - Prevent usage of @test(expected = ...) and change existing tests #5221
apache/iceberg#5037 - Core: Implement BaseMetastoreCatalog.registerTable() #5037

Wanted but couldn't as Hive-Iceberg and Iceberg have too many differences. They does that in a complete different way
apache/iceberg#5039 - Hive: Print db and table name while acquiring hive meta-store lock #5039

Was on the changelist but didn't contain file that should be ported:
apache/iceberg#4873 - API: Pass FileIO into Snapshot methods that read metadata #4873

What changes were proposed in this pull request?

Porting

Why are the changes needed?

The last round of porting happened in 2022 april, there were a couple of changes especially in HiveTableOperations worth porting into iceberg-catalog.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Ran the tests.

@InvisibleProgrammer InvisibleProgrammer changed the title Hive 26822 port changes before spotless Port: HIVE-26822 port changes before spotless Dec 14, 2022
@InvisibleProgrammer InvisibleProgrammer changed the title Port: HIVE-26822 port changes before spotless HIVE-26822: port changes before spotless Dec 14, 2022
@sonarqubecloud
Copy link

sonarqubecloud bot commented Jan 2, 2023

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug C 1 Bug
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 2 Code Smells

No Coverage information No Coverage information
No Duplication information No Duplication information

@InvisibleProgrammer InvisibleProgrammer deleted the HIVE-26822---Port-changes-before-spotless branch January 3, 2023 13:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

10 participants