Skip to content

Move ThriftHiveMetastore alternate calls system to ThriftHiveMetastoreClient#13610

Merged
dain merged 3 commits intotrinodb:masterfrom
dain:hive-metastore-alternate-calls
Aug 13, 2022
Merged

Move ThriftHiveMetastore alternate calls system to ThriftHiveMetastoreClient#13610
dain merged 3 commits intotrinodb:masterfrom
dain:hive-metastore-alternate-calls

Conversation

@dain
Copy link
Member

@dain dain commented Aug 11, 2022

Description

This change moves the logic for discovering and managing alternate Thrift calls for the various version of Hive Metastore to the lowest level ThriftHiveMetastoreClient. This simplifies callers because they do not need understand complexity of API versions, and instead callers just issue simple commands.

Documentation

(X) No documentation is needed.
( ) Sufficient documentation is included in this PR.
( ) Documentation PR is available with #prnumber.
( ) Documentation issue #issuenumber is filed, and can be handled later.

Release notes

( ) No release notes entries required.
(X) Release notes entries required with the following suggested text:

# Hive
* Reduce Thrift Metastore communication overhead when impersonation is enabled. ({issue}`13606`)

@dain dain force-pushed the hive-metastore-alternate-calls branch from e6de085 to 429d217 Compare August 12, 2022 22:57
@dain dain merged commit 280fee3 into trinodb:master Aug 13, 2022
@dain dain deleted the hive-metastore-alternate-calls branch August 13, 2022 18:23
@github-actions github-actions bot added this to the 393 milestone Aug 13, 2022
@colebow
Copy link
Member

colebow commented Aug 15, 2022

What would be the best way to frame this release note so it's providing a tangible improvement to users? It is a performance improvement, a reduction in bandwidth usage, something else?

Comment on lines +51 to +52
// When `dateStatistics.size() > 1` we expect something like "TApplicationException: Required field 'colName' is unset! Struct:ColumnStatisticsObj(colName:null, colType:null, statsData:null)"
// When `dateStatistics.size() == 1` we expect something like "TTransportException: java.net.SocketTimeoutException: Read timed out"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What does dateStatistics refer to?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

4 participants