Skip to content

Fix GlueHiveMetastore#batchGetPartition to handle unprocessedKeys#6155

Closed
rentaow wants to merge 1 commit intotrinodb:masterfrom
rentaow:gluebatchpartitionfix
Closed

Fix GlueHiveMetastore#batchGetPartition to handle unprocessedKeys#6155
rentaow wants to merge 1 commit intotrinodb:masterfrom
rentaow:gluebatchpartitionfix

Conversation

@rentaow
Copy link
Copy Markdown

@rentaow rentaow commented Nov 30, 2020

AwsGlue's BatchGetPartitionsRequest could potentially not return all requested partition values. If Glue returns incomplete partitions, the presto query will error out from this line. This change is to handle unprocessedKeys from BatchGetParititonsResults.

https://docs.aws.amazon.com/glue/latest/dg/aws-glue-api-catalog-partitions.html

BatchGetPartition (Response)

Partitions – An array of Partition objects.

A list of the requested partitions.

UnprocessedKeys – An array of PartitionValueList objects, not more than 1000 structures.

A list of the partition values in the request for which partitions were not returned.

BatchGetPartitionsRequest could potentially not return all requested
partition values. If Glue returns incomplete partitions, the query
will error out. This change is to handle unprocessedKeys from
BatchGetParititonsResults.
@cla-bot
Copy link
Copy Markdown

cla-bot bot commented Nov 30, 2020

Thank you for your pull request and welcome to our community. We could not parse the GitHub identity of the following contributors: Rentao Wu.
This is most likely caused by a git client misconfiguration; please make sure to:

  1. check if your git client is configured with an email to sign commits git config --list | grep email
  2. If not, set it up using git config --global user.email email@example.com
  3. Make sure that the git commit email is configured in your GitHub account settings, see https://github.com/settings/emails

@mosabua
Copy link
Copy Markdown
Member

mosabua commented Oct 20, 2022

These changes were absorbed in the linked and merged PR #10696. We can therefore close this inactive PR.

@mosabua mosabua closed this Oct 20, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

2 participants