Skip to content

Conversation

@KnightChess
Copy link
Contributor

a table with bucket index, if insert overwrite the same partition twice, can not get any data will query sql

reason: insert overwrite in bucket index will tagLocation, the new file version will use the same fgId, so the lastest file slice will be filtered by replacecommit file with the same fileGroupId.

Change Logs

if op is insert_overwrite, ignore tagLocation.

Impact

none

Risk level (write none, low medium or high below)

none

Documentation Update

none

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

@hudi-bot
Copy link
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@KnightChess KnightChess changed the title [HUDI-5861] fix table can not read date after overwrite table with bu… [HUDI-5861] fix table can not read data after overwrite table with bu… Feb 28, 2023
@KnightChess
Copy link
Contributor Author

#8072 look like meet the same question, close it

@flashJd
Copy link
Contributor

flashJd commented Jun 29, 2023

#8072 look like meet the same question, close it

I prefer the solution that remove tagLocation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Archived in project

Development

Successfully merging this pull request may close these issues.

3 participants