[HUDI-6361] retain the commit before inflignt compaction to support schema Evolution

[zhuanshenbsj1]

Change Logs

Describe context and summary for this change. Highlight if any code was copied.

Impact

Describe any public API or user-facing feature change or any performance impact.

Risk level (write none, low medium or high below)

If medium or high, explain what verification was done to mitigate the risks.

Documentation Update

Describe any necessary documentation update if there is any new feature, config, or user-facing change

• The config description must be updated if new configs are added or the default value of the configs are changed
• Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
  ticket number here and follow the instruction to make
  changes to the website.

Contributor's checklist

• Read through contributor's guide
• Change Logs and Impact were stated clearly
• Adequate tests were added if applicable
• CI passed

[zhuanshenbsj1]

hudi/hudi-common/src/main/java/org/apache/hudi/common/util/InternalSchemaCache.java

Line 149 in 2f2d592

byte[] data = timelineBeforeCurrentCompaction.getInstantDetails(lastInstantBeforeCurrentCompaction.get()).get();

When asynchronously executing archiving and compaction, due to non atomic operations here（line147-line149）, although it will be determined whether it exists at line 147, there is still possible that the metafile has been archived and an exception will be throwed as ' filenotfound' when executed at line 149.

[hudi-bot]

CI report:

• 32cb5fe Azure: FAILURE

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build

[danny0405]

Seems we have merged a fix already: #8783

[zhuanshenbsj1]

Seems we have merged a fix already: #8783

Oh, i see. Closing this pr as #8783 has already solved the problem.