Skip to content

Conversation

@xushiyan
Copy link
Member

@xushiyan xushiyan commented Jul 4, 2022

Users do not need to set partition value extractor for meta sync. The existing interface PartitionValueExtractor is marked as deprecated.

stack on #6073

@xushiyan xushiyan force-pushed the HUDI-4322-deprecate-partextract branch from 48bbfc6 to 76abccd Compare July 9, 2022 21:35
@xushiyan xushiyan marked this pull request as draft July 9, 2022 21:35
@xushiyan xushiyan requested a review from codope July 9, 2022 21:35
@xushiyan xushiyan added component:catalog-sync Catalog-sync related priority:blocker Production down; release blocker labels Jul 9, 2022
@xushiyan xushiyan force-pushed the HUDI-4322-deprecate-partextract branch from 76abccd to fd5e2d6 Compare July 9, 2022 21:43
@xushiyan xushiyan force-pushed the HUDI-4322-deprecate-partextract branch from fd5e2d6 to 15209b8 Compare July 10, 2022 17:35
@xushiyan xushiyan changed the title [WIP][HUDI-4322] Deprecate partition value extractor [HUDI-4322] Deprecate partition value extractor Jul 10, 2022
Comment on lines -190 to -197
public <T> String getStringOrDefault(ConfigProperty<T> configProperty) {
return getStringOrDefault(configProperty, configProperty.defaultValue().toString());
}

public <T> String getStringOrDefault(ConfigProperty<T> configProperty, String defaultVal) {
Option<Object> rawValue = getRawValue(configProperty);
return rawValue.map(Object::toString).orElse(defaultVal);
}
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

re-arranged getString*() methods to keep them close

@hudi-bot
Copy link
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

Copy link
Member

@codope codope left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@xushiyan The changes look good to me. Is more work needed here? Also, now that the base PR has landed, please rebase.

@prasannarajaperumal prasannarajaperumal removed the priority:blocker Production down; release blocker label Jul 20, 2022
@xushiyan xushiyan closed this Aug 23, 2022
@xushiyan xushiyan deleted the HUDI-4322-deprecate-partextract branch August 23, 2022 06:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

component:catalog-sync Catalog-sync related

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants