Skip to content

Conversation

@alexeykudinkin
Copy link
Contributor

@alexeykudinkin alexeykudinkin commented Jan 28, 2023

Change Logs

Cleaning up some of the recently introduced configs:

  • Shortening file-listing mode override for Spark's FileIndex
  • Fixing Disruptor's write buffer limit config
  • Scoped CANONICALIZE_NULLABLE config to HoodieSparkSqlWriter

Impact

N/A

Risk level (write none, low medium or high below)

N/A

Documentation Update

Describe any necessary documentation update if there is any new feature, config, or user-facing change

  • The config description must be updated if new configs are added or the default value of the configs are changed
  • Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
    ticket number here and follow the instruction to make
    changes to the website.

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

Copy link
Contributor

@yihua yihua left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks for the clean-up.

@nsivabalan
Copy link
Contributor

rebased w/ latest master.

@alexeykudinkin alexeykudinkin force-pushed the ak/cfg-fix branch 2 times, most recently from 8c1d972 to 0bbd11b Compare January 28, 2023 07:20
@hudi-bot
Copy link
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@alexeykudinkin
Copy link
Contributor Author

CI is failing due to a flaky test (multi-writer DeltaStreamer)

@alexeykudinkin alexeykudinkin merged commit 88d8e5e into apache:master Jan 29, 2023
yihua pushed a commit that referenced this pull request Jan 30, 2023
Cleaning up some of the recently introduced configs:

Shortening file-listing mode override for Spark's FileIndex
Fixing Disruptor's write buffer limit config
Scoped CANONICALIZE_NULLABLE config to HoodieSparkSqlWriter
fengjian428 pushed a commit to fengjian428/hudi that referenced this pull request Jan 31, 2023
Cleaning up some of the recently introduced configs:

Shortening file-listing mode override for Spark's FileIndex
Fixing Disruptor's write buffer limit config
Scoped CANONICALIZE_NULLABLE config to HoodieSparkSqlWriter
fengjian428 pushed a commit to fengjian428/hudi that referenced this pull request Apr 5, 2023
Cleaning up some of the recently introduced configs:

Shortening file-listing mode override for Spark's FileIndex
Fixing Disruptor's write buffer limit config
Scoped CANONICALIZE_NULLABLE config to HoodieSparkSqlWriter
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

priority:blocker Production down; release blocker

Projects

Archived in project

Development

Successfully merging this pull request may close these issues.

4 participants