-
Notifications
You must be signed in to change notification settings - Fork 2.5k
[HUDI-6456] [DOC] Add parquet blooms documentation #9056
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: asf-site
Are you sure you want to change the base?
Conversation
|
@parisni I think you need to add it to "current" docs version as well, if you want to have it copied over to 0.14 docs |
|
thanks @kazdy , moved into docs folder. No mention of sidebar there, I assume it is done manually during the release. |
|
I think somewhere in the configuration page, we need to mention about this function: https://hudi.apache.org/docs/configurations#Write-Options, or no one knows how to use it. |
2db7877 to
78e1220
Compare
|
@danny0405 added mention of parquet features hudi supports |
|
|
||
| By default, Hudi would load the configuration file under `/etc/hudi/conf` directory. You can specify a different configuration directory location by setting the `HUDI_CONF_DIR` environment variable. | ||
| - [**Spark Datasource Configs**](#SPARK_DATASOURCE): These configs control the Hudi Spark Datasource, providing ability to define keys/partitioning, pick out the write operation, specify how to merge records or choosing query type to read. | ||
| - [**Parquet Configs**](#PARQUET_CONFIG): These configs makes it possible to bring native parquet features |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The configurations.md is automatically generated by https://github.com/apache/hudi/tree/asf-site/hudi-utils so let's avoid changing this page directly.
| @@ -0,0 +1,74 @@ | |||
| --- | |||
| title: Parquet Bloom Filters | |||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Does this new page show up in the sidebar?
Change Logs
This adds doc for the parquet bloom feature. I added it in 0.13.1, but this likely should be moved to 0.14
Impact
Describe any public API or user-facing feature change or any performance impact.
Risk level (write none, low medium or high below)
If medium or high, explain what verification was done to mitigate the risks.
Documentation Update
Describe any necessary documentation update if there is any new feature, config, or user-facing change
ticket number here and follow the instruction to make
changes to the website.
Contributor's checklist