Skip to content

Drop experimental qualifier for optimized parquet writer#14137

Merged
raunaqmorarka merged 1 commit intotrinodb:masterfrom
raunaqmorarka:pqw-exp
Sep 17, 2022
Merged

Drop experimental qualifier for optimized parquet writer#14137
raunaqmorarka merged 1 commit intotrinodb:masterfrom
raunaqmorarka:pqw-exp

Conversation

@raunaqmorarka
Copy link
Copy Markdown
Member

@raunaqmorarka raunaqmorarka commented Sep 15, 2022

Description

Optimized parquet writer is already the default in delta lake.
All the known incompatibilities with Hive and Spark were fixed
in the hive connector by using legacy encodings where needed.
Therefore, the experimental tag is no longer needed.

Non-technical explanation

The parquet.experimental-optimized-writer.enabled property is now deprecated.
parquet.optimized-writer.enabled is the new property for enabling the optimized parquet writer.

Release notes

( ) This is not user-visible and no release notes are required.
( ) Release notes are required, please propose a release note for me.
(x) Release notes are required, with the following suggested text:

# Hive, Delta
* The `parquet.experimental-optimized-writer.enabled` property is now deprecated.
`parquet.optimized-writer.enabled` is the new property for enabling the optimized parquet writer. 
({issue}`14137`)

Optimized parquet writer is already the default in delta lake.
All the known incompatibilities with Hive and Spark were fixed
in the hive connector by using legacy encodings where needed.
Therefore, the experimental tag is no longer needed.
@raunaqmorarka raunaqmorarka merged commit 9f0ace6 into trinodb:master Sep 17, 2022
@raunaqmorarka raunaqmorarka deleted the pqw-exp branch September 17, 2022 00:44
@github-actions github-actions bot added this to the 397 milestone Sep 17, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

3 participants