Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow adding user defined metadata to ParquetSink #10224

Merged
merged 6 commits into from
Apr 26, 2024
Merged

Allow adding user defined metadata to ParquetSink #10224

merged 6 commits into from
Apr 26, 2024

Commits on Apr 24, 2024

  1. chore: make explicit what ParquetWriterOptions are created from a sub… 

    …set of TableParquetOptions
    @wiedld
    wiedld committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    7b33bc8 View commit details
    Browse the repository at this point in the history

  2. refactor: restore the ability to add kv metadata into the generated f… 

    …ile sink
    @wiedld
    wiedld committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    86bf317 View commit details
    Browse the repository at this point in the history

  3. test: demomnstrate API contract for metadata TableParquetOptions

    @wiedld
    wiedld committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    c35b326 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2024

  1. chore: update code docs

    @wiedld
    wiedld committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    cd91a77 View commit details
    Browse the repository at this point in the history

  2. fix: parse on proper delimiter, and improve tests

    @wiedld
    wiedld committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    0cf04b5 View commit details
    Browse the repository at this point in the history

  3. fix: enable any character in the metadata string value, by having any… 

    … key parsing be a part of the format.metadata::key
    @wiedld
    wiedld committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    5b06bf3 View commit details
    Browse the repository at this point in the history