Skip to content

How can I save partitioned Parquet ? #3737

Answered by andygrove
Miyake-Diogo asked this question in Q&A
Discussion options

You must be logged in to vote
    let ctx = SessionContext::new();
    ctx
        .read_csv("data.csv", CsvReadOptions::default().has_header(true)).await?
        .repartition(Partitioning::Hash(vec![col("id")], 2))?
        .write_parquet("data.parquet", None).await?;

Replies: 2 comments 2 replies

Comment options

You must be logged in to vote
1 reply
@Miyake-Diogo
Comment options

Comment options

You must be logged in to vote
1 reply
@Miyake-Diogo
Comment options

Answer selected by Miyake-Diogo
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants