Skip to content

Conversation

@findepi
Copy link
Member

@findepi findepi commented Sep 19, 2022

TableMetadataParser.toJson now serializes table statistics. This
completes the read path from JSON.

Extracted from #4741 / #5794

@github-actions github-actions bot added the core label Sep 19, 2022
`TableMetadataParser.toJson` now serializes table statistics. This
completes the read path from JSON.
@findepi findepi force-pushed the findepi/serialize-statistics-inside-table-metadata-c68a78 branch from 0f66f3e to fca6101 Compare September 19, 2022 18:44
@findepi
Copy link
Member Author

findepi commented Sep 19, 2022

@rdblue this should be ready to review

}
generator.writeEndArray();

generator.writeArrayFieldStart(STATISTICS);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you also add deserialization? Generally when we update a parser we want to update both.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Deserialization already exists.

statisticsFiles = statisticsFilesFromJson(node.get(STATISTICS));

Was added in #5450

The fact serialization was not covered was an omission.

@findepi findepi requested a review from rdblue September 20, 2022 07:15
@rdblue rdblue changed the title Serialize statistics inside Table Metadata Core: Serialize statistics files in TableMetadata Sep 21, 2022
@rdblue rdblue merged commit d1befd9 into apache:master Sep 21, 2022
@rdblue
Copy link
Contributor

rdblue commented Sep 21, 2022

Thanks, @findepi!

@findepi findepi deleted the findepi/serialize-statistics-inside-table-metadata-c68a78 branch September 21, 2022 10:31
@findepi
Copy link
Member Author

findepi commented Sep 21, 2022

thanks for the merge @rdblue !

sunchao pushed a commit to sunchao/iceberg that referenced this pull request May 10, 2023
…he#894)

* Core: Serialize statistics files in TableMetadata (apache#5799)

(cherry picked from commit d1befd9)

* Add DR support of V2 tables without delete date files

Co-authored-by: Piotr Findeisen <[email protected]>
zhongyujiang pushed a commit to zhongyujiang/iceberg that referenced this pull request Apr 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants