Skip to content

Parquet schema evolution on non-primitive type#71

Closed
Yaliang wants to merge 3 commits intotwitter-forks:twitter-masterfrom
Yaliang:yaliangw/schemaEvolution
Closed

Parquet schema evolution on non-primitive type#71
Yaliang wants to merge 3 commits intotwitter-forks:twitter-masterfrom
Yaliang:yaliangw/schemaEvolution

Conversation

@Yaliang
Copy link
Collaborator

@Yaliang Yaliang commented Feb 4, 2017

Added a lazy equals function in HiveType which only compare the catalog if the type is not primitive.
Added a configuration option for enabling the lazy schema matcher.
Includes a name based nested field mapping from prestodb#4714

@Yaliang
Copy link
Collaborator Author

Yaliang commented Feb 4, 2017

Will build a new PR in upstream for testing.
prestodb#7305 for upstream PR

@Yaliang
Copy link
Collaborator Author

Yaliang commented Feb 4, 2017

Upstream's CI passed.
https://travis-ci.org/prestodb/presto/builds/198243778

@billonahill
Copy link
Collaborator

billonahill commented Feb 6, 2017

@Yaliang let's get prestodb#7305 merged to OSS or at least reviewed for consensus before merging this patch to our fork.

@Yaliang Yaliang closed this Feb 25, 2017
@Yaliang Yaliang force-pushed the yaliangw/schemaEvolution branch from 43466e1 to 78662ca Compare February 25, 2017 00:48
@Yaliang Yaliang reopened this Feb 25, 2017
… on non-primitive type for Parquet so that the Parquet cursor can get the table schema
@Yaliang Yaliang changed the title schema evolution Parquet schema evolution on non-primitive type Feb 25, 2017
@Yaliang
Copy link
Collaborator Author

Yaliang commented Feb 25, 2017

Restructured commits

@Yaliang Yaliang closed this Oct 20, 2017
@Yaliang Yaliang deleted the yaliangw/schemaEvolution branch October 20, 2017 20:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants