Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Parquet ExampleGen support #240

Open
yongtang opened this issue May 16, 2019 · 2 comments
Open

Add Parquet ExampleGen support #240

yongtang opened this issue May 16, 2019 · 2 comments
Assignees
Labels
feature New feature request

Comments

@yongtang
Copy link
Member

yongtang commented May 16, 2019

This issue is to track the progress of adding Parquet ExampleGen support, so that it could be integrated into TFX OSS.

Related issues: tensorflow/tfx#74

Related discussion:

There's a close relationship between the work in SIG IO and ExampleGen implementations for TFX. Currently, TFX has no particular way of maintaining contributions, and there seems like there may be significant code overlap as well with stuff in IO.
I'm starting this thread to kick off a discussion about the feasibility and desirability of incorporating TFX data ingestion components into the SIG's work.

Related docs:
https://github.com/tensorflow/tfx/blob/master/docs/guide/examplegen.md#custom-examplegen

@yongtang yongtang self-assigned this May 16, 2019
@yongtang
Copy link
Member Author

Assigned to myself.

@ewilderj ewilderj self-assigned this May 16, 2019
@ewilderj
Copy link

the TFX team has decided to merge the Parquet PR rather than having it maintained externally. So this particular issue isn't as urgent as it was before, it might come up again in future.

@yongtang yongtang added the feature New feature request label Jun 2, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature request
Projects
None yet
Development

No branches or pull requests

2 participants