Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for coder argument in WriteToBigQuery #20532

Closed
damccorm opened this issue Jun 4, 2022 · 2 comments · Fixed by #22312
Closed

Support for coder argument in WriteToBigQuery #20532

damccorm opened this issue Jun 4, 2022 · 2 comments · Fixed by #22312

Comments

@damccorm
Copy link
Contributor

damccorm commented Jun 4, 2022

When using WriteToBigQuery to transfer data to BigQuery, non-ascii characters are replaced with replacement characters.

This was due to the RowAsDictJsonCoder being set as the coder for the BigQueryBatchFileLoads called inside WriteToBigQuery.

I want to add coder to the argument of WriteToBigQuery so that I can set a coder other than RowAsDictJsonCoder.

If no problem, I will create a Pull Request next weekend.

Imported from Jira BEAM-10785. Original Jira may contain additional context.
Reported by: chanyou.

@damccorm
Copy link
Contributor Author

damccorm commented Jun 4, 2022

Unable to assign user @harrydrippin. If able, self-assign, otherwise tag @damccorm so that he can assign you. Because of GitHub's spam prevention system, your activity is required to enable assignment in this repo.

@harrydrippin
Copy link
Contributor

@damccorm Thank you for opening this issue. Please assign me and I will comment some progress on this soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants