[SPARK-33304][R][SQL] Add from_avro and to_avro functions to SparkR #30216

zero323 · 2020-11-01T17:45:45Z

What changes were proposed in this pull request?

Adds from_avro and to_avro functions to SparkR.

Why are the changes needed?

Feature parity.

Does this PR introduce any user-facing change?

New functions exposed in SparkR API.

How was this patch tested?

New unit tests.

SparkQA · 2020-11-01T18:08:41Z

Test build #130499 has finished for PR 30216 at commit 6cde957.

This patch fails SparkR unit tests.
This patch merges cleanly.
This patch adds no public classes.

SparkQA · 2020-11-01T18:30:17Z

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35103/

SparkQA · 2020-11-01T18:53:16Z

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35103/

SparkQA · 2020-11-01T23:28:07Z

Test build #130504 has finished for PR 30216 at commit 1e9545f.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

SparkQA · 2020-11-01T23:38:42Z

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35107/

SparkQA · 2020-11-02T00:02:16Z

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35107/

R/pkg/DESCRIPTION

R/pkg/R/functions_avro.R

zero323 · 2020-11-02T08:13:24Z

I am going to rebase it to master, to fix AppVeyor failure.

SparkQA · 2020-11-02T08:45:57Z

Test build #130519 has finished for PR 30216 at commit c5e5186.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

SparkQA · 2020-11-02T08:53:12Z

Test build #130520 has finished for PR 30216 at commit 55c3780.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

SparkQA · 2020-11-02T08:58:07Z

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35119/

SparkQA · 2020-11-02T09:05:23Z

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35120/

SparkQA · 2020-11-02T09:21:50Z

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35119/

SparkQA · 2020-11-02T09:30:17Z

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35120/

SparkQA · 2020-11-02T15:34:59Z

Test build #130529 has finished for PR 30216 at commit 8bdf665.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

SparkQA · 2020-11-02T15:41:45Z

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35129/

SparkQA · 2020-11-02T16:02:45Z

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35129/

SparkQA · 2020-11-02T16:11:50Z

Test build #130530 has finished for PR 30216 at commit 1457133.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

SparkQA · 2020-11-02T16:19:31Z

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35130/

SparkQA · 2020-11-02T16:49:03Z

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35130/

SparkQA · 2020-11-02T23:09:20Z

Test build #130534 has finished for PR 30216 at commit 63f7792.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

SparkQA · 2020-11-02T23:16:31Z

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35134/

SparkQA · 2020-11-02T23:45:23Z

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35134/

dongjoon-hyun · 2020-11-06T18:12:44Z

Thank you, @zero323 .

dongjoon-hyun · 2020-11-06T18:12:51Z

Retest this please.

SparkQA · 2020-11-06T18:55:33Z

Test build #130736 has finished for PR 30216 at commit 63f7792.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

SparkQA · 2020-11-06T18:57:34Z

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35345/

SparkQA · 2020-11-06T19:24:30Z

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35345/

HyukjinKwon · 2020-11-19T00:52:20Z

Merged to master.

zero323 · 2020-11-19T01:13:47Z

Thanks @dongjoon-hyun @HyukjinKwon!

zero323 marked this pull request as draft November 1, 2020 17:46

zero323 force-pushed the SPARK-33304 branch from 6cde957 to 1e9545f Compare November 1, 2020 22:52

HyukjinKwon reviewed Nov 2, 2020

View reviewed changes

R/pkg/DESCRIPTION Outdated Show resolved Hide resolved

HyukjinKwon reviewed Nov 2, 2020

View reviewed changes

R/pkg/R/functions_avro.R Outdated Show resolved Hide resolved

zero323 added 2 commits November 2, 2020 09:12

Add from_avro and to_avro to R API

ffa4ed7

Add link to docs

55c3780

zero323 force-pushed the SPARK-33304 branch from c5e5186 to 55c3780 Compare November 2, 2020 08:13

zero323 marked this pull request as ready for review November 2, 2020 09:27

zero323 added 4 commits November 2, 2020 15:27

Add R example to avro docs

8bdf665

Fix condition

27e6236

Move functions to functions.R

a45b1b0

Move tests to test_sparkSQL.R

1457133

Remove availability note

63f7792

zero323 requested a review from HyukjinKwon November 19, 2020 00:25

HyukjinKwon approved these changes Nov 19, 2020

View reviewed changes

HyukjinKwon closed this in 56a8510 Nov 19, 2020

zero323 deleted the SPARK-33304 branch November 19, 2020 01:13

[SPARK-33304][R][SQL] Add from_avro and to_avro functions to SparkR #30216

[SPARK-33304][R][SQL] Add from_avro and to_avro functions to SparkR #30216

Uh oh!

Conversation

zero323 commented Nov 1, 2020

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

How was this patch tested?

Uh oh!

SparkQA commented Nov 1, 2020

Uh oh!

SparkQA commented Nov 1, 2020

Uh oh!

SparkQA commented Nov 1, 2020

Uh oh!

SparkQA commented Nov 1, 2020

Uh oh!

SparkQA commented Nov 1, 2020

Uh oh!

SparkQA commented Nov 2, 2020

Uh oh!

Uh oh!

Uh oh!

zero323 commented Nov 2, 2020

Uh oh!

SparkQA commented Nov 2, 2020

Uh oh!

SparkQA commented Nov 2, 2020

Uh oh!

SparkQA commented Nov 2, 2020

Uh oh!

SparkQA commented Nov 2, 2020

Uh oh!

SparkQA commented Nov 2, 2020

Uh oh!

SparkQA commented Nov 2, 2020

Uh oh!

SparkQA commented Nov 2, 2020

Uh oh!

SparkQA commented Nov 2, 2020

Uh oh!

SparkQA commented Nov 2, 2020

Uh oh!

SparkQA commented Nov 2, 2020

Uh oh!

SparkQA commented Nov 2, 2020

Uh oh!

SparkQA commented Nov 2, 2020

Uh oh!

SparkQA commented Nov 2, 2020

Uh oh!

SparkQA commented Nov 2, 2020

Uh oh!

SparkQA commented Nov 2, 2020

Uh oh!

dongjoon-hyun commented Nov 6, 2020

Uh oh!

dongjoon-hyun commented Nov 6, 2020

Uh oh!

SparkQA commented Nov 6, 2020

Uh oh!

SparkQA commented Nov 6, 2020

Uh oh!

SparkQA commented Nov 6, 2020

Uh oh!

HyukjinKwon commented Nov 19, 2020

Uh oh!

zero323 commented Nov 19, 2020

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants