Skip to content

Conversation

@yanboliang
Copy link
Contributor

Since the data is always serialized on the R side, the storage levels of JAVA-specific deserialization should be deprecated. We should automatically convert MEMORY_ONLY to MEMORY_ONLY_SER and deprecated MEMORY_ONLY_SER at SparkR side. Please refer the similar change for PySpark at #10092.

@sun-rui
Copy link
Contributor

sun-rui commented Dec 8, 2015

@yanboliang, thanks for the PR. But for SparkR RDD API, still discussion how to evolve it. So maybe we need more discussion before submitting a PR for all RDD related JIRA issues (Those JIRAs are for tracking purpose for now)

@shivaram, @felixcheung.

@SparkQA
Copy link

SparkQA commented Dec 8, 2015

Test build #47312 has finished for PR 10189 at commit fa88169.

  • This patch fails R style tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@yanboliang
Copy link
Contributor Author

@sun-rui Got it, thanks for your kindly remind.

@felixcheung
Copy link
Member

yes, in fact we are instructed not to work on Spark 2.0 release yet

@SparkQA
Copy link

SparkQA commented Dec 8, 2015

Test build #47314 has finished for PR 10189 at commit 588acaf.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@shivaram
Copy link
Contributor

@yanboliang Could you close this PR for now ? It just makes the reviewing queue easier

@yanboliang
Copy link
Contributor Author

OK, I will close this PR.

@yanboliang yanboliang closed this Dec 11, 2015
@yanboliang yanboliang deleted the spark-12170 branch May 5, 2016 07:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants