Skip to content

Conversation

@Leemoonsoo
Copy link
Member

What is this PR for?

This PR implement spark 2.0 support based on #747.
This PR has approach from #980 which is reimplementing code in scala.

You can try build this branch

mvn clean package -Dscala-2.11 -Pspark-2.0 -Dspark.version=2.0.0-preview -Ppyspark -Psparkr -Pyarn -Phadoop-2.6 -DskipTests

What type of PR is it?

Improvements

Todos

  • - Spark 2.0 support
  • - Rebase after [ZEPPELIN-605] Add support for Scala 2.11 #747 merge
  • - .travis.yml to use spark version 2.0.0 instead of 2.0.0-preview after spark 2.0.0 release
  • - Update LICENSE file
  • - Update related document (build)

What is the Jira issue?

https://issues.apache.org/jira/browse/ZEPPELIN-759

How should this be tested?

Build and try

mvn clean package -Dscala-2.11 -Pspark-2.0 -Dspark.version=2.0.0-preview -Ppyspark -Psparkr -Pyarn -Phadoop-2.6 -DskipTests

Screenshots (if appropriate)

spark2

Questions:

  • Does the licenses files need update? yes
  • Is there breaking changes for older versions? no
  • Does this needs documentation? yes

lresende and others added 30 commits July 7, 2016 22:01
Enable Zeppelin to be built with both Scala 2.10
and Scala 2.11, mostly to start supporting interpreters
that are moving to Scala 2.11 only such as Spark.
Scala 2.11 has changed a lot of it's REPL support and in order to enable
building with Scala 2.10 and 2.11 we need to enable the new Scala 2.11
REPL and also make the build to compile based on the scala version.
Closes lresende/incubator-zeppelin/#1
Use createDataFrame instead of applySchema
@Leemoonsoo Leemoonsoo closed this Jul 16, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants