Skip to content

Commit 83ffef7

Browse files
committed
[SPARK-32441][BUILD][CORE] Update json4s to 3.7.0-M5 for Scala 2.13
### What changes were proposed in this pull request? This PR aims to upgrade `json4s` to from 3.6.6 to 3.7.0-M5 for Scala 2.13 support at Apache Spark 3.1.0 on December. We will upgrade to the latest `json4s` around November. ### Why are the changes needed? `json4s` starts to support Scala 2.13 since v3.7.0-M4. - json4s/json4s#660 - json4s/json4s@b013af8 Old `json4s` causes many UT failures with `NoSuchMethodException`. ```scala Cause: java.lang.NoSuchMethodException: scala.collection.immutable.Seq$.apply(scala.collection.Seq) at java.lang.Class.getMethod(Class.java:1786) ``` The following is one example. ```scala $ dev/change-scala-version.sh 2.13 $ build/mvn test -pl core --am -Pscala-2.13 -Dtest=none -DwildcardSuites=org.apache.spark.executor.CoarseGrainedExecutorBackendSuite ... Tests: succeeded 4, failed 9, canceled 0, ignored 0, pending 0 *** 9 TESTS FAILED *** ``` ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? 1. **Scala 2.12**: Pass the Jenkins or GitHub Action with the existing tests. 2. **Scala 2.13**: Do the following manually at least. ```scala $ dev/change-scala-version.sh 2.13 $ build/mvn test -pl core --am -Pscala-2.13 -Dtest=none -DwildcardSuites=org.apache.spark.executor.CoarseGrainedExecutorBackendSuite ... Tests: succeeded 13, failed 0, canceled 0, ignored 0, pending 0 All tests passed. ``` Closes #29239 from dongjoon-hyun/SPARK-32441. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent 147022a commit 83ffef7

File tree

4 files changed

+13
-13
lines changed

4 files changed

+13
-13
lines changed

dev/deps/spark-deps-hadoop-2.7-hive-1.2

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -129,10 +129,10 @@ jline/2.14.6//jline-2.14.6.jar
129129
joda-time/2.10.5//joda-time-2.10.5.jar
130130
jodd-core/3.5.2//jodd-core-3.5.2.jar
131131
jpam/1.1//jpam-1.1.jar
132-
json4s-ast_2.12/3.6.6//json4s-ast_2.12-3.6.6.jar
133-
json4s-core_2.12/3.6.6//json4s-core_2.12-3.6.6.jar
134-
json4s-jackson_2.12/3.6.6//json4s-jackson_2.12-3.6.6.jar
135-
json4s-scalap_2.12/3.6.6//json4s-scalap_2.12-3.6.6.jar
132+
json4s-ast_2.12/3.7.0-M5//json4s-ast_2.12-3.7.0-M5.jar
133+
json4s-core_2.12/3.7.0-M5//json4s-core_2.12-3.7.0-M5.jar
134+
json4s-jackson_2.12/3.7.0-M5//json4s-jackson_2.12-3.7.0-M5.jar
135+
json4s-scalap_2.12/3.7.0-M5//json4s-scalap_2.12-3.7.0-M5.jar
136136
jsp-api/2.1//jsp-api-2.1.jar
137137
jsr305/3.0.0//jsr305-3.0.0.jar
138138
jta/1.1//jta-1.1.jar

dev/deps/spark-deps-hadoop-2.7-hive-2.3

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -144,10 +144,10 @@ joda-time/2.10.5//joda-time-2.10.5.jar
144144
jodd-core/3.5.2//jodd-core-3.5.2.jar
145145
jpam/1.1//jpam-1.1.jar
146146
json/1.8//json-1.8.jar
147-
json4s-ast_2.12/3.6.6//json4s-ast_2.12-3.6.6.jar
148-
json4s-core_2.12/3.6.6//json4s-core_2.12-3.6.6.jar
149-
json4s-jackson_2.12/3.6.6//json4s-jackson_2.12-3.6.6.jar
150-
json4s-scalap_2.12/3.6.6//json4s-scalap_2.12-3.6.6.jar
147+
json4s-ast_2.12/3.7.0-M5//json4s-ast_2.12-3.7.0-M5.jar
148+
json4s-core_2.12/3.7.0-M5//json4s-core_2.12-3.7.0-M5.jar
149+
json4s-jackson_2.12/3.7.0-M5//json4s-jackson_2.12-3.7.0-M5.jar
150+
json4s-scalap_2.12/3.7.0-M5//json4s-scalap_2.12-3.7.0-M5.jar
151151
jsp-api/2.1//jsp-api-2.1.jar
152152
jsr305/3.0.0//jsr305-3.0.0.jar
153153
jta/1.1//jta-1.1.jar

dev/deps/spark-deps-hadoop-3.2-hive-2.3

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -142,10 +142,10 @@ jodd-core/3.5.2//jodd-core-3.5.2.jar
142142
jpam/1.1//jpam-1.1.jar
143143
json-smart/2.3//json-smart-2.3.jar
144144
json/1.8//json-1.8.jar
145-
json4s-ast_2.12/3.6.6//json4s-ast_2.12-3.6.6.jar
146-
json4s-core_2.12/3.6.6//json4s-core_2.12-3.6.6.jar
147-
json4s-jackson_2.12/3.6.6//json4s-jackson_2.12-3.6.6.jar
148-
json4s-scalap_2.12/3.6.6//json4s-scalap_2.12-3.6.6.jar
145+
json4s-ast_2.12/3.7.0-M5//json4s-ast_2.12-3.7.0-M5.jar
146+
json4s-core_2.12/3.7.0-M5//json4s-core_2.12-3.7.0-M5.jar
147+
json4s-jackson_2.12/3.7.0-M5//json4s-jackson_2.12-3.7.0-M5.jar
148+
json4s-scalap_2.12/3.7.0-M5//json4s-scalap_2.12-3.7.0-M5.jar
149149
jsp-api/2.1//jsp-api-2.1.jar
150150
jsr305/3.0.0//jsr305-3.0.0.jar
151151
jta/1.1//jta-1.1.jar

pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -861,7 +861,7 @@
861861
<dependency>
862862
<groupId>org.json4s</groupId>
863863
<artifactId>json4s-jackson_${scala.binary.version}</artifactId>
864-
<version>3.6.6</version>
864+
<version>3.7.0-M5</version>
865865
<exclusions>
866866
<exclusion>
867867
<groupId>com.fasterxml.jackson.core</groupId>

0 commit comments

Comments
 (0)