Skip to content

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Aug 30, 2019

What changes were proposed in this pull request?

This PR adds scala-library test dependency to network-common module for JDK11.

Why are the changes needed?

In JDK11, the following command fails due to scala library.

mvn clean install -pl common/network-common -DskipTests

BEFORE

...
error: fatal error: object scala in compiler mirror not found.
one error found
...
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------

AFTER

[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Manual. On JDK11, do the following.

mvn clean install -pl common/network-common -DskipTests

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-28932][CORE] Add scala dependency to network-common module [SPARK-28932][CORE] Add scala dependency to network-common module for JDK11 Aug 30, 2019
@dongjoon-hyun dongjoon-hyun changed the title [SPARK-28932][CORE] Add scala dependency to network-common module for JDK11 [SPARK-28932][CORE][test-hadoop3.2][test-maven] Add scala dependency to network-common module for JDK11 Aug 30, 2019
@dongjoon-hyun
Copy link
Member Author

Retest this please.

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-28932][CORE][test-hadoop3.2][test-maven] Add scala dependency to network-common module for JDK11 [SPARK-28932][CORE] Add scala-library test dependency to network-common module for JDK11 Aug 30, 2019
@dongjoon-hyun dongjoon-hyun changed the title [SPARK-28932][CORE] Add scala-library test dependency to network-common module for JDK11 [SPARK-28932][BUILD] Add scala-library test dependency to network-common module for JDK11 Aug 30, 2019
@SparkQA
Copy link

SparkQA commented Aug 31, 2019

Test build #109971 has finished for PR 25638 at commit d55904f.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Aug 31, 2019

Test build #109969 has finished for PR 25638 at commit 7623d2b.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Aug 31, 2019

Test build #109973 has finished for PR 25638 at commit d55904f.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Aug 31, 2019

Test build #109979 has finished for PR 25638 at commit 10a2bf4.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyun
Copy link
Member Author

Thank you, @srowen and @viirya !

@dongjoon-hyun dongjoon-hyun deleted the SPARK-28932 branch August 31, 2019 17:59
@dongjoon-hyun
Copy link
Member Author

dongjoon-hyun commented Sep 16, 2019

Hi, @srowen and @viirya .
Very sorry. During testing the last commit, it seems that my local maven was filled with previous result. During installation, test jar building needs Scala library. We need to upgrade this to compile dependency like tags and core. At the first commit, it was a compile dependency. I'll make a follow-up PR for this and ping you guys. Sorry again.

dongjoon-hyun added a commit that referenced this pull request Sep 16, 2019
…ency for JDK11

### What changes were proposed in this pull request?

This is a follow-up of #25638 to switch `scala-library` from `test` dependency to `compile` dependency in `network-common` module.

### Why are the changes needed?

Previously, we added `scala-library` as a test dependency to resolve the followings, but it was insufficient to resolve. This PR aims to switch it to compile dependency.
```
$ java -version
openjdk version "11.0.3" 2019-04-16
OpenJDK Runtime Environment AdoptOpenJDK (build 11.0.3+7)
OpenJDK 64-Bit Server VM AdoptOpenJDK (build 11.0.3+7, mixed mode)

$ mvn clean install -pl common/network-common -DskipTests
...
[INFO] --- scala-maven-plugin:4.2.0:doc-jar (attach-scaladocs)  spark-network-common_2.12 ---
error: fatal error: object scala in compiler mirror not found.
one error found
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
```

### Does this PR introduce any user-facing change?

No.

### How was this patch tested?

Manually, run the following on JDK11.
```
$ mvn clean install -pl common/network-common -DskipTests
```

Closes #25800 from dongjoon-hyun/SPARK-28932-2.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
rshkv pushed a commit to palantir/spark that referenced this pull request Feb 18, 2021
…ency for JDK11

### What changes were proposed in this pull request?

This is a follow-up of apache#25638 to switch `scala-library` from `test` dependency to `compile` dependency in `network-common` module.

### Why are the changes needed?

Previously, we added `scala-library` as a test dependency to resolve the followings, but it was insufficient to resolve. This PR aims to switch it to compile dependency.
```
$ java -version
openjdk version "11.0.3" 2019-04-16
OpenJDK Runtime Environment AdoptOpenJDK (build 11.0.3+7)
OpenJDK 64-Bit Server VM AdoptOpenJDK (build 11.0.3+7, mixed mode)

$ mvn clean install -pl common/network-common -DskipTests
...
[INFO] --- scala-maven-plugin:4.2.0:doc-jar (attach-scaladocs)  spark-network-common_2.12 ---
error: fatal error: object scala in compiler mirror not found.
one error found
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
```

### Does this PR introduce any user-facing change?

No.

### How was this patch tested?

Manually, run the following on JDK11.
```
$ mvn clean install -pl common/network-common -DskipTests
```

Closes apache#25800 from dongjoon-hyun/SPARK-28932-2.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
rshkv pushed a commit to palantir/spark that referenced this pull request Feb 19, 2021
…ency for JDK11

### What changes were proposed in this pull request?

This is a follow-up of apache#25638 to switch `scala-library` from `test` dependency to `compile` dependency in `network-common` module.

### Why are the changes needed?

Previously, we added `scala-library` as a test dependency to resolve the followings, but it was insufficient to resolve. This PR aims to switch it to compile dependency.
```
$ java -version
openjdk version "11.0.3" 2019-04-16
OpenJDK Runtime Environment AdoptOpenJDK (build 11.0.3+7)
OpenJDK 64-Bit Server VM AdoptOpenJDK (build 11.0.3+7, mixed mode)

$ mvn clean install -pl common/network-common -DskipTests
...
[INFO] --- scala-maven-plugin:4.2.0:doc-jar (attach-scaladocs)  spark-network-common_2.12 ---
error: fatal error: object scala in compiler mirror not found.
one error found
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
```

### Does this PR introduce any user-facing change?

No.

### How was this patch tested?

Manually, run the following on JDK11.
```
$ mvn clean install -pl common/network-common -DskipTests
```

Closes apache#25800 from dongjoon-hyun/SPARK-28932-2.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants