Skip to content

Conversation

@steveloughran
Copy link
Contributor

What changes were proposed in this pull request?

Remove jets3t dependency, and bouncy castle which it brings in; update licenses and deps

Note this is just #22081 with merge conflict resolved; submitting to see what jenkins says.

How was this patch tested?

Existing tests on a JVM with unlimited Java Crypto Extensions

@SparkQA
Copy link

SparkQA commented Aug 16, 2018

Test build #94834 has finished for PR 22117 at commit 3cad78f.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@jerryshao
Copy link
Contributor

Jenkins, retest this please.

@SparkQA
Copy link

SparkQA commented Aug 16, 2018

Test build #94840 has finished for PR 22117 at commit 3cad78f.

  • This patch fails due to an unknown error code, -9.
  • This patch merges cleanly.
  • This patch adds no public classes.

@xuanyuanking
Copy link
Member

retest this please

@SparkQA
Copy link

SparkQA commented Aug 16, 2018

Test build #94851 has finished for PR 22117 at commit 3cad78f.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@steveloughran
Copy link
Contributor Author

Test failure in org.apache.spark.sql.hive.client.HiveClientSuites.(It is not a test it is a sbt.testing.SuiteSelector):

Caused by: sbt.ForkMain$ForkError: java.lang.NoClassDefFoundError: javax/jdo/JDOException
	at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5501)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:184)
	at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:73)
	... 41 more
Caused by: sbt.ForkMain$ForkError: java.lang.ClassNotFoundException: javax.jdo.JDOException
	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1.doLoadClass(IsolatedClientLoader.scala:227)
	at org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1.loadClass(IsolatedClientLoader.scala:216)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	... 44 more

somehow datanucleus JARs aren't on the CP for the hive test. I can't see how this patch is causing this —can anyone else? But if not: why is it surfacing here

@steveloughran steveloughran deleted the incoming/PR-22081-jets3t branch August 20, 2018 04:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants