Skip to content

NoClassDefFoundError when running TestPrestoSparkNativeGeneralQueries #25944

@xin-zhang2

Description

@xin-zhang2

presto-native-execution has been upgraded to Java 17, and it has a dependency on presto-on-spark which remains Java 8. There are some dependencies issues now, leading to the following errors when running TestPrestoSparkNativeGeneralQueries.

java.lang.NoClassDefFoundError: javax/ws/rs/WebApplicationException

	at java.base/java.lang.ClassLoader.defineClass1(Native Method)
	at java.base/java.lang.ClassLoader.defineClass(ClassLoader.java:1017)
	at java.base/java.security.SecureClassLoader.defineClass(SecureClassLoader.java:150)
	at java.base/jdk.internal.loader.BuiltinClassLoader.defineClass(BuiltinClassLoader.java:862)
	at java.base/jdk.internal.loader.BuiltinClassLoader.findClassOnClassPathOrNull(BuiltinClassLoader.java:760)
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClassOrNull(BuiltinClassLoader.java:681)
	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:639)
	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
	at org.apache.spark.ui.SparkUI.<init>(SparkUI.scala:54)
	at org.apache.spark.ui.SparkUI$.create(SparkUI.scala:219)
	at org.apache.spark.ui.SparkUI$.createLiveUI(SparkUI.scala:161)
	at org.apache.spark.SparkContext.<init>(SparkContext.scala:440)
	at com.facebook.presto.spark.PrestoSparkQueryRunner$SparkContextHolder.get(PrestoSparkQueryRunner.java:833)
	at com.facebook.presto.spark.PrestoSparkQueryRunner.<init>(PrestoSparkQueryRunner.java:366)
	at com.facebook.presto.spark.PrestoSparkNativeQueryRunnerUtils.createRunner(PrestoSparkNativeQueryRunnerUtils.java:138)
	at com.facebook.presto.spark.PrestoSparkNativeQueryRunnerUtils.createRunner(PrestoSparkNativeQueryRunnerUtils.java:113)
	at com.facebook.presto.spark.PrestoSparkNativeQueryRunnerUtils.createHiveRunner(PrestoSparkNativeQueryRunnerUtils.java:103)

Your Environment

  • Presto version used:
  • Storage (HDFS/S3/GCS..):
  • Data source and connector used:
  • Deployment (Cloud or On-prem):
  • Pastebin link to the complete debug logs:

Expected Behavior

Current Behavior

Possible Solution

Steps to Reproduce

Screenshots (if appropriate)

Context

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    Status

    🆕 Unprioritized

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions