You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
Unit test Write encrypted ORC fallback fails on Spark-3.4 with below error:
- NOT ON GPU[ShuffleExchangeExec,DataWritingCommandExec]: Write encrypted ORC fallback *** FAILED ***
java.lang.IllegalArgumentException: Part of the plan is not columnar class org.apache.spark.sql.execution.datasources.WriteFilesExec
WriteFiles
+- GpuColumnarToRow false
+- GpuShuffleCoalesce 2147483647
+- GpuColumnarExchange gpusinglepartitioning$(), REPARTITION_BY_NUM, [plan_id=110]
+- GpuRowToColumnar targetsize(2147483647)
+- LocalTableScan [ints#20, more_ints#21]
at com.nvidia.spark.rapids.GpuTransitionOverrides.assertIsOnTheGpu(GpuTransitionOverrides.scala:623)
at com.nvidia.spark.rapids.GpuTransitionOverrides.$anonfun$assertIsOnTheGpu$7(GpuTransitionOverrides.scala:637)
at com.nvidia.spark.rapids.GpuTransitionOverrides.$anonfun$assertIsOnTheGpu$7$adapted(GpuTransitionOverrides.scala:637)
at scala.collection.Iterator.foreach(Iterator.scala:943)
at scala.collection.Iterator.foreach$(Iterator.scala:943)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1431)
at scala.collection.IterableLike.foreach(IterableLike.scala:74)
at scala.collection.IterableLike.foreach$(IterableLike.scala:73)
at scala.collection.AbstractIterable.foreach(Iterable.scala:56)
at com.nvidia.spark.rapids.GpuTransitionOverrides.assertIsOnTheGpu(GpuTransitionOverrides.scala:637)
Describe the bug
Unit test
Write encrypted ORC fallback
fails on Spark-3.4 with below error:Steps/Code to reproduce bug
Expected behavior
Above test should pass
The text was updated successfully, but these errors were encountered: