Skip to content

Commit 1699a04

Browse files
committed
[EZSPA-772] Spark3/hadoop3 application fails (apache#1011)
Co-authored-by: Egor Krivokon <>
1 parent 9d9c42b commit 1699a04

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

conf/spark-env.sh

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -108,6 +108,9 @@ if [ -f "$MAPR_HOME/kafka/kafkaversion" ]; then
108108
MAPR_SPARK_CLASSPATH=$MAPR_SPARK_CLASSPATH:$(find ${BASEMAPR:-$MAPR_HOME}/kafka -name "kafka-eventstreams-*.jar")
109109
fi
110110

111+
#FIX for EZSPA-772. We need to take mapr-security-web jar from mapr lib folder, not from Hadoop
112+
MAPR_SPARK_CLASSPATH=$MAPR_SPARK_CLASSPATH:$(find ${BASEMAPR:-$MAPR_HOME}/lib -name "mapr-security-web-*.jar" | egrep -v tests)
113+
111114
SPARK_MAPR_HOME=$MAPR_HOME
112115

113116
export SPARK_LIBRARY_PATH=$MAPR_HADOOP_JNI_PATH

0 commit comments

Comments
 (0)