From ed7f624ed18e2c7dabb121abce75d4a29142a27a Mon Sep 17 00:00:00 2001 From: Dongjoon Hyun Date: Fri, 24 Jan 2020 10:46:52 -0800 Subject: [PATCH] [SPARK-29924][DOCS] Add Apache Arrow requirement in Java 11 --- docs/index.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/index.md b/docs/index.md index d86471d56d5d9..f6ec595231f9e 100644 --- a/docs/index.md +++ b/docs/index.md @@ -52,6 +52,8 @@ For the Scala API, Spark {{site.SPARK_VERSION}} uses Scala {{site.SCALA_BINARY_VERSION}}. You will need to use a compatible Scala version ({{site.SCALA_BINARY_VERSION}}.x). +For Java 11, `-Dio.netty.tryReflectionSetAccessible=true` is required additionally for Apache Arrow library. This prevents `java.lang.UnsupportedOperationException: sun.misc.Unsafe or java.nio.DirectByteBuffer.(long, int) not available` when Apache Arrow uses Netty internally. + # Running the Examples and Shell Spark comes with several sample programs. Scala, Java, Python and R examples are in the