Skip to content

Commit dbc4137

Browse files
HyukjinKwondongjoon-hyun
authored andcommitted
[SPARK-32841][BUILD] Use Apache Hadoop 3.2.0 for PyPI and CRAN
### What changes were proposed in this pull request? PyPI and CRAN did not change because of the concern about selecting Hadoop and Hive versions. For PyPI, now there is a PR open at apache#29703 For CRAN, we can already select Hadoop and Hive versions via `SparkR::install.spark`. ### Why are the changes needed? To keep the default profiles consistent in distributions ### Does this PR introduce _any_ user-facing change? Yes, the default distributions will use Hadoop 3.2. ### How was this patch tested? Jenkins tests. Closes apache#29704 from HyukjinKwon/SPARK-32058. Authored-by: HyukjinKwon <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent 2f85f95 commit dbc4137

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

dev/create-release/release-build.sh

+1-1
Original file line numberDiff line numberDiff line change
@@ -288,7 +288,7 @@ if [[ "$1" == "package" ]]; then
288288
fi
289289

290290
declare -A BINARY_PKGS_EXTRA
291-
BINARY_PKGS_EXTRA["hadoop2.7"]="withpip,withr"
291+
BINARY_PKGS_EXTRA["hadoop3.2"]="withpip,withr"
292292

293293
if [[ $PUBLISH_SCALA_2_11 = 1 ]]; then
294294
key="without-hadoop-scala-2.11"

0 commit comments

Comments
 (0)