[SPARK-23529][K8s] Support mounting hostPath volumes for executors#21032

Closed

madanadit wants to merge 46 commits intoapache:masterfrom

madanadit:k8s-vols

Commits on Apr 10, 2018

Support mounting hostPath volumes for executors
madanadit
committed
Read mode for mounted volumes
madanadit
committed
Refactor
madanadit
committed
Fix style
madanadit
committed
Add unit tests
madanadit
committed
Update comment
madanadit
committed
Fix unit tests
madanadit
committed
[SPARK-23871][ML][PYTHON] add python api for VectorAssembler handleInvalid

huaxingao
authored and
jkbradley
committed

Commits on Apr 11, 2018

[SPARK-23944][ML] Add the set method for the two LSHModel

lu-wang-dl
authored and
jkbradley
committed
[SPARK-23847][FOLLOWUP][PYTHON][SQL] Actually test [desc|acs]_nulls_[first|last] functions in PySpark
HyukjinKwon
committed
[MINOR][DOCS] Fix R documentation generation instruction for roxygen2
HyukjinKwon
committed
[SPARK-23951][SQL] Use actual java class instead of string representation.

hvanhovell
authored and
cloud-fan
committed
[SPARK-23960][SQL][MINOR] Mark HashAggregateExec.bufVars as transient

rednaxelafx
authored and
cloud-fan
committed
[SPARK-6951][CORE] Speed up parsing of event logs during listing.

Marcelo Vanzin
authored and
squito
committed
[SPARK-22941][CORE] Do not exit JVM when submit fails with in-process launcher.

Marcelo Vanzin
authored and
squito
committed
[SPARK-22883] ML test for StructuredStreaming: spark.ml.feature, I-M
jkbradley
committed
typo rawPredicition changed to rawPrediction

JBauerKogentix
authored and
jkbradley
committed

Commits on Apr 12, 2018

Commits on Apr 13, 2018

[SPARK-23867][SCHEDULER] use droppedCount in logWarning

Patrick Pisciuneri
authored and
cloud-fan
committed
[SPARK-23748][SS] Fix SS continuous process doesn't support SubqueryAlias issue

jerryshao
authored and
tdas
committed
[SPARK-23942][PYTHON][SQL] Makes collect in PySpark as action for a query executor listener
HyukjinKwon
committed
[SPARK-23971] Should not leak Spark sessions across test suites

ericl
authored and
gatorsmile
committed
[SPARK-23815][CORE] Spark writer dynamic partition overwrite mode may fail to write output on multi level partition

Fangshi Li
authored and
cloud-fan
committed
[SPARK-23905][SQL] Add UDF weekday

yucai
authored and
gatorsmile
committed
[SPARK-22839][K8S] Refactor to unify driver and executor pod builder APIs

mccheah
authored and
foxish
committed
[SPARK-23896][SQL] Improve PartitioningAwareFileIndex

gengliangwang
authored and
cloud-fan
committed
[SPARK-23375][SQL] Eliminate unneeded Sort in Optimizer

mgaido91
authored and
cloud-fan
committed
[SPARK-23963][SQL] Properly handle large number of columns in query on text-based Hive table

bersprockets
authored and
gatorsmile
committed
[SPARK-23966][SS] Refactoring all checkpoint file writing logic in a common CheckpointFileManager interface
tdas
committed

Commits on Apr 14, 2018

[SPARK-23979][SQL] MultiAlias should not be a CodegenFallback

viirya
authored and
cloud-fan
committed

Commits on Apr 16, 2018

[SPARK-23956][YARN] Use effective RPC port in AM registration

gerashegalov
authored and
jerryshao
committed
[SPARK-23917][SQL] Add array_max function

mgaido91
authored and
gatorsmile
committed
[SPARK-21033][CORE][FOLLOW-UP] Update Spillable

wangyum
authored and
cloud-fan
committed
[SPARK-9312][ML] Add RawPrediction, numClasses, and numFeatures for OneVsRestModel

lu-wang-dl
authored and
jkbradley
committed
[SPARK-21088][ML] CrossValidator, TrainValidationSplit support collect all models when fitting: Python API

WeichenXu123
authored and
jkbradley
committed
Support mounting hostPath volumes for executors
madanadit
committed
Read mode for mounted volumes
madanadit
committed
Refactor
madanadit
committed
Fix style
madanadit
committed
Add unit tests
madanadit
committed
Update comment
madanadit
committed
Fix unit tests
madanadit
committed
Merge
madanadit
committed