Spark - July 31, 2017#3

Merged

pgandhi999 merged 23 commits intopgandhi999:SPARK-21585from

Jul 31, 2017

Commits on Jul 27, 2017

[SPARK-21530] Update description of spark.shuffle.maxChunksBeingTransferred.

jinxing
authored and
cloud-fan
committed
[SPARK-21271][SQL] Ensure Unsafe.sizeInBytes is a multiple of 8

kiszk
authored and
cloud-fan
committed
[SPARK-21440][SQL][PYSPARK] Refactor ArrowConverters and add ArrayType and StructType support.

ueshin
authored and
cloud-fan
committed
[SPARK-19270][ML] Add summary table to GLM summary

actuaryzhang
authored and
yanboliang
committed
[SPARK-21319][SQL] Fix memory leak in sorter
cloud-fan
committed
[SPARK-21538][SQL] Attribute resolution inconsistency in the Dataset API

aokolnychyi
authored and
gatorsmile
committed

Commits on Jul 28, 2017

[SPARK-21306][ML] OneVsRest should support setWeightCol

facaiy
authored and
yanboliang
committed
[MINOR][BUILD] Fix current lint-java failures
srowen
committed
[SPARK-21553][SPARK SHELL] Add the description of the default value of master parameter in the spark-shell

davidxdh
authored and
srowen
committed
[SPARK-21541][YARN] Spark Logs show incorrect job status for a job that does not create SparkContext

pgandhi
authored and
Tom Graves
committed
Typo in comment

nahoj
authored and
srowen
committed

Commits on Jul 29, 2017

[SPARK-20090][PYTHON] Add StructType.fieldNames in PySpark

HyukjinKwon
authored and
holdenk
committed
[SPARK-21508][DOC] Fix example code provided in Spark Streaming Documentation

Remis Haroon
authored and
srowen
committed
[SPARK-21357][DSTREAMS] FileInputDStream not remove out of date RDD

shaofei007
authored and
srowen
committed
[SPARK-21555][SQL] RuntimeReplaceable should be compared semantically by its canonicalized child

viirya
authored and
gatorsmile
committed
[SPARK-19451][SQL] rangeBetween method should accept Long value as boundary

jiangxb1987
authored and
gatorsmile
committed
[SPARK-20962][SQL] Support subquery column aliases in FROM clause

maropu
authored and
gatorsmile
committed

Commits on Jul 30, 2017

[SQL] Fix typo in DataframeWriter doc

GuoChenzhao
authored and
HyukjinKwon
committed
[SPARK-21297][WEB-UI] Add count in 'JDBC/ODBC Server' page.

guoxiaolong
authored and
srowen
committed
[MINOR][DOC] Replace numTasks with numPartitions in programming guide

polarker
authored and
srowen
committed

Commits on Jul 31, 2017

[MINOR] Minor comment fixes in merge_spark_pr.py script
HyukjinKwon
committed
[SPARK-19839][CORE] release longArray in BytesToBytesMap

Zhan Zhang
authored and
gatorsmile
committed
[SPARK-21575][SPARKR] Eliminate needless synchronization in java-R serialization

SereneAnt
authored and
yanboliang
committed