Streamed fetch chunk#8

Closed

squito wants to merge 49 commits intosquito:masterfrom

attilapiros:StreamedFetchChunk

Commits on May 29, 2018

[SPARK-24371][SQL] Added isInCollection in DataFrame API for Scala and Java.
dbtsai
committed

Commits on May 30, 2018

[SPARK-24365][SQL] Add Data Source write benchmark

gengliangwang
authored and
cloud-fan
committed
[SPARK-24331][SPARKR][SQL] Adding arrays_overlap, array_repeat, map_entries to SparkR

mn-mikke
authored and
Felix Cheung
committed
[SPARK-23754][PYTHON] Re-raising StopIteration in client code

e-dorigatti
authored and
HyukjinKwon
committed
[SPARK-24419][BUILD] Upgrade SBT to 0.13.17 with Scala 2.10.7 for JDK9+
dbtsai
committed
[SPARK-24369][SQL] Correct handling for multiple distinct aggregations having the same argument set

maropu
authored and
cloud-fan
committed
[SPARK-24384][PYTHON][SPARK SUBMIT] Add .py files correctly into PythonRunner in submit with client mode in spark-submit

HyukjinKwon
authored and
Marcelo Vanzin
committed
[SPARK-23161][PYSPARK][ML] Add missing APIs to Python GBTClassifier

huaxingao
authored and
BryanCutler
committed
[SPARK-23901][SQL] Add masking functions

mgaido91
authored and
ueshin
committed
[SPARK-24276][SQL] Order of literals in IN should not affect semantic equality

mgaido91
authored and
gatorsmile
committed

Commits on May 31, 2018

[SPARK-24337][CORE] Improve error messages for Spark conf values

PenguinToast
authored and
gatorsmile
committed
[SPARK-24146][PYSPARK][ML] spark.ml parity for sequential pattern mining - PrefixSpan: Python API

WeichenXu123
authored and
mengxr
committed
[WEBUI] Avoid possibility of script in query param keys

srowen
authored and
Marcelo Vanzin
committed
[SPARK-24414][UI] Calculate the correct number of tasks for a stage.
Marcelo Vanzin
committed
[SPARK-24397][PYSPARK] Added TaskContext.getLocalProperty(key) in Python
tdas
committed
[SPARK-23900][SQL] format_number support user specifed format as argument

wangyum
authored and
ueshin
committed
[SPARK-24232][K8S] Add support for secret env vars

Stavros Kontopoulos
authored and
foxish
committed

Commits on Jun 1, 2018

[MINOR][YARN] Add YARN-specific credential providers in debug logging message

HyukjinKwon
authored and
jerryshao
committed
[SPARK-24330][SQL] Refactor ExecuteWriteTask and Use `while` in writing files

gengliangwang
authored and
cloud-fan
committed
[SPARK-24444][DOCS][PYTHON] Improve Pandas UDF docs to explain column assignment

BryanCutler
authored and
HyukjinKwon
committed
[SPARK-24326][MESOS] add support for local:// scheme for the app jar

Stavros Kontopoulos
authored and
Felix Cheung
committed
[SPARK-23920][SQL] add array_remove to remove all elements that equal element from array

huaxingao
authored and
ueshin
committed
[SPARK-24351][SS] offsetLog/commitLog purge thresholdBatchId should be computed with current committed epoch but not currentBatchId in CP mode

ivoson
authored and
zsxwing
committed
Revert "[SPARK-24369][SQL] Correct handling for multiple distinct aggregations having the same argument set"
gatorsmile
committed
[INFRA] Close stale PRs.
Marcelo Vanzin
committed
[SPARK-24340][CORE] Clean up non-shuffle disk block manager files following executor exits on a Standalone cluster

jiangxb1987
authored and
gatorsmile
committed

Commits on Jun 2, 2018

[SPARK-23668][K8S] Added missing config property in running-on-kubernetes.md

liyinan926
authored and
Felix Cheung
committed

Commits on Jun 3, 2018

[SPARK-24356][CORE] Duplicate strings in File.path managed by FileSegmentManagedBuffer

misha-cloudera
authored and
srowen
committed

Commits on Jun 4, 2018

[SPARK-24455][CORE] fix typo in TaskSchedulerImpl comment

xueyu
authored and
HyukjinKwon
committed
[SPARK-24369][SQL] Correct handling for multiple distinct aggregations having the same argument set

cloud-fan
authored and
gatorsmile
committed
[SPARK-23786][SQL] Checking column names of csv headers

MaxGekk
authored and
gatorsmile
committed
[SPARK-23903][SQL] Add support for date extract

wangyum
authored and
ueshin
committed
[SPARK-21896][SQL] Fix StackOverflow caused by window functions inside aggregate functions

aokolnychyi
authored and
cloud-fan
committed
[SPARK-24290][ML] add support for Array input for instrumentation.logNamedValue

lu-wang-dl
authored and
mengxr
committed
[SPARK-24300][ML] change the way to set seed in ml.cluster.LDASuite.generateLDAData

lu-wang-dl
authored and
mengxr
committed

Commits on Jun 5, 2018