sync#21

Merged

GuoPhilipse merged 63 commits intoGuoPhilipse:masterfrom

Jul 16, 2020

Commits on Jul 9, 2020

[SPARK-32024][WEBUI][FOLLOWUP] Quick fix on test failure on missing when statements

HeartSaVioR
authored and
HyukjinKwon
committed
[SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors

ueshin
authored and
HyukjinKwon
committed
[SPARK-28067][SPARK-32018] Fix decimal overflow issues

cloud-fan
authored and
HyukjinKwon
committed
[SPARK-32193][SQL][DOCS] Update regexp usage in SQL docs

GuoPhilipse
authored and
maropu
committed
[SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

HeartSaVioR
authored and
cloud-fan
committed
[SPARK-32231][R][INFRA] Use Hadoop 3.2 winutils in AppVeyor build

dongjoon-hyun
and
HyukjinKwon
committed
[SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

erikerlandson
authored and
cloud-fan
committed
[SPARK-32192][SQL] Print column name when throws ClassCastException

xiepengjie
authored and
srowen
committed
[SPARK-32035][DOCS][EXAMPLES] Fixed typos involving AWS Access, Secret, & Sessions tokens

kaxio
authored and
dongjoon-hyun
committed
[SPARK-31831][SQL] HiveSessionImplSuite flakiness fix via mocking instances earlier than initializing HiveSessionImpl

HeartSaVioR
authored and
dongjoon-hyun
committed

Commits on Jul 10, 2020

Commits on Jul 11, 2020

[SPARK-32238][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

Ngone51
authored and
dongjoon-hyun
committed
[SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

attilapiros
authored and
HeartSaVioR
committed
[SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

MaxGekk
authored and
HyukjinKwon
committed
[SPARK-32232][ML][PYSPARK] Make sure ML has the same default solver values between Scala and Python

huaxingao
authored and
srowen
committed
[SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

williamhyun
authored and
HyukjinKwon
committed
[SPARK-32245][INFRA] Run Spark tests in Github Actions

HyukjinKwon
authored and
dongjoon-hyun
committed
[SPARK-32200][WEBUI] Redirect to the history page when accessed to /history on the HistoryServer without appliation id

sarutak
authored and
dongjoon-hyun
committed
[SPARK-29292][SPARK-30010][CORE] Let core compile for Scala 2.13

srowen
authored and
dongjoon-hyun
committed
[SPARK-31226][CORE][TESTS] SizeBasedCoalesce logic will lose partition

AngersZhuuuu
authored and
dongjoon-hyun
committed
[SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

viirya
authored and
dongjoon-hyun
committed

Commits on Jul 12, 2020

[SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

Ngone51
authored and
maropu
committed
[MINOR][SQL][DOCS] consistency in argument naming for time functions

Michael Chirico
authored and
srowen
committed
[MINOR][DOCS] Fix typo in PySpark example in ml-datasource.md

ChuliangXiao
authored and
dongjoon-hyun
committed
[SPARK-32270][SQL] Use TextFileFormat in CSV's schema inference with a different encoding

HyukjinKwon
authored and
dongjoon-hyun
committed
[SPARK-31831][SQL][TESTS] Use subclasses for mock in HiveSessionImplSuite

Frank Yin
authored and
HeartSaVioR
committed
[SPARK-32245][INFRA][FOLLOWUP] Reenable Github Actions on commit
dongjoon-hyun
committed
[SPARK-32258][SQL] NormalizeFloatingNumbers directly normalizes IF/CaseWhen/Coalesce child expressions

viirya
authored and
dongjoon-hyun
committed

Commits on Jul 14, 2020

Commits on Jul 15, 2020

Commits on Jul 16, 2020

[SPARK-32125][UI] Support get taskList by status in Web UI and SHS Rest API

Warren Zhu
authored and
gengliangwang
committed