Merge#3

Merged

Deegue merged 87 commits intoDeegue:masterfrom

Nov 5, 2019

Commits on Oct 28, 2019

[SPARK-29617][BUILD] Upgrade to ORC 1.5.7
dongjoon-hyun
committed
[SPARK-29008][SQL][FOLLOW-UP] Checks correct param lengths of split methods

maropu
authored and
dongjoon-hyun
committed
[SPARK-28560][SQL][FOLLOWUP] change the local shuffle reader from leaf node to unary node

JkSelf
authored and
cloud-fan
committed
Revert "[SPARK-29528][BUILD][TEST-MAVEN] Upgrade scala-maven-plugin to 4.2.4 for Scala 2.13.1"
HyukjinKwon
committed
[SPARK-28158][SQL] Hive UDFs supports UDT type

uncleGen
authored and
HyukjinKwon
committed
[SPARK-29599][WEBUI] Support pagination for session table in JDBC/ODBC Tab

AngersZhuuuu
authored and
srowen
committed
[SPARK-29521][SQL] LOAD DATA INTO TABLE should look up catalog/table like v2 commands

viirya
authored and
cloud-fan
committed
[SPARK-29509][SQL][SS] Deduplicate codes from Kafka data source

HeartSaVioR
authored and
Marcelo Vanzin
committed
[SPARK-29609][SQL] DataSourceV2: Support DROP NAMESPACE

imback82
authored and
dongjoon-hyun
committed

Commits on Oct 29, 2019

[SPARK-29566][ML] Imputer should support single-column input/output

huaxingao
authored and
zhengruifeng
committed
[SPARK-28158][SQL][FOLLOWUP] HiveUserDefinedTypeSuite: don't use RandomDataGenerator to create row for UDT backed by ArrayType

HeartSaVioR
authored and
cloud-fan
committed
Prepare Spark release v3.0.0-preview-rc1

jiangxb1987
and
HyukjinKwon
committed
Revert "Prepare Spark release v3.0.0-preview-rc1"
jiangxb1987
committed
[SPARK-29612][SQL] ALTER TABLE (RECOVER PARTITIONS) should look up catalog/table like v2 commands

huaxingao
authored and
cloud-fan
committed
[SPARK-29565][ML][PYTHON] OneHotEncoder should support single-column input/output

huaxingao
authored and
viirya
committed
[SPARK-29607][SQL] Move static methods from CalendarInterval to IntervalUtils

MaxGekk
authored and
cloud-fan
committed
[SPARK-29637][CORE] Add description to Job SHS web API

gaborgsomogyi
authored and
Marcelo Vanzin
committed
[SPARK-28746][SQL] Add partitionby hint for sql queries

ulysses-you
authored and
maropu
committed

Commits on Oct 30, 2019

[SPARK-29629][SQL] Support typed integer literal expression

yaooqinn
authored and
HyukjinKwon
committed
[SPARK-29627][PYTHON][SQL] Allow array_contains to take column instances
HyukjinKwon
committed
[SPARK-29110][SQL][TESTS] Port window.sql (Part 4)

DylanGuedes
authored and
HyukjinKwon
committed
[MINOR][DOCS] Use proper html tag in markdown

uncleGen
authored and
HyukjinKwon
committed
[SPARK-29604][SQL] Force initialize SessionState before initializing HiveClient in SparkSQLEnv

HeartSaVioR
authored and
dongjoon-hyun
committed
[SPARK-29653][SQL] Fix MICROS_PER_MONTH in IntervalUtils

yaooqinn
authored and
dongjoon-hyun
committed
[SPARK-29120][SQL][TESTS] Port create_view.sql

maropu
authored and
dongjoon-hyun
committed
[SPARK-29668][DOCS] Deprecate Python 3 prior to version 3.6
dongjoon-hyun
committed
[SPARK-29646][BUILD] Allow pyspark version name format `${versionNumber}-preview` in release script

jiangxb1987
authored and
dongjoon-hyun
committed
[SPARK-29666][BUILD] Fix the publish release failure under dry-run mode

jiangxb1987
authored and
dongjoon-hyun
committed

Commits on Oct 31, 2019

Commits on Nov 1, 2019

[SPARK-29664][PYTHON][SQL] Column.getItem behavior is not consistent with Scala

imback82
authored and
HyukjinKwon
committed
[SPARK-29676][SQL] ALTER TABLE (RENAME PARTITION) should look up catalog/table like v2 commands

huaxingao
authored and
viirya
committed
[SPARK-29686][ML] LinearSVC should persist instances if needed
zhengruifeng
committed
[SPARK-29486][SQL] CalendarInterval should have 3 fields: months, days and microseconds

LinhongLiu
authored and
cloud-fan
committed
[SPARK-29643][SQL] ALTER TABLE/VIEW (DROP PARTITION) should look up catalog/table like v2 commands

huaxingao
authored and
cloud-fan
committed
[SPARK-29109][SQL][TESTS] Port window.sql (Part 3)

DylanGuedes
authored and
maropu
committed
[SPARK-29452][WEBUI] Improve Storage tab tooltip

iRakson
authored and
srowen
committed
[MINOR][PYSPARK][DOCS] Fix typo in example documentation

mstill3
authored and
dongjoon-hyun
committed

Commits on Nov 2, 2019

Commits on Nov 3, 2019

Commits on Nov 4, 2019

[SPARK-29722][SQL] Non reversed keywords should be able to be used in high order functions

yaooqinn
authored and
HyukjinKwon
committed
[SPARK-29343][SQL] Eliminate sorts without limit in the subquery of Join/Aggregation

WangGuangxin
authored and
cloud-fan
committed
[SPARK-29671][SQL] Simplify string representation of intervals

MaxGekk
authored and
dongjoon-hyun
committed
[SPARK-29353][SQL] Fallback AlterTableAlterColumnStatement to v1 AlterTableChangeColumnCommand

viirya
authored and
cloud-fan
committed
[SPARK-29739][PYSPARK][TESTS] Use `java` instead of `cc` in test_pipe_functions
dongjoon-hyun
committed
[SPARK-29736][TESTS] Improve stability of tests for special datetime values

MaxGekk
authored and
cloud-fan
committed
[SPARK-29285][SHUFFLE] Temporary shuffle files should be able to handle disk failures

yaooqinn
authored and
cloud-fan
committed
[SPARK-29590][WEBUI] JDBC/ODBC tab in the spark UI support hide tables, to make it consistent with other tabs

shahidki31
authored and
srowen
committed
[SPARK-29678][SQL] ALTER TABLE (ADD PARTITION) should look up catalog/table like v2 commands

imback82
authored and
cloud-fan
committed
[SPARK-29663][SQL] Support sum with interval type values

yaooqinn
authored and
cloud-fan
committed
[SPARK-29742][BUILD] Update checkstyle plugin's check dir scope

AngersZhuuuu
authored and
dongjoon-hyun
committed
[SPARK-28798][DOC][SQL] Document DROP TABLE/VIEW statement in SQL Reference

shivusondur
authored and
srowen
committed
[SPARK-28809][DOC][SQL] Document SHOW TABLE in SQL Reference

shivusondur
authored and
srowen
committed
[SPARK-29743][SQL] sample should set needCopyResult to true if its child is

cloud-fan
authored and
dongjoon-hyun
committed
[SPARK-29723][SQL] Get date and time parts of an interval as java classes

MaxGekk
authored and
dongjoon-hyun
committed
[SPARK-29397][CORE] Extend plugin interface to include the driver
Marcelo Vanzin
committed
[SPARK-28552][SQL] Case-insensitive database URLs in JdbcDialect

committed
[SPARK-20568][SS] Provide option to clean up completed files in streaming query

HeartSaVioR
authored and
Marcelo Vanzin
committed

Commits on Nov 5, 2019

[SPARK-29747][BUILD] Bump joda-time version to 2.10.5

viirya
authored and
HyukjinKwon
committed
[SPARK-29734][SQL] Datasource V2: Support SHOW CURRENT NAMESPACE

imback82
authored and
dongjoon-hyun
committed
[SPARK-29696][SQL][TESTS] Port groupingsets.sql

maropu
authored and
dongjoon-hyun
committed
[SPARK-29630][SQL] Disallow creating a permanent view that references a temporary view in an expression

imback82
authored and
cloud-fan
committed
[SPARK-29695][SQL] ALTER TABLE (SerDe properties) should look up catalog/table like v2 commands

huaxingao
authored and
dongjoon-hyun
committed
[SPARK-29648][SQL][TESTS] Port limit.sql

maropu
authored and
dongjoon-hyun
committed