bump parquet#49

Closed

robert3005 wants to merge 163 commits intomasterfrom

robertk/parquet-bump

Commits on Oct 13, 2016

Commits on Oct 14, 2016

[SPARK-17368][SQL] Add support for value class serialization and deserialization

jodersky
authored and
marmbrus
committed
[SPARK-15957][FOLLOW-UP][ML][PYSPARK] Add Python API for RFormula forceIndexLabel.
yanboliang
committed
[SPARK-17927][SQL] Remove dead code in WriterContainer.

rxin
authored and
cloud-fan
committed
[SPARK-17925][SQL] Break fileSourceInterfaces.scala into multiple pieces

rxin
authored and
cloud-fan
committed
[SPARK-17903][SQL] MetastoreRelation should talk to external catalog instead of hive client
cloud-fan
committed
[SPARK-15402][ML][PYSPARK] PySpark ml.evaluation should support save/load
yanboliang
committed
[SPARK-14634][ML] Add BisectingKMeansSummary

zhengruifeng
authored and
yanboliang
committed
[SPARK-17870][MLLIB][ML] Change statistic to pValue for SelectKBest and SelectPercentile because of DoF difference

Peng
authored and
srowen
committed
[SPARK-17855][CORE] Remove query string from jar url

invkrh
authored and
srowen
committed
[SPARK-17073][SQL][FOLLOWUP] generate column-level statistics

wangzhenhua
authored and
cloud-fan
committed
[DOC] Fix typo in sql hive doc

dhruve
authored and
srowen
committed
Typo: form -> from

ash211
authored and
srowen
committed
[TEST] Ignore flaky test in StreamingQueryListenerSuite
tdas
committed
[SPARK-17941][ML][TEST] Logistic regression tests should use sample weights.

sethah
authored and
DB Tsai
committed
[SPARK-17620][SQL] Determine Serde by hive.default.fileformat when Creating Hive Serde Tables

dilipbiswal
authored and
gatorsmile
committed
Revert "[SPARK-17620][SQL] Determine Serde by hive.default.fileformat when Creating Hive Serde Tables"
yhuai
committed
[SPARK-17863][SQL] should not add column into Distinct

Davies Liu
authored and
yhuai
committed
[SPARK-16063][SQL] Add storageLevel to Dataset

Nick Pentreath
authored and
marmbrus
committed
[SPARK-11775][PYSPARK][SQL] Allow PySpark to register Java UDF

zjffdu
authored and
marmbrus
committed
[SPARK-17900][SQL] Graduate a list of Spark SQL APIs to stable

rxin
authored and
marmbrus
committed

Commits on Oct 15, 2016

[SPARK-17946][PYSPARK] Python crossJoin API similar to Scala

srinathshankar
authored and
rxin
committed
[SPARK-16980][SQL] Load only catalog table partition metadata required to answer a query

Michael Allman
authored and
rxin
committed
[SPARK-17953][DOCUMENTATION] Fix typo in SparkSession scaladoc

tae-jun
authored and
rxin
committed

Commits on Oct 16, 2016

[SPARK-17637][SCHEDULER] Packed scheduling for Spark tasks across executors

Zhan Zhang
authored and
Mridul Muralidharan
committed
Revert "[SPARK-17637][SCHEDULER] Packed scheduling for Spark tasks across executors"
rxin
committed

Commits on Oct 17, 2016

[SPARK-17819][SQL] Support default database in connection URIs for Spark Thrift Server

dongjoon-hyun
authored and
rxin
committed
[SPARK-17947][SQL] Add Doc and Comment about spark.sql.debug

gatorsmile
authored and
cloud-fan
committed
[MINOR][SQL] Add prettyName for current_database function

weiqingy
authored and
rxin
committed
Fix example of tf_idf with minDocFreq

maximerihouey
authored and
srowen
committed
[SPARK-17839][CORE] Use Nio's directbuffer instead of BufferedInputStream in order to avoid additional copy from os buffer cache to user buffer

Sital Kedia
authored and
zsxwing
committed
[SPARK-17751][SQL] Remove spark.sql.eagerAnalysis and Output the Plan if Existed in AnalysisException

gatorsmile
authored and
hvanhovell
committed

Commits on Oct 18, 2016

[SPARK-17620][SQL] Determine Serde by hive.default.fileformat when Creating Hive Serde Tables

dilipbiswal
authored and
gatorsmile
committed
[SPARK-17974] Refactor FileCatalog classes to simplify the inheritance tree

ericl
authored and
rxin
committed
Revert "[SPARK-17974] Refactor FileCatalog classes to simplify the inheritance tree"
rxin
committed
[SQL][STREAMING][TEST] Fix flaky tests in StreamingQueryListenerSuite

lw-lin
authored and
tdas
committed
[SQL][STREAMING][TEST] Follow up to remove Option.contains for Scala 2.10 compatibility
tdas
committed
[SPARK-17899][SQL][FOLLOW-UP] debug mode should work for corrupted table

cloud-fan
authored and
rxin
committed
[SPARK-17388] [SQL] Support for inferring type date/timestamp/decimal for partition column

HyukjinKwon
authored and
davies
committed
[SPARK-17711] Compress rolled executor log

loneknightpy
authored and
tdas
committed
[SPARK-17974] try 2) Refactor FileCatalog classes to simplify the inheritance tree

ericl
authored and
rxin
committed
[SPARK-17985][CORE] Bump commons-lang3 version to 3.5.

ueshin
authored and
rxin
committed
[MINOR][DOC] Add more built-in sources in sql-programming-guide.md

weiqingy
authored and
rxin
committed
[SPARK-17930][CORE] The SerializerInstance instance used when deserializing a TaskResult is not reused

witgo
authored and
zsxwing
committed
[SPARK-17955][SQL] Make DataFrameReader.jdbc call DataFrameReader.format("jdbc").load

HyukjinKwon
authored and
rxin
committed
Revert "[SPARK-17985][CORE] Bump commons-lang3 version to 3.5."
rxin
committed
[SPARK-17841][STREAMING][KAFKA] drain commitQueue

koeninger
authored and
rxin
committed
[SPARK-17817] [PYSPARK] [FOLLOWUP] PySpark RDD Repartitioning Results in Highly Skewed Partition Sizes

viirya
authored and
davies
committed

Commits on Oct 19, 2016

[SPARK-17731][SQL][STREAMING][FOLLOWUP] Refactored StreamingQueryListener APIs
tdas
committed
[SPARK-17980][SQL] Fix refreshByPath for converted Hive tables

ericl
authored and
cloud-fan
committed
[SPARK-17711][TEST-HADOOP2.2] Fix hadoop2.2 compilation error

loneknightpy
authored and
zsxwing
committed
[SPARK-17873][SQL] ALTER TABLE RENAME TO should allow users to specify database in destination table name(but have to be same as source table)

cloud-fan
authored and
yhuai
committed
[SPARK-18001][DOCUMENT] fix broke link to SparkDataFrame

Wenpei
authored and
rxin
committed
[SPARK-17985][CORE] Bump commons-lang3 version to 3.5.

ueshin
authored and
srowen
committed
[SPARK-10541][WEB UI] Allow ApplicationHistoryProviders to provide their own text when there aren't any complete apps

ajbozarth
authored and
Marcelo Vanzin
committed

Commits on Oct 20, 2016

[SPARK-17989][SQL] Check ascendingOrder type in sort_array function rather than throwing ClassCastException

HyukjinKwon
authored and
rxin
committed
[SPARK-18012][SQL] Simplify WriterContainer

rxin
authored and
liancheng
committed
[SPARK-18003][SPARK CORE] Fix bug of RDD zipWithIndex & zipWithUniqueId index value overflowing

WeichenXu123
authored and
rxin
committed
[SPARK-17991][SQL] Enable metastore partition pruning by default.

ericl
authored and
rxin
committed
[SPARK-11653][DEPLOY] Allow spark-daemon.sh to run in the foreground

mikejihbe
authored and
srowen
committed
[SPARK-17796][SQL] Support wildcard character in filename for LOAD DATA LOCAL INPATH

dongjoon-hyun
authored and
srowen
committed
[SPARK-17860][SQL] SHOW COLUMN's database conflict check should respect case sensitivity configuration

dilipbiswal
authored and
cloud-fan
committed
[SPARK-17698][SQL] Join predicates should not contain filter clauses

tejasapatil
authored and
rxin
committed
[SPARK-15780][SQL] Support mapValues on KeyValueGroupedDataset

koertkuipers
authored and
rxin
committed
[SPARK-17999][KAFKA][SQL] Add getPreferredLocations for KafkaSourceRDD

jerryshao
authored and
zsxwing
committed
[SPARK-18021][SQL] Refactor file name specification for data sources
rxin
committed
[DOCS] Update docs to not suggest to package Spark before running tests.

markgrover
authored and
Marcelo Vanzin
committed

Commits on Oct 21, 2016

[SPARK-18030][TESTS] Adds more checks to collect more info about FileStreamSourceSuite failure
zsxwing
committed
[SPARKR] fix warnings

felixcheung
authored and
Felix Cheung
committed
[SPARK-18029][SQL] PruneFileSourcePartitions should not change the output of LogicalRelation
cloud-fan
committed
[SPARK-17960][PYSPARK][UPGRADE TO PY4J 0.10.4]

jagadeesanas2
authored and
srowen
committed
[SPARK-17331][FOLLOWUP][ML][CORE] Avoid allocating 0-length arrays

zhengruifeng
authored and
srowen
committed
[SPARK-13275][WEB UI] Visually clarified executors start time in timeline

ajbozarth
authored and
srowen
committed
[SPARK-18034] Upgrade to MiMa 0.1.11 to fix flakiness
JoshRosen
committed
[SPARK-17674][SPARKR] check for warning in test output

felixcheung
authored and
Felix Cheung
committed
[SPARK-18013][SPARKR] add crossJoin API

felixcheung
authored and
Felix Cheung
committed
[SPARK-17811] SparkR cannot parallelize data.frame with NA or NULL in Date columns

falaki
authored and
Felix Cheung
committed
[SPARK-17926][SQL][STREAMING] Added json for statuses

tdas
authored and
yhuai
committed
[SPARK-17929][CORE] Fix deadlock when CoarseGrainedSchedulerBackend reset

scwf
authored and
zsxwing
committed
[SPARK-18044][STREAMING] FileStreamSource should not infer partitions in every batch

cloud-fan
authored and
zsxwing
committed
[SPARK-17812][SQL][KAFKA] Assign and specific startingOffsets for structured stream

koeninger
authored and
zsxwing
committed
[STREAMING][KAFKA][DOC] clarify kafka settings needed for larger batches

koeninger
authored and
zsxwing
committed

Commits on Oct 22, 2016

Commits on Oct 23, 2016

[SPARK-18035][SQL] Introduce performant and memory efficient APIs to create ArrayBasedMapData

tejasapatil
authored and
gatorsmile
committed
[SPARK-18038][SQL] Move output partitioning definition from UnaryNodeExec to its children

tejasapatil
authored and
hvanhovell
committed
[SPARK-18045][SQL][TESTS] Move `HiveDataFrameAnalyticsSuite` to package `sql`

jiangxb1987
authored and
hvanhovell
committed
[SPARK-18058][SQL] Comparing column types ignoring Nullability in Union and SetOperation

CodingCat
authored and
hvanhovell
committed
[SPARKR][BRANCH-2.0] R merge API doc and example fix

felixcheung
authored and
Felix Cheung
committed

Commits on Oct 24, 2016

Commits on Oct 25, 2016

[SPARK-17624][SQL][STREAMING][TEST] Fixed flaky StateStoreSuite.maintenance

tdas
authored and
zsxwing
committed
[SPARK-18028][SQL] simplify TableFileCatalog
cloud-fan
committed
[SPARK-17409][SQL][FOLLOW-UP] Do Not Optimize Query in CTAS More Than Once

gatorsmile
authored and
cloud-fan
committed
[SPARK-17894][HOTFIX] Fix broken build from

kayousterhout
authored and
zsxwing
committed
[SPARK-17748][ML] One pass solver for Weighted Least Squares with ElasticNet

sethah
authored and
yanboliang
committed
[SPARK-18026][SQL] should not always lowercase partition columns of partition spec in parser
cloud-fan
committed
[SPARK-14634][ML][FOLLOWUP] Delete superfluous line in BisectingKMeans

zhengruifeng
authored and
yanboliang
committed
[SPARK-17748][FOLLOW-UP][ML] Fix build error for Scala 2.10.
yanboliang
committed
[SPARK-18010][CORE] Reduce work performed for building up the application list for the History Server app list UI page

vijoshi
authored and
Marcelo Vanzin
committed
[SPARK-18070][SQL] binary operator should not consider nullability when comparing input types

cloud-fan
authored and
yhuai
committed
[SPARK-18019][ML] Add instrumentation to GBTs

sethah
authored and
jkbradley
committed
[SPARK-16988][SPARK SHELL] spark history server log needs to be fixed to show https url when ssl is enabled

hayashidac
authored and
sarutak
committed

Commits on Oct 26, 2016

[SPARK-18007][SPARKR][ML] update SparkR MLP - add initalWeights parameter

WeichenXu123
authored and
Felix Cheung
committed
[SPARK-17693][SQL] Fixed Insert Failure To Data Source Tables when the Schema has the Comment Field
gatorsmile
committed
[SPARK-18022][SQL] java.lang.NullPointerException instead of real exception when saving DF to MySQL
srowen
committed
[SPARK-18027][YARN] .sparkStaging not clean on RM ApplicationNotFoundException
srowen
committed
[SPARK-4411][WEB UI] Add "kill" link for jobs in the UI

ajbozarth
authored and
srowen
committed
[SPARK-17802] Improved caller context logging.

lins05
authored and
srowen
committed
[SPARK-17733][SQL] InferFiltersFromConstraints rule never terminates for query

jiangxb1987
authored and
hvanhovell
committed
[SPARK-18093][SQL] Fix default value test in SQLConfSuite to work rega…

markgrover
authored and
Marcelo Vanzin
committed
[SPARK-17748][FOLLOW-UP][ML] Reorg variables of WeightedLeastSquares.
yanboliang
committed
[SPARK-13747][SQL] Fix concurrent executions in ForkJoinPool for SQL
zsxwing
committed
[SPARK-18063][SQL] Failed to infer constraints over multiple aliases

jiangxb1987
authored and
rxin
committed
[SPARK-18104][DOC] Don't build KafkaSource doc
zsxwing
committed
[MINOR][ML] Refactor clustering summary.

yanboliang
authored and
jkbradley
committed
[SPARK-17961][SPARKR][SQL] Add storageLevel to DataFrame for SparkR

WeichenXu123
authored and
Felix Cheung
committed
[SPARK-14300][DOCS][MLLIB] Scala MLlib examples code merge and clean up

keypointt
authored and
jkbradley
committed
[SPARK-18094][SQL][TESTS] Move group analytics test cases from `SQLQuerySuite` into a query file test.

jiangxb1987
authored and
rxin
committed
[SPARK-17157][SPARKR] Add multiclass logistic regression SparkR Wrapper

wangmiao1981
authored and
Felix Cheung
committed
[SPARK-18126][SPARK-CORE] getIteratorZipWithIndex accepts negative value as index

Miao Wang
authored and
rxin
committed

Commits on Oct 27, 2016

[SPARK-16963][STREAMING][SQL] Changes to Source trait and related implementation classes

frreiss
authored and
zsxwing
committed
[SPARK-17770][CATALYST] making ObjectType public

ALeksander Eskilson
authored and
marmbrus
committed
[SPARK-18009][SQL] Fix ClassCastException while calling toLocalIterator() on dataframe produced by RunnableCommand

dilipbiswal
authored and
cloud-fan
committed
[SPARK-18132] Fix checkstyle
yhuai
committed
[SPARK-17157][SPARKR][FOLLOW-UP] doc fixes

felixcheung
authored and
Felix Cheung
committed
[SQL][DOC] updating doc for JSON source to link to jsonlines.org

felixcheung
authored and
Felix Cheung
committed
[SPARK-CORE][TEST][MINOR] Fix the wrong comment in test

wangmiao1981
authored and
srowen
committed
[SPARK-17813][SQL][KAFKA] Maximum data per trigger

koeninger
authored and
zsxwing
committed
[SPARK-17219][ML] enhanced NaN value handling in Bucketizer

VinceShieh
authored and
jkbradley
committed
[SPARK-16963][SQL] Fix test "StreamExecution metadata garbage collection"
zsxwing
committed
[SPARK-17970][SQL] store partition spec in metastore for data source table

ericl
authored and
yhuai
committed

Commits on Oct 28, 2016

Commits on Oct 29, 2016

Commits on Oct 30, 2016

[SPARK-16312][FOLLOW-UP][STREAMING][KAFKA][DOC] Add java code snippet for Kafka 0.10 integration doc

lw-lin
authored and
srowen
committed
[SPARK-3261][MLLIB] KMeans clusterer can return duplicate cluster centers
srowen
committed
[SPARK-18146][SQL] Avoid using Union to chain together create table and repair partition commands

ericl
authored and
cloud-fan
committed
[SPARK-18103][SQL] Rename *FileCatalog to *FileIndex

ericl
authored and
rxin
committed
[SPARK-18106][SQL] ANALYZE TABLE should raise a ParseException for invalid option

dongjoon-hyun
authored and
hvanhovell
committed
[SPARK-17919] Make timeout to RBackend configurable in SparkR

falaki
authored and
Felix Cheung
committed
[SPARK-16137][SPARKR] randomForest for R

felixcheung
authored and
Felix Cheung
committed
[SPARK-18110][PYTHON][ML] add missing parameter in Python for RandomForest regression and classification

felixcheung
authored and
Felix Cheung
committed

Commits on Oct 31, 2016

[SPARK-18143][SQL] Ignore Structured Streaming event logs to avoid breaking history server

zsxwing
authored and
tdas
committed
[BUILD] Close stale Pull Requests.
srowen
committed
Merge branch 'master' into palantir-master
Robert Kruszewski
committed
fix merge
Robert Kruszewski
committed
parquet bump
Robert Kruszewski
committed