[SPARK-14346] [SQL][WIP]Show create table #12132

Closed

xwu0226 wants to merge 111 commits intoapache:masterfrom

xwu0226:show_create_table_1

Commits on Apr 8, 2016

Commits on Apr 9, 2016

[SPARK-14437][CORE] Use the address that NettyBlockTransferService listens to create BlockManagerId
zsxwing
committed
[SPARK-14454] Better exception handling while marking tasks as failed

sameeragarwal
authored and
davies
committed
[SPARK-14498][ML][PYTHON][SQL] Many cleanups to ML and ML-related docs

jkbradley
authored and
DB Tsai
committed
[SPARK-14482][SQL] Change default Parquet codec from gzip to snappy
rxin
committed
[SPARK-14451][SQL] Move encoder definition into Aggregator interface
rxin
committed
[SPARK-14419] [SQL] Improve HashedRelation for key fit within Long

Davies Liu
authored and
davies
committed
[SPARK-14392][ML] CountVectorizer Estimator should include binary toggle Param

wangmiao1981
authored and
MLnick
committed
[SPARK-14496][SQL] fix some javadoc typos

bomeng
authored and
sarutak
committed
[SPARK-14462][ML][MLLIB] add the mllib-local build to maven pom

DB Tsai
authored and
mengxr
committed
[SPARK-14339][DOC] Add python examples for DCT,MinMaxScaler,MaxAbsScaler

zhengruifeng
authored and
mengxr
committed
Revert "[SPARK-14419] [SQL] Improve HashedRelation for key fit within Long"
davies
committed
[SPARK-14335][SQL] Describe function command returns wrong output

yongtang
authored and
yhuai
committed
Revert "[SPARK-14462][ML][MLLIB] add the mllib-local build to maven pom"
mengxr
committed
[SPARK-14481][SQL] Issue Exceptions for All Unsupported Options during Parsing

gatorsmile
authored and
yhuai
committed

Commits on Apr 10, 2016

[SPARK-14362][SPARK-14406][SQL] DDL Native Support: Drop View and Drop Table

gatorsmile
authored and
yhuai
committed
[SPARK-14419] [SQL] Improve HashedRelation for key fit within Long

Davies Liu
authored and
davies
committed
[SPARK-14217] [SQL] Fix bug if parquet data has columns that use dictionary encoding for some of the data

nongli
authored and
davies
committed
[SPARK-13687][PYTHON] Cleanup PySpark parallelize temporary files

holdenk
authored and
srowen
committed
[SPARK-14301][EXAMPLES] Java examples code merge and clean up.

yongtang
authored and
srowen
committed
[SPARK-14465][BUILD] Checkstyle should check all Java files

dongjoon-hyun
authored and
rxin
committed
[SPARK-14506][SQL] HiveClientImpl's toHiveTable misses a table property for external tables

yhuai
authored and
Andrew Or
committed
[SPARK-14455][STREAMING] Fix NPE in allocatedExecutors when calling in receiver-less scenario

jerryshao
authored and
Andrew Or
committed
[SPARK-14357][CORE] Properly handle the root cause being a commit denied exception

jasonmoore2k
authored and
Andrew Or
committed
[SPARK-14497][ML] Use top instead of sortBy() to get top N frequent words as dict in ConutVectorizer

lionelfeng
authored and
mengxr
committed
Update KMeansExample.scala

oluies
authored and
srowen
committed
[SPARK-14415][SQL] All functions should show usages by command `DESC FUNCTION`

dongjoon-hyun
authored and
yhuai
committed

Commits on Apr 11, 2016

[SPARK-14419] [MINOR] coding style cleanup

Davies Liu
authored and
davies
committed
[SPARK-14362][SPARK-14406][SQL][FOLLOW-UP] DDL Native Support: Drop View and Drop Table

gatorsmile
authored and
yhuai
committed
[MINOR][DOCS] Fix wrong data types in JSON Datasets example.

dongjoon-hyun
authored and
srowen
committed
[SPARK-14372][SQL] Dataset.randomSplit() needs a Java version

rekhajoshm
authored and
liancheng
committed
[SPARK-14500] [ML] Accept Dataset[_] instead of DataFrame in MLlib APIs
mengxr
committed
[SPARK-14510][MLLIB] Add args-checking for LDA and StreamingKMeans

zhengruifeng
authored and
mengxr
committed
[SPARK-14462][ML][MLLIB] Add the mllib-local build to maven pom

DB Tsai
authored and
mengxr
committed
[SPARK-14528] [SQL] Fix same result of Union

Davies Liu
authored and
davies
committed
[SPARK-14502] [SQL] Add optimization for Binary Comparison Simplification

dongjoon-hyun
authored and
davies
committed
[SPARK-14494][SQL] Fix the race conditions in MemoryStream and MemorySink

zsxwing
authored and
marmbrus
committed
[SPARK-13600][MLLIB] Use approxQuantile from DataFrame stats in QuantileDiscretizer

Oliver Pierson
authored and
mengxr
committed
[SPARK-14298][ML][MLLIB] Add unit test for EM LDA disable checkpointing

yanboliang
authored and
jkbradley
committed
[SPARK-10521][SQL] Utilize Docker for test DB2 JDBC Dialect support

lresende
authored and
JoshRosen
committed

Commits on Apr 12, 2016

[SPARK-14475] Propagate user-defined context from driver to executors

ericl
authored and
rxin
committed
[SPARK-14520][SQL] Use correct return type in VectorizedParquetInputFormat

viirya
authored and
rxin
committed
[MINOR][ML] Fixed MLlib build warnings

jkbradley
authored and
srowen
committed
[SPARK-14132][SPARK-14133][SQL] Alter table partition DDLs

Andrew Or
authored and
yhuai
committed
[SPARK-14362][SPARK-14406][SQL][FOLLOW-UP] DDL Native Support: Drop View and Drop Table

gatorsmile
authored and
yhuai
committed
[SPARK-14554][SQL] disable whole stage codegen if there are too many input columns

cloud-fan
authored and
yhuai
committed
[SPARK-14535][SQL] Remove buildInternalScan from FileFormat

cloud-fan
authored and
yhuai
committed
[SPARK-14508][BUILD] Add a new ScalaStyle Rule `OmitBracesInCase`

dongjoon-hyun
authored and
rxin
committed
[SPARK-14488][SPARK-14493][SQL] "CREATE TEMPORARY TABLE ... USING ... AS SELECT" shouldn't create persisted table
liancheng
committed
[SPARK-3724][ML] RandomForest: More options for feature subset size.

yongtang
authored and
MLnick
committed
[SPARK-14474][SQL] Move FileSource offset log into checkpointLocation

zsxwing
authored and
marmbrus
committed
[SPARK-12566][SPARK-14324][ML] GLM model family, link function support in SparkR:::glm

yanboliang
authored and
mengxr
committed
[SPARK-13322][ML] AFTSurvivalRegression supports feature standardization

yanboliang
authored and
mengxr
committed
[SPARK-13597][PYSPARK][ML] Python API for GeneralizedLinearRegression

vectorijk
authored and
mengxr
committed
[SPARK-14563][ML] use a random table name instead of __THIS__ in SQLTransformer
mengxr
committed
[SPARK-14147][ML][SPARKR] SparkR predict should not output feature column

yanboliang
authored and
mengxr
committed
[SPARK-14556][SQL] Code clean-ups for package o.a.s.sql.execution.streaming.state

lw-lin
authored and
zsxwing
committed
[SPARK-14562] [SQL] improve constraints propagation in Union

Davies Liu
authored and
davies
committed
[SPARK-14414][SQL] improve the error message class hierarchy

bomeng
authored and
rxin
committed
[SPARK-14513][CORE] Fix threads left behind after stopping SparkContext

chtyim
authored and
rxin
committed
[SPARK-14544] [SQL] improve performance of SQL UI tab

Davies Liu
authored and
davies
committed
[SPARK-14547] Avoid DNS resolution for reusing connections
rxin
committed
[SPARK-14363] Fix executor OOM due to memory leak in the Sorter

Sital Kedia
authored and
davies
committed

Commits on Apr 13, 2016

[SPARK-14578] [SQL] Fix codegen for CreateExternalRow with nested wide schema

Davies Liu
authored and
davies
committed
[SPARK-14579][SQL] Fix a race condition in StreamExecution.processAllAvailable
zsxwing
committed
[MINOR][SQL] Remove some unused imports in datasources.

HyukjinKwon
authored and
cloud-fan
committed
[SPARK-14554][SQL][FOLLOW-UP] use checkDataset to check the result
cloud-fan
committed
[SPARK-13992][CORE][PYSPARK][FOLLOWUP] Update OFF_HEAP semantics for Java api and Python api

lw-lin
authored and
rxin
committed
[SPARK-14537][CORE] Make TaskSchedulerImpl waiting fail if context is shut down

drcrallen
authored and
srowen
committed
Revert "[SPARK-14154][MLLIB] Simplify the implementation for Kolmogorov–Smirnov test"
mengxr
committed
[SPARK-14568][ML] Instrumentation framework for logistic regression

thunterdb
authored and
jkbradley
committed
[SPARK-14388][SQL] Implement CREATE TABLE

Andrew Or
authored and
yhuai
committed
[SPARK-13783][ML] Model export/import for spark.ml: GBTs

yanboliang
authored and
jkbradley
committed
[SPARK-14581] [SQL] push predicatese through more logical plans

Davies Liu
authored and
davies
committed
[SPARK-10386][MLLIB] PrefixSpanModel supports save/load

yanboliang
authored and
jkbradley
committed
[SPARK-14461][ML] GLM training summaries should provide solver

yanboliang
authored and
jkbradley
committed
[SPARK-14375][ML] Unit test for spark.ml KMeansSummary

yanboliang
authored and
jkbradley
committed
[SPARK-14509][DOC] Add python CountVectorizerExample

zhengruifeng
authored and
jkbradley
committed
[SPARK-13089][ML] [Doc] spark.ml Naive Bayes user guide and examples

hhbyyh
authored and
jkbradley
committed
[SPARK-14472][PYSPARK][ML] Cleanup ML JavaWrapper and related class hierarchy

BryanCutler
authored and
jkbradley
committed
merge the code committed by CREATE TABLE native support
xwu0226
committed

Commits on Apr 14, 2016

[SPARK-14607] [SPARK-14484] [SQL] fix case-insensitive predicates in FileSourceStrategy

Davies Liu
authored and
davies
committed
[SPARK-14596][SQL] Remove not used SqlNewHadoopRDD and some more unused imports

HyukjinKwon
authored and
cloud-fan
committed
[SPARK-14573][PYSPARK][BUILD] Fix PyDoc Makefile & highlighting issues

holdenk
authored and
srowen
committed
[MINOR][SQL] Remove extra anonymous closure within functional transformations

HyukjinKwon
authored and
srowen
committed
[SPARK-14518][SQL] Support Comment in CREATE VIEW

gatorsmile
authored and
yhuai
committed
[SPARK-14572][DOC] Update config docs to allow -Xms in extraJavaOptions

dhruve
authored and
Tom Graves
committed
[SPARK-14125][SQL] Native DDL Support: Alter View

gatorsmile
authored and
yhuai
committed
[SPARK-14625] TaskUIData and ExecutorUIData shouldn't be case classes
rxin
committed
[SPARK-14630][BUILD][CORE][SQL][STREAMING] Code style: public abstract methods should have explicit return types

lw-lin
authored and
rxin
committed
[SPARK-14612][ML] Consolidate the version of dependencies in mllib and mllib-local into one place

srowen
authored and
DB Tsai
committed
[SPARK-14619] Track internal accumulators (metrics) by stage attempt

rxin
authored and
Andrew Or
committed
[SPARK-14617] Remove deprecated APIs in TaskMetrics

rxin
authored and
Andrew Or
committed
[SPARK-14558][CORE] In ClosureCleaner, clean the outer pointer if it's a REPL line object

cloud-fan
authored and
Andrew Or
committed
[SPARK-14499][SQL][TEST] Drop Partition Does Not Delete Data of External Tables

gatorsmile
authored and
Andrew Or
committed
[SPARK-14592][SQL] Native support for CREATE TABLE LIKE DDL command

viirya
authored and
Andrew Or
committed
[SPARK-13967][PYSPARK][ML] Added binary Param to Python CountVectorizer

BryanCutler
authored and
Nick Pentreath
committed
[SPARK-14618][ML][DOC] Updated RegressionEvaluator.metricName param doc
jkbradley
committed
[SPARK-14238][ML][MLLIB][PYSPARK] Add binary toggle Param to PySpark HashingTF in ML & MLlib

yongtang
authored and
Nick Pentreath
committed
[SPARK-14545][SQL] Improve `LikeSimplification` by adding `a%b` rule

dongjoon-hyun
authored and
rxin
committed
rework show create ddl based on new native supported create table DDL work
xwu0226
committed
Merge branch 'show_create_table_1' into show_create_table_2
xwu0226
committed