[SPARK-9319][SPARKR] Add support for setting column names, types#9218

Closed

felixcheung wants to merge 325 commits intoapache:masterfrom

felixcheung:colnamescoltypes

This pull request is big! We're only showing the most recent 250 commits

Commits on Oct 29, 2015

[SPARK-11322] [PYSPARK] Keep full stack trace in captured exception

viirya
authored and
davies
committed
[SPARK-11379][SQL] ExpressionEncoder can't handle top level primitive type correctly

cloud-fan
authored and
marmbrus
committed
[SPARK-11370] [SQL] fix a bug in GroupedIterator and create unit test for it

cloud-fan
authored and
marmbrus
committed
[SPARK-11318] Include hive profile in make-distribution.sh command

tedyu
authored and
srowen
committed
[SPARK-11388][BUILD] Fix self closing tags.

hvanhovell
authored and
srowen
committed
[SPARK-11246] [SQL] Table cache for Parquet broken in 1.5

xwu0226
authored and
yhuai
committed
[SPARK-11188][SQL] Elide stacktraces in bin/spark-sql for AnalysisExceptions

dilipbiswal
authored and
marmbrus
committed
[SPARK-10641][SQL] Add Skewness and Kurtosis Support

sethah
authored and
mengxr
committed
[SPARK-10532][EC2] Added --profile option to specify the name of profile

teramonagi
authored and
JoshRosen
committed
[SPARK-11236][CORE] Update Tachyon dependency from 0.7.1 -> 0.8.0.

calvinjia
authored and
haoyuan
committed
[SPARK-11301] [SQL] fix case sensitivity for filter on partitioned columns

cloud-fan
authored and
yhuai
committed

Commits on Oct 30, 2015

[SPARK-11409][SPARKR] Enable url link in R doc for Persist

felixcheung
authored and
shivaram
committed
[SPARK-10342] [SPARK-10309] [SPARK-10474] [SPARK-10929] [SQL] Cooperative memory management

Davies Liu
authored and
davies
committed
[SPARK-11417] [SQL] no @Override in codegen

Davies Liu
authored and
davies
committed
[SPARK-11207] [ML] Add test cases for solver selection of LinearRegres…

Lewuathe
authored and
DB Tsai
committed
[SPARK-11103][SQL] Filter applied on Merged Parquet shema with new column fail

HyukjinKwon
authored and
liancheng
committed
[SPARK-11393] [SQL] CoGroupedIterator should respect the fact that GroupedIterator.hasNext is not idempotent

cloud-fan
authored and
marmbrus
committed
[SPARK-10986][MESOS] Set the context class loader in the Mesos executor backend.

dragos
authored and
srowen
committed
[SPARK-11414][SPARKR] Forgot to update usage of 'spark.sparkr.r.command' in RRDD in the PR for SPARK-10971.

Sun Rui
authored and
shivaram
committed
[SPARK-11210][SPARKR] Add window functions into SparkR [step 2].

Sun Rui
authored and
shivaram
committed
[SPARK-11342][TESTS] Allow to set hadoop profile when running dev/ru…

zjffdu
authored and
srowen
committed
[SPARK-11340][SPARKR] Support setting driver properties when starting Spark from R programmatically or from RStudio

felixcheung
authored and
shivaram
committed
[SPARK-11423] remove MapPartitionsWithPreparationRDD

Davies Liu
authored and
davies
committed
Revert "[SPARK-11236][CORE] Update Tachyon dependency from 0.7.1 -> 0.8.0."
yhuai
committed

Commits on Oct 31, 2015

Commits on Nov 1, 2015

[SPARK-11265][YARN] YarnClient can't get tokens to talk to Hive 1.2.1 in a secure cluster

steveloughran
authored and
Marcelo Vanzin
committed
[SPARK-11117] [SPARK-11345] [SQL] Makes all HadoopFsRelation data sources produce UnsafeRow

liancheng
authored and
davies
committed
[SPARK-11305][DOCS] Remove Third-Party Hadoop Distributions Doc Page
srowen
committed
Take R types instead to map to JVM types, add check for NA to keep column
felixcheung
committed
[SPARK-11338] [WEBUI] Prepend app links on HistoryPage with uiRoot path

ckadner
authored and
Marcelo Vanzin
committed
This seems to fix the Rd error - no idea why it worked before.
felixcheung
committed
[SPARK-11410][SQL] Add APIs to provide functionality similar to Hive's DISTRIBUTE BY and SORT BY.

nongli
authored and
yhuai
committed
[SPARK-11020][CORE] Wait for HDFS to leave safe mode before initializing HS.
Marcelo Vanzin
committed
[SPARK-11073][CORE][YARN] Remove akka dependency in secret key generation.
Marcelo Vanzin
committed

Commits on Nov 2, 2015

fix test broken from column name change from cast
felixcheung
committed
[SPARK-9298][SQL] Add pearson correlation aggregation function

viirya
authored and
yhuai
committed
[SPARK-9722] [ML] Pass random seed to spark.ml DecisionTree*

yu-iskw
authored and
DB Tsai
committed
[SPARK-11271][SPARK-11016][CORE] Use Spark BitSet instead of RoaringBitmap to reduce memory usage

viirya
authored and
srowen
committed
[SPARK-11413][BUILD] Bump joda-time version to 2.9 for java 8 and s3

yongjiaw
authored and
srowen
committed
[SPARK-10786][SQL] Take the whole statement to generate the CommandProcessor

SaintBacchus
authored and
liancheng
committed
[SPARK-11311][SQL] spark cannot describe temporary functions

adrian-wang
authored and
liancheng
committed
[SPARK-9817][YARN] Improve the locality calculation of containers by taking pending container requests into consideraion

jerryshao
authored and
Marcelo Vanzin
committed
[SPARK-10997][CORE] Add "client mode" to netty rpc env.
Marcelo Vanzin
committed
[SPARK-11437] [PYSPARK] Don't .take when converting RDD to DataFrame with provided schema

Jason White
authored and
davies
committed
[SPARK-11456][TESTS] Remove deprecated junit.framework in Java tests

srowen
authored and
Imran Rashid
committed
[SPARK-11358][MLLIB] deprecate runs in k-means
mengxr
committed
[SPARK-11371] Make "mean" an alias for "avg" operator

tedyu
authored and
yhuai
committed
[SPARK-11383][DOCS] Replaced example code in mllib-naive-bayes.md/mllib-isotonic-regression.md using include_example

rishabhbhardwaj
authored and
mengxr
committed

Commits on Nov 3, 2015

[SPARK-10286][ML][PYSPARK][DOCS] Add @since annotation to pyspark.ml.param and pyspark.ml.*

lidinghao
authored and
mengxr
committed
[SPARK-11343][ML] Allow float and double prediction/label columns in RegressionEvaluator

Dominik Dahlem
authored and
mengxr
committed
[SPARK-10592] [ML] [PySpark] Deprecate weights and use coefficients instead in ML models

vectorijk
authored and
DB Tsai
committed
[SPARK-11236] [TEST-MAVEN] [TEST-HADOOP1.0] [CORE] Update Tachyon dependency 0.7.1 -> 0.8.1

calvinjia
authored and
pwendell
committed
[MINOR][ML] removed the old `getModelWeights` function
DB Tsai
committed
[SPARK-5354][SQL] Cached tables should preserve partitioning and ord…

nongli
authored and
yhuai
committed
[SPARK-11329][SQL] Support star expansion for structs.

nongli
authored and
yhuai
committed
[SPARK-11432][GRAPHX] Personalized PageRank shouldn't use uniform initialization

Yves Raimond
authored and
DB Tsai
committed
[SPARK-11469][SQL] Allow users to define nondeterministic udfs.
yhuai
committed
[SPARK-9034][SQL] Reflect field names defined in GenericUDTF

navis
authored and
yhuai
committed
[SPARK-9858][SPARK-9859][SPARK-9861][SQL] Add an ExchangeCoordinator to estimate the number of post-shuffle partitions for aggregates and joins
yhuai
committed
[SPARK-10429] [SQL] make mutableProjection atomic

Davies Liu
authored and
marmbrus
committed
[SPARK-11436] [SQL] rebind right encoder when join 2 datasets

cloud-fan
authored and
marmbrus
committed
[SPARK-11404] [SQL] Support for groupBy using column expressions
marmbrus
committed
[SPARK-11344] Made ApplicationDescription and DriverDescription case classes

jacek-lewandowski
authored and
srowen
committed
[SPARK-10533][SQL] handle scientific notation in sqlParser

adrian-wang
authored and
liancheng
committed
[SPARK-11256] Mark all Stage/ResultStage/ShuffleMapStage internal state as private.
rxin
committed
[SPARK-10304] [SQL] Partition discovery should throw an exception if the dir structure is invalid

viirya
authored and
davies
committed
[SPARK-9836][ML] Provide R-like summary statistics for OLS via normal equation solver

yanboliang
authored and
mengxr
committed
[MINOR][ML] Fix naming conventions of AFTSurvivalRegression coefficients

yanboliang
authored and
mengxr
committed
[SPARK-11349][ML] Support transform string label for RFormula

yanboliang
authored and
mengxr
committed
[SPARK-9790][YARN] Expose in WebUI if NodeManager is the reason why executors were killed.

markgrover
authored and
Marcelo Vanzin
committed
[SPARK-10978][SQL] Allow data sources to eliminate filters

liancheng
authored and
yhuai
committed
[SPARK-11407][SPARKR] Add doc for running from RStudio

felixcheung
authored and
shivaram
committed
[SPARK-11467][SQL] add Python API for stddev/variance

Davies Liu
authored and
rxin
committed
[SPARK-11477] [SQL] support create Dataset from RDD

cloud-fan
authored and
marmbrus
committed
Fix typo in WebUI

Jacek Laskowski
authored and
rxin
committed

Commits on Nov 4, 2015

[SPARK-11466][CORE] Avoid mockito in multi-threaded FsHistoryProviderSuite test.
Marcelo Vanzin
committed
[SPARK-11489][SQL] Only include common first order statistics in GroupedData
rxin
committed
[DOC] Missing link to R DataFrame API doc

Lewuathe
authored and
shivaram
committed
[SPARK-11329] [SQL] Cleanup from spark-11329 fix.

Nong
authored and
yhuai
committed
[SPARK-11455][SQL] fix case sensitivity of partition by

cloud-fan
authored and
yhuai
committed
[SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen)

jerryshao
authored and
srowen
committed
[SPARK-11442] Reduce numSlices for local metrics test of SparkListenerSuite

tedyu
authored and
srowen
committed
[SPARK-9492][ML][R] LogisticRegression in R should provide model statistics

yanboliang
authored and
mengxr
committed
[SPARK-11380][DOCS] Replace example code in mllib-frequent-pattern-mining.md using include_example

pravingadakh
authored and
mengxr
committed
[SPARK-11443] Reserve space lines

yinxusen
authored and
mengxr
committed
[SPARK-10622][CORE][YARN] Differentiate dead from "mostly dead" executors.
Marcelo Vanzin
committed
[SPARK-11235][NETWORK] Add ability to stream data using network lib.
Marcelo Vanzin
committed
[SPARK-11485][SQL] Make DataFrameHolder and DatasetHolder public.
rxin
committed
[SPARK-11197][SQL] add doc for run SQL on files directly

cloud-fan
authored and
rxin
committed
[SPARK-11490][SQL] variance should alias var_samp instead of var_pop.

rxin
authored and
yhuai
committed
Closes #9464
rxin
committed
[SPARK-10304][SQL] Following up checking valid dir structure for partition discovery

viirya
authored and
yhuai
committed
[SPARK-11504][SQL] API audit for distributeBy and localSort

rxin
authored and
yhuai
committed
[SPARK-11505][SQL] Break aggregate functions into multiple files
rxin
committed
[SPARK-10949] Update Snappy version to 1.1.2

a-roberts
authored and
rxin
committed
[SPARK-11493] remove bitset from BytesToBytesMap

Davies Liu
authored and
JoshRosen
committed
[SPARK-10028][MLLIB][PYTHON] Add Python API for PrefixSpan

yu-iskw
authored and
mengxr
committed

Commits on Nov 5, 2015

[SPARK-11510][SQL] Remove SQL aggregation tests for higher order statistics

rxin
authored and
yhuai
committed
[SPARK-11491] Update build to use Scala 2.10.5

JoshRosen
authored and
rxin
committed
[SPARK-11398] [SQL] unnecessary def dialectClassName in HiveContext, and misleading dialect conf at the start of spark-sql

Zhenhua Wang
authored and
davies
committed
[SPARK-11307] Reduce memory consumption of OutputCommitCoordinator

JoshRosen
authored and
davies
committed
[SPARK-11425] [SPARK-11486] Improve hybrid aggregation

Davies Liu
authored and
davies
committed
[SPARK-11440][CORE][STREAMING][BUILD] Declare rest of @Experimental items non-experimental if they've existed since 1.2.0
srowen
committed
[SPARK-11378][STREAMING] make StreamingContext.awaitTerminationOrTimeout return properly

ontarionick
authored and
srowen
committed
[SPARK-11449][CORE] PortableDataStream should be a factory

hvanhovell
authored and
srowen
committed
[SPARK-11506][MLLIB] Removed redundant operation in Online LDA implementation

a1singh
authored and
srowen
committed
[MINOR][SQL] A minor log line fix
liancheng
committed
[MINOR][ML][DOC] Rename weights to coefficients in user guide

yanboliang
authored and
mengxr
committed
[SPARK-11527][ML][PYSPARK] PySpark AFTSurvivalRegressionModel should expose coefficients/intercept/scale

yanboliang
authored and
mengxr
committed
[SPARK-11501][CORE][YARN] Propagate spark.rpc config to executors

nishkamravi2
authored and
Marcelo Vanzin
committed
[SPARK-11474][SQL] change fetchSize to fetchsize

Huaxin Gao
authored and
rxin
committed
[SPARK-11473][ML] R-like summary statistics with intercept for OLS via normal equation solver

yanboliang
authored and
mengxr
committed
[SPARK-11484][WEBUI] Using proxyBase set by spark AM

Srinivasa Reddy Vundela
authored and
Marcelo Vanzin
committed
[SPARK-11513][SQL] Remove implicit conversion from LogicalPlan to DataFrame

rxin
authored and
yhuai
committed
[SPARK-10265][DOCUMENTATION, ML] Fixed @Since annotation to ml.regression

ehsanmok
authored and
mengxr
committed
[SPARK-10648] Oracle dialect to handle nonspecific numeric types

travishegner
authored and
yhuai
committed
[SPARK-11532][SQL] Remove implicit conversion from Expression to Column
rxin
committed
[SPARK-11260][SPARKR] with() function support

adrian555
authored and
shivaram
committed
[SPARK-10656][SQL] completely support special chars in DataFrame

cloud-fan
authored and
yhuai
committed
[SPARK-11536][SQL] Remove the internal implicit conversion from Expression to Column in functions.scala
rxin
committed

Commits on Nov 6, 2015

[SPARK-11542] [SPARKR] fix glm with long fomular

Davies Liu
authored and
davies
committed
[SPARK-11537] [SQL] fix negative hours/minutes/seconds

Davies Liu
authored and
davies
committed
Revert "[SPARK-11469][SQL] Allow users to define nondeterministic udfs."
rxin
committed
[SPARK-11514][ML] Pass random seed to spark.ml DecisionTree*

yu-iskw
authored and
jkbradley
committed
[SPARK-11457][STREAMING][YARN] Fix incorrect AM proxy filter conf recovery from checkpoint

jerryshao
authored and
Marcelo Vanzin
committed
[SPARK-11538][BUILD] Force guava 14 in sbt build.
Marcelo Vanzin
committed
[SPARK-11540][SQL] API audit for QueryExecutionListener.
rxin
committed
[SPARK-7542][SQL] Support off-heap index/sort buffer

Davies Liu
authored and
JoshRosen
committed
[SPARK-11528] [SQL] Typed aggregations for Datasets
marmbrus
committed
[SPARK-11541][SQL] Break JdbcDialects.scala into multiple files and mark various dialects as private.
rxin
committed
[SPARK-11453][SQL][FOLLOW-UP] remove DecimalLit

cloud-fan
authored and
rxin
committed
[SPARK-11511][STREAMING] Fix NPE when an InputDStream is not used

zsxwing
authored and
srowen
committed
[SPARK-9162] [SQL] Implement code generation for ScalaUDF

viirya
authored and
davies
committed
[SPARK-10978][SQL][FOLLOW-UP] More comprehensive tests for PR #9399

liancheng
authored and
yhuai
committed
[SPARK-9858][SQL] Add an ExchangeCoordinator to estimate the number of post-shuffle partitions for aggregates and joins (follow-up)
yhuai
committed
Typo fixes + code readability improvements

Jacek Laskowski
authored and
srowen
committed
[SPARK-10116][CORE] XORShiftRandom.hashSeed is random in high bits

squito
authored and
srowen
committed
[SPARK-11450] [SQL] Add Unsafe Row processing to Expand

hvanhovell
authored and
marmbrus
committed
[SPARK-11561][SQL] Rename text data source's column name to value.
rxin
committed
[SPARK-11217][ML] save/load for non-meta estimators and transformers

mengxr
authored and
jkbradley
committed
[SPARK-11555] spark on yarn spark-class --num-workers doesn't work

Thomas Graves
authored and
Marcelo Vanzin
committed
[SPARK-11269][SQL] Java API support & test cases for Dataset

cloud-fan
authored and
rxin
committed
[SPARK-11410] [PYSPARK] Add python bindings for repartition and sortW…

nongli
authored and
davies
committed

Commits on Nov 7, 2015

[SPARK-9241][SQL] Supporting multiple DISTINCT columns (2) - Rewriting Rule

hvanhovell
authored and
marmbrus
committed
[SPARK-11546] Thrift server makes too many logs about result schema

navis
authored and
marmbrus
committed
[HOTFIX] Fix python tests after #9527

marmbrus
authored and
rxin
committed
[SPARK-11389][CORE] Add support for off-heap memory to MemoryManager
JoshRosen
committed
[SPARK-11112] DAG visualization: display RDD callsite
Andrew Or
committed
[SPARK-8467] [MLLIB] [PYSPARK] Add LDAModel.describeTopics() in Python

yu-iskw
authored and
davies
committed
[SPARK-9241][SQL] Supporting multiple DISTINCT columns - follow-up

hvanhovell
authored and
yhuai
committed

Commits on Nov 8, 2015

[SPARK-11362] [SQL] Use Spark BitSet in BroadcastNestedLoopJoin

viirya
authored and
davies
committed
[SPARK-11476][DOCS] Incorrect function referred to in MLib Random data generation documentation
srowen
committed
[DOC][SQL] Remove redundant out-of-place python snippet

rohitagarwal003
authored and
srowen
committed
[SPARK-11451][SQL] Support single distinct count on multiple columns.

hvanhovell
authored and
yhuai
committed
[SPARK-10046][SQL] Hive warehouse dir not set in current directory when not …

xwu0226
authored and
rxin
committed
[SPARK-11554][SQL] add map/flatMap to GroupedDataset

cloud-fan
authored and
marmbrus
committed

Commits on Nov 9, 2015

[SPARK-11564][SQL] Dataset Java API audit
rxin
committed
[SPARK-11453][SQL] append data to partitioned table will messes up the result

cloud-fan
authored and
yhuai
committed
[SPARK-11218][CORE] show help messages for start-slave and start-master

Charles Yeh
authored and
srowen
committed
[DOC][MINOR][SQL] Fix internal link

rohitagarwal003
authored and
srowen
committed
[SPARK-11494][ML][R] Expose R-like summary statistics in SparkR::glm for linear regression

yanboliang
authored and
mengxr
committed
[SPARK-10689][ML][DOC] User guide and example code for AFTSurvivalRegression

yanboliang
authored and
mengxr
committed
[SPARK-11582][MLLIB] specifying pmml version attribute =4.2 in the root node of pmml model

fazlan-nazeem
authored and
mengxr
committed
[SPARK-10565][CORE] add missing web UI stats to /api/v1/applications JSON

Charles Yeh
authored and
squito
committed
[SPARK-11112] Fix Scala 2.11 compilation error in RDDInfo.scala

tedyu
authored and
Andrew Or
committed
[SPARK-9865][SPARKR] Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

felixcheung
authored and
shivaram
committed
[DOCS] Fix typo for Python section on unifying Kafka streams

chriskang90
authored and
srowen
committed
[SPARK-11581][DOCS] Example mllib code in documentation incorrectly computes MSE

bharatl
authored and
jkbradley
committed
[SPARK-10280][MLLIB][PYSPARK][DOCS] Add @since annotation to pyspark.ml.classification

yu-iskw
authored and
mengxr
committed
[SPARK-10471][CORE][MESOS] prevent getting offers for unmet constraints

FelixBechstein0000
authored and
Andrew Or
committed
[SPARK-11552][DOCS][Replaced example code in ml-decision-tree.md using include_example]

agsachin
authored and
mengxr
committed
[SPARK-11548][DOCS] Replaced example code in mllib-collaborative-filtering.md using include_example

rishabhbhardwaj
authored and
mengxr
committed
[SPARK-9301][SQL] Add collect_set and collect_list aggregate functions

nburoojy
authored and
marmbrus
committed
[SPARK-11595] [SQL] Fixes ADD JAR when the input path contains URL scheme

liancheng
authored and
davies
committed
[SPARK-11359][STREAMING][KINESIS] Checkpoint to DynamoDB even when new data doesn't come in

brkyvz
authored and
tdas
committed
[SPARK-6517][MLLIB] Implement the Algorithm of Hierarchical Clustering

yu-iskw
authored and
mengxr
committed
[SPARK-11564][SQL][FOLLOW-UP] improve java api for GroupedDataset

cloud-fan
authored and
marmbrus
committed
[SPARK-9557][SQL] Refactor ParquetFilterSuite and remove old ParquetFilters code

HyukjinKwon
authored and
marmbrus
committed

Commits on Nov 10, 2015

[SPARK-11360][DOC] Loss of nullability when writing parquet files

gatorsmile
authored and
marmbrus
committed
[SPARK-11578][SQL] User API for Typed Aggregation
marmbrus
committed
[SPARK-11564][SQL] Fix documentation for DataFrame.take/collect
rxin
committed
[SPARK-11610][MLLIB][PYTHON][DOCS] Make the docs of LDAModel.describeTopics in Python more specific

yu-iskw
authored and
jkbradley
committed
[SPARK-11069][ML] Add RegexTokenizer option to convert to lowercase

hhbyyh
authored and
jkbradley
committed
[SPARK-11198][STREAMING][KINESIS] Support de-aggregation of records during recovery

brkyvz
authored and
tdas
committed
[SPARK-11141][STREAMING] Batch ReceivedBlockTrackerLogEvents for WAL writes

brkyvz
authored and
tdas
committed
[SPARK-11462][STREAMING] Add JavaStreamingListener

zsxwing
authored and
tdas
committed
[SPARK-11333][STREAMING] Add executorId to ReceiverInfo and display it in UI

zsxwing
authored and
tdas
committed
Add mockito as an explicit test dependency to spark-streaming

brkyvz
authored and
tdas
committed
[SPARK-11587][SPARKR] Fix the summary generic to match base R
shivaram
committed
[SPARK-11599] [SQL] fix NPE when resolve Hive UDF in SQLParser

Davies Liu
authored and
davies
committed
[SPARK-11598] [SQL] enable tests for ShuffledHashOuterJoin

Davies Liu
authored and
davies
committed
Fix typo in driver page

pestilence669
authored and
srowen
committed
[SPARK-11382] Replace example code in mllib-decision-tree.md using include_example

yinxusen
authored and
mengxr
committed
[SPARK-7841][BUILD] Stop using retrieveManaged to retrieve dependencies in SBT

JoshRosen
authored and
marmbrus
committed
[SPARK-11252][NETWORK] ShuffleClient should release connection after fetching blocks had been completed for external shuffle

lianhuiwang
authored and
Marcelo Vanzin
committed
[SPARK-9830][SQL] Remove AggregateExpression1 and Aggregate Operator used to evaluate AggregateExpression1s

yhuai
authored and
marmbrus
committed
[SPARK-10863][SPARKR] Method coltypes() (New version)

Oscar D. Lara Yejas
authored and
shivaram
committed
[SPARK-11578][SQL][FOLLOW-UP] complete the user facing api for typed aggregation

cloud-fan
authored and
marmbrus
committed
[SPARK-11590][SQL] use native json_tuple in lateral view

cloud-fan
authored and
yhuai
committed
[SPARK-10371][SQL] Implement subexpr elimination for UnsafeProjections

nongli
authored and
marmbrus
committed
[ML][R] SparkR::glm summary result to compare with native R

yanboliang
authored and
mengxr
committed
[SPARK-11618][ML] Minor refactoring of basic ML import/export

jkbradley
authored and
mengxr
committed
[SPARK-7316][MLLIB] RDD sliding window with step

unknown
authored and
mengxr
committed
[SPARK-11616][SQL] Improve toString for Dataset
marmbrus
committed
[SPARK-11550][DOCS] Replace example code in mllib-optimization.md using include_example

pravingadakh
authored and
mengxr
committed
[SPARK-11567] [PYTHON] Add Python API for corr Aggregate function

felixcheung
authored and
davies
committed
[SPARK-9818] Re-enable Docker tests for JDBC data source

JoshRosen
authored and
rxin
committed

Commits on Nov 11, 2015

[SPARK-5565][ML] LDA wrapper for Pipelines API
jkbradley
committed
[SPARK-9830][SPARK-11641][SQL][FOLLOW-UP] Remove AggregateExpression1 and update toString of Exchange

yhuai
authored and
rxin
committed
[SPARK-9241][SQL] Supporting multiple DISTINCT columns - follow-up (3)

hvanhovell
authored and
yhuai
committed
[SPARK-10827][CORE] AppClient should not use `askWithReply` in `receiveAndReply`

BryanCutler
authored and
rxin
committed
[SPARK-11566] [MLLIB] [PYTHON] Refactoring GaussianMixtureModel.gaussians in Python

yu-iskw
authored and
davies
committed
[SPARK-10192][CORE] simple test w/ failure involving a shared dependency

squito
authored and
Andrew Or
committed
[SPARK-11572] Exit AsynchronousListenerBus thread when stop() is called

tedyu
authored and
Andrew Or
committed
[SPARK-11615] Drop @VisibleForTesting annotation

tedyu
authored and
Andrew Or
committed
[SPARK-11361][STREAMING] Show scopes of RDD operations inside DStream.foreachRDD and DStream.transform in DAG viz

tdas
authored and
Andrew Or
committed
[MINOR] Fix typo in AggregationQuerySuite.scala

saurfang
authored and
Andrew Or
committed
[MINOR] License header formatting fix

marcprux
authored and
Andrew Or
committed
[SPARK-6726][ML] Import/export for spark.ml LogisticRegressionModel

jkbradley
authored and
mengxr
committed
[SPARK-10192][HOTFIX] Fix NPE in test that was added in #8402
JoshRosen
committed
[SPARK-11468] [SPARKR] add stddev/variance agg functions for Column

felixcheung
authored and
davies
committed
[SPARK-11463] [PYSPARK] only install signal in main thread

Davies Liu
authored and
davies
committed
[SPARK-11290][STREAMING] Basic implementation of trackStateByKey
tdas
committed
[SPARK-11500][SQL] Not deterministic order of columns when using merging schemas.

HyukjinKwon
authored and
liancheng
committed
[SPARK-10371][SQL][FOLLOW-UP] fix code style

cloud-fan
authored and
yhuai
committed
[SPARK-11626][ML] ml.feature.Word2Vec.transform() function very slow

Yuming Wang
authored and
mengxr
committed
[SPARK-11646] WholeTextFileRDD should return Text rather than String
rxin
committed
[SQL][MINOR] rename present to finish in Aggregator

cloud-fan
authored and
rxin
committed
[SPARK-11656][SQL] support typed aggregate in project list

cloud-fan
authored and
marmbrus
committed
[SPARK-11564][SQL][FOLLOW-UP] clean up java tuple encoder

cloud-fan
authored and
marmbrus
committed
[SQL][MINOR] remove newLongEncoder in functions

cloud-fan
authored and
marmbrus
committed
[SPARK-6152] Use shaded ASM5 to support closure cleaning of Java 8 compiled classes

JoshRosen
authored and
marmbrus
committed
[SPARK-11639][STREAMING][FLAKY-TEST] Implement BlockingWriteAheadLog for testing the BatchedWriteAheadLog

brkyvz
authored and
tdas
committed
[SPARK-11644][SQL] Remove the option to turn off unsafe and codegen.
rxin
committed
[SPARK-11645][SQL] Remove OpenHashSet for the old aggregate.
rxin
committed
[SPARK-11335][STREAMING] update kafka direct python docs on how to get the offset ranges for a KafkaRDD

ontarionick
authored and
tdas
committed
[SPARK-11647] Attempt to reduce time/flakiness of Thriftserver CLI and SparkSubmit tests

JoshRosen
authored and
rxin
committed
[SPARK-10827] replace volatile with Atomic* in AppClient.scala.
rxin
committed
[SPARK-11672][ML] disable spark.ml read/write tests
mengxr
committed

Commits on Nov 12, 2015