[WIP] [SPARK-11327] [MESOS] Dispatcher does not respect all args from the Submit request#9752

Closed

jayv wants to merge 1824 commits intoapache:branch-1.5from

jayv:mesos_cluster_params

This pull request is big! We're only showing the most recent 250 commits

Commits on Nov 28, 2015

[SPARK-12028] [SQL] get_json_object returns an incorrect result when the value is null literals

gatorsmile
authored and
davies
committed

Commits on Nov 29, 2015

[SPARK-12029][SPARKR] Improve column functions signature, param check, tests, fix doc and add examples

felixcheung
authored and
shivaram
committed
[SPARK-9319][SPARKR] Add support for setting column names, types

felixcheung
authored and
shivaram
committed
[SPARK-11781][SPARKR] SparkR has problem in inferring type of raw type.

Sun Rui
authored and
shivaram
committed
[SPARK-12024][SQL] More efficient multi-column counting.

hvanhovell
authored and
yhuai
committed

Commits on Nov 30, 2015

[SPARK-12039] [SQL] Ignore HiveSparkSubmitSuite's "SPARK-9757 Persist Parquet relation with decimal column".
yhuai
committed
[SPARK-11859][MESOS] SparkContext accepts invalid Master URLs in the form zk://host:port for a multi-master Mesos cluster using ZooKeeper

toddwan
authored and
srowen
committed
[MINOR][BUILD] Changed the comment to reflect the plugin project is there to support SBT pom reader only.

ScrapCodes
authored and
srowen
committed
[DOC] Explicitly state that top maintains the order of elements

mineo
authored and
srowen
committed
[SPARK-12023][BUILD] Fix warnings while packaging spark with maven.

ScrapCodes
authored and
srowen
committed
[SPARK-11989][SQL] Only use commit in JDBC data source if the underlying database supports transactions

CK50
authored and
rxin
committed
[SPARK-11700] [SQL] Remove thread local SQLContext in SparkPlan

Davies Liu
authored and
davies
committed
[SPARK-11982] [SQL] improve performance of cartesian product

Davies Liu
authored and
davies
committed
[MINOR][DOCS] fixed list display in ml-ensembles

BenFradet
authored and
mengxr
committed
Revert "[SPARK-11206] Support SQL UI on the history server"
JoshRosen
committed
[SPARK-12053][CORE] EventLoggingListener.getLogPath needs 4 parameters

chutium
authored and
sarutak
committed
[SPARK-11689][ML] Add user guide and example code for LDA under spark.ml

hhbyyh
authored and
mengxr
committed
[SPARK-11975][ML] Remove duplicate mllib example (DT/RF/GBT in Java/Python)

yanboliang
authored and
mengxr
committed
[SPARK-11960][MLLIB][DOC] User guide for streaming tests

feynmanliang
authored and
mengxr
committed
fix Maven build
davies
committed

Commits on Dec 1, 2015

[SPARK-12058][HOTFIX] Disable KinesisStreamTests
zsxwing
committed
[SPARK-12000] Fix API doc generation issues
JoshRosen
committed
[SPARK-12035] Add more debug information in include_example tag of Jekyll

yinxusen
authored and
Andrew Or
committed
[SPARK-12037][CORE] initialize heartbeatReceiverRef before calling startDriverHeartbeat

CodingCat
authored and
Andrew Or
committed
[SPARK-12007][NETWORK] Avoid copies in the network lib's RPC layer.

Marcelo Vanzin
authored and
Andrew Or
committed
[SPARK-12049][CORE] User JVM shutdown hook can cause deadlock at shutdown

srowen
authored and
Marcelo Vanzin
committed
[HOTFIX][SPARK-12000] Add missing quotes in Jekyll API docs plugin.
JoshRosen
committed
[SPARK-12018][SQL] Refactor common subexpression elimination code

viirya
authored and
marmbrus
committed
[SPARK-11898][MLLIB] Use broadcast for the global tables in Word2Vec

hhbyyh
authored and
srowen
committed
[SPARK-11949][SQL] Set field nullable property for GroupingSets to get correct results for null values

viirya
authored and
yhuai
committed
[SPARK-12060][CORE] Avoid memory copy in JavaSerializerInstance.serialize
zsxwing
committed
[SPARK-12046][DOC] Fixes various ScalaDoc/JavaDoc issues

liancheng
authored and
marmbrus
committed
[SPARK-12068][SQL] use a single column in Dataset.groupBy and count will fail

cloud-fan
authored and
marmbrus
committed
[SPARK-11856][SQL] add type cast if the real type is different but compatible with encoder schema

cloud-fan
authored and
marmbrus
committed
[SPARK-11954][SQL] Encoder for JavaBeans

cloud-fan
authored and
marmbrus
committed
[SPARK-11905][SQL] Support Persist/Cache and Unpersist in Dataset APIs

gatorsmile
authored and
marmbrus
committed
[SPARK-11821] Propagate Kerberos keytab for all environments

woj-i
authored and
Marcelo Vanzin
committed
[SPARK-12065] Upgrade Tachyon from 0.8.1 to 0.8.2
JoshRosen
committed
[SPARK-12030] Fix Platform.copyMemory to handle overlapping regions.

nongli
authored and
yhuai
committed
[SPARK-12004] Preserve the RDD partitioner through RDD checkpointing

tdas
authored and
Andrew Or
committed
Revert "[SPARK-12060][CORE] Avoid memory copy in JavaSerializerInstance.serialize"
zsxwing
committed
[SPARK-11961][DOC] Add docs of ChiSqSelector

yinxusen
authored and
jkbradley
committed
[SPARK-12002][STREAMING][PYSPARK] Fix python direct stream checkpoint recovery issue

jerryshao
authored and
zsxwing
committed
[SPARK-12075][SQL] Speed up HiveComparisionTest by avoiding / speeding up TestHive.reset()

JoshRosen
authored and
rxin
committed
[SPARK-11328][SQL] Improve error message when hitting this issue

nongli
authored and
yhuai
committed
[SPARK-11788][SQL] surround timestamp/date value with quotes in JDBC data source

Huaxin Gao
authored and
yhuai
committed

Commits on Dec 2, 2015

[SPARK-11352][SQL] Escape */ in the generated comments.
yhuai
committed
[SPARK-11596][SQL] In TreeNode's argString, if a TreeNode is not a child of the current TreeNode, we should only return the simpleString.

yhuai
authored and
marmbrus
committed
[SPARK-8414] Ensure context cleaner periodic cleanups

Andrew Or
authored and
JoshRosen
committed
[SPARK-12081] Make unified memory manager work with small heaps
Andrew Or
committed
[SPARK-12077][SQL] change the default plan for single distinct

Davies Liu
authored and
yhuai
committed
[SPARK-12087][STREAMING] Create new JobConf for every batch in saveAsHadoopFiles

tdas
authored and
zsxwing
committed
[SPARK-11949][SQL] Check bitmasks to set nullable property

viirya
authored and
yhuai
committed
[SPARK-12090] [PYSPARK] consider shuffle in coalesce()

Davies Liu
authored and
davies
committed
[SPARK-3580][CORE] Add Consistent Method To Get Number of RDD Partitions Across Different Languages

Jeroen Schot
authored and
srowen
committed
[SPARK-12094][SQL] Prettier tree string for TreeNode

liancheng
authored and
yhuai
committed
[SPARK-12001] Allow partially-stopped StreamingContext to be completely stopped
JoshRosen
committed
[SPARK-10266][DOCUMENTATION, ML] Fixed @Since annotation for ml.tunning

yu-iskw
authored and
mengxr
committed

Commits on Dec 3, 2015

[SPARK-12093][SQL] Fix the error of comment in DDLParser

watermen
authored and
rxin
committed
[SPARK-12000] do not specify arg types when reference a method in ScalaDoc
mengxr
committed
[SPARK-12082][FLAKY-TEST] Increase timeouts in NettyBlockTransferSecuritySuite

JoshRosen
authored and
rxin
committed
[SPARK-12109][SQL] Expressions's simpleString should delegate to its toString.

yhuai
authored and
rxin
committed
[SPARK-12088][SQL] check connection.isClosed before calling connection…

Huaxin Gao
authored and
srowen
committed
[DOCUMENTATION][MLLIB] typo in mllib doc

zjffdu
authored and
srowen
committed
[DOCUMENTATION][KAFKA] fix typo in kafka/OffsetRange.scala

microwishing
authored and
srowen
committed
[SPARK-12116][SPARKR][DOCS] document how to workaround function name conflicts with dplyr

felixcheung
authored and
shivaram
committed
[SPARK-11314][YARN] add service API and test service for Yarn Cluster schedulers

steveloughran
authored and
Marcelo Vanzin
committed
[SPARK-12059][CORE] Avoid assertion error when unexpected state transition met in Master

jerryshao
authored and
Andrew Or
committed
[SPARK-12101][CORE] Fix thread pools that cannot cache tasks in Worker and AppClient
zsxwing
committed
[SPARK-12108] Make event logs smaller
Andrew Or
committed
[MINOR][ML] Use coefficients replace weights

yanboliang
authored and
mengxr
committed
[SPARK-12107][EC2] Update spark-ec2 versions

nchammas
authored and
shivaram
committed
[FLAKY-TEST-FIX][STREAMING][TEST] Make sure StreamingContexts are shutdown after test
tdas
committed
[SPARK-12019][SPARKR] Support character vector for sparkR.init(), check param and fix doc

felixcheung
authored and
shivaram
committed

Commits on Dec 4, 2015

[SPARK-12056][CORE] Create a TaskAttemptContext only after calling setConf.

Anderson de Andrade
authored and
Marcelo Vanzin
committed
[SPARK-11206] Support SQL UI on the history server (resubmit)

carsonwang
authored and
Marcelo Vanzin
committed
[SPARK-12104][SPARKR] collect() does not handle multiple columns with same name.

Sun Rui
authored and
shivaram
committed
[SPARK-12122][STREAMING] Prevent batches from being submitted twice after recovering StreamingContext from checkpoint
tdas
committed
Add links howto to setup IDEs for developing spark

kaklakariada
authored and
srowen
committed
[SPARK-12089] [SQL] Fix memory corrupt due to freeing a page being referenced

Nong
authored and
davies
committed
[SPARK-6990][BUILD] Add Java linting script; fix minor warnings

dskrvk
authored and
JoshRosen
committed
[SPARK-12058][STREAMING][KINESIS][TESTS] fix Kinesis python tests

brkyvz
authored and
tdas
committed
[SPARK-11314][BUILD][HOTFIX] Add exclusion for moved YARN classes.

Marcelo Vanzin
authored and
JoshRosen
committed

Commits on Dec 5, 2015

[SPARK-12112][BUILD] Upgrade to SBT 0.13.9

JoshRosen
authored and
rxin
committed
[SPARK-12142][CORE]Reply false when container allocator is not ready and reset target

XuTingjun
authored and
Marcelo Vanzin
committed
[SPARK-12080][CORE] Kryo - Support multiple user registrators

rotems
authored and
Marcelo Vanzin
committed
[SPARK-12084][CORE] Fix codes that uses ByteBuffer.array incorrectly

zsxwing
authored and
Marcelo Vanzin
committed
[SPARK-12096][MLLIB] remove the old constraint in word2vec

hhbyyh
authored and
srowen
committed
[SPARK-11994][MLLIB] Word2VecModel load and save cause SparkException when model is bigger than spark.kryoserializer.buffer.max

tmnd1991
authored and
srowen
committed
[SPARK-11988][ML][MLLIB] Update JPMML to 1.2.7
srowen
committed
[SPARK-11774][SPARKR] Implement struct(), encode(), decode() functions in SparkR.

Sun Rui
authored and
shivaram
committed

Commits on Dec 6, 2015

Commits on Dec 7, 2015

[SPARK-12152][PROJECT-INFRA] Speed up Scalastyle checks by only invoking SBT once
JoshRosen
committed
[SPARK-12106][STREAMING][FLAKY-TEST] BatchedWAL test transiently flaky when Jenkins load is high

brkyvz
authored and
tdas
committed
[SPARK-12032] [SQL] Re-order inner joins to do join with conditions first

Davies Liu
authored and
davies
committed
[SPARK-12034][SPARKR] Eliminate warnings in SparkR test cases.

Sun Rui
authored and
shivaram
committed
[SPARK-12132] [PYSPARK] raise KeyboardInterrupt inside SIGINT handler

Davies Liu
authored and
davies
committed
[SPARK-11932][STREAMING] Partition previous TrackStateRDD if partitioner not present
tdas
committed
[SPARK-12060][CORE] Avoid memory copy in JavaSerializerInstance.serialize
zsxwing
committed
[SPARK-11963][DOC] Add docs for QuantileDiscretizer

yinxusen
authored and
jkbradley
committed
[SPARK-11884] Drop multiple columns in the DataFrame API

tedyu
authored and
marmbrus
committed
[SPARK-12184][PYTHON] Make python api doc for pivot consistant with scala doc

aray
authored and
yhuai
committed

Commits on Dec 8, 2015

[SPARK-12160][MLLIB] Use SQLContext.getOrCreate in MLlib

jkbradley
authored and
mengxr
committed
[SPARK-11551][DOC][EXAMPLE] Replace example code in ml-features.md using include_example

somideshmukh
authored and
mengxr
committed
Closes #10098
mengxr
committed
[SPARK-10259][ML] Add @since annotation to ml.classification

Takahashi Hiroshi
authored and
mengxr
committed
[SPARK-11958][SPARK-11957][ML][DOC] SQLTransformer user guide and example code

yanboliang
authored and
mengxr
committed
[SPARK-12103][STREAMING][KAFKA][DOC] document that K means Key and V …

koeninger
authored and
srowen
committed
[SPARK-12166][TEST] Unset hadoop related environment in testing

zjffdu
authored and
srowen
committed
[SPARK-11439][ML] Optimization of creating sparse feature without dense one

Nakul Jindal
authored and
srowen
committed
[SPARK-11551][DOC][EXAMPLE] Revert PR #10002
liancheng
committed
[SPARK-11652][CORE] Remote code execution with InvokerTransformer
srowen
committed
[SPARK-11155][WEB UI] Stage summary json should include stage duration

keypointt
authored and
squito
committed
[SPARK-12074] Avoid memory copy involving ByteBuffer.wrap(ByteArrayOutputStream.toByteArray)

tedyu
authored and
zsxwing
committed
[SPARK-12201][SQL] add type coercion rule for greatest/least

cloud-fan
authored and
marmbrus
committed
[SPARK-12195][SQL] Adding BigDecimal, Date and Timestamp into Encoder

gatorsmile
authored and
marmbrus
committed
[SPARK-12188][SQL] Code refactoring and comment correction in Dataset APIs

gatorsmile
authored and
marmbrus
committed
[SPARK-10393] use ML pipeline in LDA example

hhbyyh
authored and
jkbradley
committed
[SPARK-12205][SQL] Pivot fails Analysis when aggregate is UnresolvedFunction

aray
authored and
yhuai
committed
[SPARK-11605][MLLIB] ML 1.6 QA: API: Java compatibility, docs

hhbyyh
authored and
jkbradley
committed
[SPARK-12159][ML] Add user guide section for IndexToString transformer

BenFradet
authored and
jkbradley
committed
[SPARK-3873][BUILD] Add style checker to enforce import ordering.
Marcelo Vanzin
committed
[SPARK-12187] *MemoryPool classes should not be fully public

Andrew Or
authored and
JoshRosen
committed
[SPARK-12069][SQL] Update documentation with Datasets
marmbrus
committed

Commits on Dec 9, 2015

[SPARK-8517][ML][DOC] Reorganizes the spark.ml user guide

thunterdb
authored and
jkbradley
committed
[SPARK-11343][ML] Documentation of float and double prediction/label columns in RegressionEvaluator

dahlem
authored and
jkbradley
committed
[SPARK-12222] [CORE] Deserialize RoaringBitmap using Kryo serializer throw Buffer underflow exception

scwf
authored and
davies
committed
[SPARK-11676][SQL] Parquet filter tests all pass if filters are not really pushed down

HyukjinKwon
authored and
liancheng
committed
[SPARK-12031][CORE][BUG] Integer overflow when do sampling

uncleGen
authored and
srowen
committed
[SPARK-12012][SQL] Show more comprehensive PhysicalRDD metadata when visualizing SQL query plan

liancheng
authored and
rxin
committed
[SPARK-10299][ML] word2vec should allow users to specify the window size

holdenk
authored and
srowen
committed
[SPARK-10582][YARN][CORE] Fix AM failure situation for dynamic allocation

jerryshao
authored and
Marcelo Vanzin
committed
[SPARK-12241][YARN] Improve failure reporting in Yarn client obtainTokenForHBase()

steveloughran
authored and
Marcelo Vanzin
committed
[SPARK-12165][SPARK-12189] Fix bugs in eviction of storage memory by execution

JoshRosen
authored and
Andrew Or
committed
[SPARK-11824][WEBUI] WebUI does not render descriptions with 'bad' HTML, throws console error
srowen
committed
[SPARK-11551][DOC] Replace example code in ml-features.md using include_example

yinxusen
authored and
mengxr
committed

Commits on Dec 10, 2015

[SPARK-12211][DOC][GRAPHX] Fix version number in graphx doc for migration from 1.1

aray
authored and
jkbradley
committed
[SPARK-12165][ADDENDUM] Fix outdated comments on unroll test

Andrew Or
authored and
JoshRosen
committed
[SPARK-11678][SQL][DOCS] Document basePath in the programming guide.
yhuai
committed
[SPARK-11796] Fix httpclient and httpcore depedency issues related to docker-client

Mark Grover
authored and
JoshRosen
committed
[SPARK-12244][SPARK-12245][STREAMING] Rename trackStateByKey to mapWithState and change tracking function signature

tdas
authored and
zsxwing
committed
[SPARK-12252][SPARK-12131][SQL] refactor MapObjects to make it less hacky

cloud-fan
authored and
liancheng
committed
[SPARK-12136][STREAMING] rddToFileName does not properly handle prefix and suffix parameters

bomeng
authored and
srowen
committed
[SPARK-11530][MLLIB] Return eigenvalues with PCA model
srowen
committed
[SPARK-12242][SQL] Add DataFrame.transform method
rxin
committed
[SPARK-11832][CORE] Process arguments in spark-shell for Scala 2.11

jodersky
authored and
Marcelo Vanzin
committed
[SPARK-12198][SPARKR] SparkR support read.parquet and deprecate parquetFile

yanboliang
authored and
shivaram
committed
[SPARK-11602][MLLIB] Refine visibility for 1.6 scala API audit

hhbyyh
authored and
jkbradley
committed
[SPARK-12234][SPARKR] Fix ```subset``` function error when only set ```select``` argument

yanboliang
authored and
shivaram
committed
[SPARK-12250][SQL] Allow users to define a UDAF without providing details of its inputSchema
yhuai
committed
[SPARK-12228][SQL] Try to run execution hive's derby in memory.
yhuai
committed
[SPARK-12212][ML][DOC] Clarifies the difference between spark.ml, spark.mllib and mllib in the documentation.

thunterdb
authored and
jkbradley
committed
[SPARK-11563][CORE][REPL] Use RpcEnv to transfer REPL-generated classes.
Marcelo Vanzin
committed
[SPARK-11713] [PYSPARK] [STREAMING] Initial RDD updateStateByKey for PySpark

BryanCutler
authored and
davies
committed
[SPARK-12251] Document and improve off-heap memory configurations

JoshRosen
authored and
Andrew Or
committed
[SPARK-12155][SPARK-12253] Fix executor OOM in unified memory management
Andrew Or
committed
[STREAMING][DOC][MINOR] Update the description of direct Kafka stream doc

jerryshao
authored and
zsxwing
committed

Commits on Dec 11, 2015

[SPARK-12258][SQL] passing null into ScalaUDF

Davies Liu
authored and
yhuai
committed
[SPARK-10991][ML] logistic regression training summary handle empty prediction col

holdenk
authored and
DB Tsai
committed
[SPARK-12258] [SQL] passing null into ScalaUDF (follow-up)

Davies Liu
authored and
davies
committed
[SPARK-12146][SPARKR] SparkR jsonFile should support multiple input files

yanboliang
authored and
shivaram
committed
[SPARK-11964][DOCS][ML] Add in Pipeline Import/Export Documentation

bllchmbrs
authored and
jkbradley
committed
[SPARK-12273][STREAMING] Make Spark Streaming web UI list Receivers in order

lw-lin
authored and
zsxwing
committed
[SPARK-11497][MLLIB][PYTHON] PySpark RowMatrix Constructor Has Type Erasure Issue

dusenberrymw
authored and
jkbradley
committed
[SPARK-12217][ML] Document invalid handling for StringIndexer

BenFradet
authored and
jkbradley
committed

Commits on Dec 12, 2015

Commits on Dec 13, 2015

Commits on Dec 14, 2015

Commits on Dec 15, 2015

[SPARK-12327] Disable commented code lintr temporarily
shivaram
committed
[SPARK-12274][SQL] WrapOption should not have type constraint for child

cloud-fan
authored and
marmbrus
committed
[SPARK-12188][SQL][FOLLOW-UP] Code refactoring and comment correction in Dataset APIs

gatorsmile
authored and
marmbrus
committed
[SPARK-12288] [SQL] Support UnsafeRow in Coalesce/Except/Intersect.

gatorsmile
authored and
davies
committed
[SPARK-12332][TRIVIAL][TEST] Fix minor typo in ResetSystemProperties

holdenk
authored and
srowen
committed
[STREAMING][MINOR] Fix typo in function name of StateImpl

jerryshao
authored and
zsxwing
committed

Commits on Dec 16, 2015

[MINOR][ML] Rename weights to coefficients for examples/DeveloperApiExample

yanboliang
authored and
jkbradley
committed
[SPARK-12271][SQL] Improve error message when Dataset.as[ ] has incompatible schemas.

nongli
authored and
marmbrus
committed
[SPARK-12236][SQL] JDBC filter tests all pass if filters are not really pushed down

HyukjinKwon
authored and
marmbrus
committed
[SPARK-12105] [SQL] add convenient show functions

jbonofre
authored and
Andrew Or
committed
[HOTFIX] Compile error from commit 31b3910
Andrew Or
committed
[SPARK-12056][CORE] Part 2 Create a TaskAttemptContext only after calling setConf

tedyu
authored and
Andrew Or
committed
[SPARK-12130] Replace shuffleManagerClass with shortShuffleMgrNames in ExternalShuffleBlockResolver

lianhuiwang
authored and
Andrew Or
committed
[SPARK-12351][MESOS] Add documentation about submitting Spark with mesos cluster mode.

tnachen
authored and
Andrew Or
committed
[SPARK-9516][UI] Improvement of Thread Dump Page

CodingCat
authored and
Andrew Or
committed
[SPARK-9026][SPARK-4514] Modifications to JobWaiter, FutureAction, and AsyncRDDActions to support non-blocking operation

reggert
authored and
Andrew Or
committed
[SPARK-10123][DEPLOY] Support specifying deploy mode from configuration

jerryshao
authored and
Andrew Or
committed
[SPARK-9886][CORE] Fix to use ShutdownHookManager in

naveenminchu
authored and
Andrew Or
committed
[SPARK-12062][CORE] Change Master to asyc rebuild UI when application completes

BryanCutler
authored and
Andrew Or
committed
[SPARK-10477][SQL] using DSL in ColumnPruningSuite to improve readability

cloud-fan
authored and
Andrew Or
committed
[SPARK-4117][YARN] Spark on Yarn handle AM being told command from RM

Devaraj K
authored and
Andrew Or
committed
[SPARK-12304][STREAMING] Make Spark Streaming web UI display more fri…

lw-lin
authored and
zsxwing
committed
[SPARK-12249][SQL] JDBC non-equality comparison operator not pushed down.

HyukjinKwon
authored and
rxin
committed
[SPARK-12314][SQL] isnull operator not pushed down for JDBC datasource.

HyukjinKwon
authored and
rxin
committed
[SPARK-12315][SQL] isnotnull operator not pushed down for JDBC datasource.

HyukjinKwon
authored and
rxin
committed
Style fix for the previous 3 JDBC filter push down commits.
rxin
committed
Revert "[HOTFIX] Compile error from commit 31b3910"
rxin
committed
Revert "[SPARK-12105] [SQL] add convenient show functions"
rxin
committed
[SPARK-12324][MLLIB][DOC] Fixes the sidebar in the ML documentation

thunterdb
authored and
jkbradley
committed
[SPARK-8745] [SQL] remove GenerateProjection

Davies Liu
authored and
davies
committed
[SPARK-12318][SPARKR] Save mode in SparkR should be error by default

zjffdu
authored and
shivaram
committed
[SPARK-12310][SPARKR] Add write.json and write.parquet for SparkR

yanboliang
authored and
shivaram
committed
[SPARK-12215][ML][DOC] User guide section for KMeans in spark.ml

yu-iskw
authored and
jkbradley
committed
[SPARK-12345][MESOS] Filter SPARK_HOME when submitting Spark jobs with Mesos cluster mode.

tnachen
authored and
Andrew Or
committed
[SPARK-6518][MLLIB][EXAMPLE][DOC] Add example code and user guide for bisecting k-means

yu-iskw
authored and
jkbradley
committed
[SPARK-9694][ML] Add random seed Param to Scala CrossValidator

yanboliang
authored and
jkbradley
committed
[SPARK-12309][ML] Use sqlContext from MLlibTestSparkContext for spark.ml test suites

yanboliang
authored and
jkbradley
committed
[SPARK-12361][PYSPARK][TESTS] Should set PYSPARK_DRIVER_PYTHON before Python tests

zjffdu
authored and
JoshRosen
committed
[SPARK-11608][MLLIB][DOC] Added migration guide for MLlib 1.6
jkbradley
committed
[SPARK-12364][ML][SPARKR] Add ML example for SparkR

yanboliang
authored and
jkbradley
committed
[SPARK-12320][SQL] throw exception if the number of fields does not line up for Tuple encoder

cloud-fan
authored and
marmbrus
committed
[SPARK-12164][SQL] Decode the encoded values and then display

gatorsmile
authored and
marmbrus
committed
[SPARK-11677][SQL] ORC filter tests all pass if filters are actually not pushed down.

HyukjinKwon
authored and
marmbrus
committed
[SPARK-9690][ML][PYTHON] pyspark CrossValidator random seed

mmenestret
authored and
jkbradley
committed
[SPARK-12380] [PYSPARK] use SQLContext.getOrCreate in mllib

Davies Liu
authored and
davies
committed

Commits on Dec 17, 2015

[MINOR] Add missing interpolation in NettyRPCEnv

Andrew Or
authored and
zsxwing
committed
MAINTENANCE: Automated closing of pull requests.
Andrew Or
committed
[SPARK-10248][CORE] track exceptions in dagscheduler event loop in tests

squito
authored and
Andrew Or
committed
[SPARK-12365][CORE] Use ShutdownHookManager where Runtime.getRuntime.addShutdownHook() is called

tedyu
authored and
Andrew Or
committed
[SPARK-12186][WEB UI] Send the complete request URI including the query string when redirecting.

Rohit Agarwal
authored and
Andrew Or
committed
[SPARK-12386][CORE] Fix NPE when spark.executor.port is set.

Marcelo Vanzin
authored and
Andrew Or
committed
[SPARK-12390] Clean up unused serializer parameter in BlockManager
Andrew Or
committed
[SPARK-11904][PYSPARK] reduceByKeyAndWindow does not require checkpointing when invFunc is None

dtolpin
authored and
zsxwing
committed
[SPARK-12057][SQL] Prevent failure on corrupt JSON records

yhuai
authored and
rxin
committed
Once driver register successfully, stop it to connect to master.

echoTomei
authored and
davies
committed
Revert "Once driver register successfully, stop it to connect to master."
davies
committed
[SPARK-12395] [SQL] fix resulting columns of outer join

Davies Liu
authored and
davies
committed
[SQL] Update SQLContext.read.text doc

yanboliang
authored and
rxin
committed
[SPARK-12220][CORE] Make Utils.fetchFile support files that contain special characters
zsxwing
committed
[SPARK-12345][MESOS] Properly filter out SPARK_HOME in the Mesos REST server

dragos
authored and
sarutak
committed
[SPARK-12410][STREAMING] Fix places that use '.' and '|' directly in split
zsxwing
committed
[SPARK-12397][SQL] Improve error messages for data sources when they are not found

rxin
authored and
marmbrus
committed
[SPARK-12376][TESTS] Spark Streaming Java8APISuite fails in assertOrderInvariantEquals method

Evan Chen
authored and
zsxwing
committed
[SPARK-8641][SQL] Native Spark Window functions

hvanhovell
authored and
yhuai
committed

Commits on Dec 18, 2015

Messos scheduler does not respect all args from the Submit request
jayv
committed