Skip to content

Conversation

@markhamstra
Copy link

No description provided.

jerryshao and others added 22 commits December 15, 2015 09:41
cc\ tdas zsxwing , please review. Thanks a lot.

Author: jerryshao <[email protected]>

Closes apache#10305 from jerryshao/fix-typo-state-impl.

(cherry picked from commit bc1ff9f)
Signed-off-by: Shixiong Zhu <[email protected]>
Author: Michael Armbrust <[email protected]>

Closes apache#10317 from marmbrus/versions.
…ling setConf

This is continuation of SPARK-12056 where change is applied to SqlNewHadoopRDD.scala

andrewor14
FYI

Author: tedyu <[email protected]>

Closes apache#10164 from tedyu/master.

(cherry picked from commit f725b2e)
Signed-off-by: Andrew Or <[email protected]>
…sos cluster mode.

Adding more documentation about submitting jobs with mesos cluster mode.

Author: Timothy Chen <[email protected]>

Closes apache#10086 from tnachen/mesos_supervise_docs.

(cherry picked from commit c2de99a)
Signed-off-by: Andrew Or <[email protected]>
ExternalBlockStore.scala

Author: Naveen <[email protected]>

Closes apache#10313 from naveenminchu/branch-fix-SPARK-9886.

(cherry picked from commit 8a215d2)
Signed-off-by: Andrew Or <[email protected]>
… completes

This change builds the event history of completed apps asynchronously so the RPC thread will not be blocked and allow new workers to register/remove if the event log history is very large and takes a long time to rebuild.

Author: Bryan Cutler <[email protected]>

Closes apache#10284 from BryanCutler/async-MasterUI-SPARK-12062.

(cherry picked from commit c5b6b39)
Signed-off-by: Andrew Or <[email protected]>
…lity

Author: Wenchen Fan <[email protected]>

Closes apache#8645 from cloud-fan/test.

(cherry picked from commit a89e8b6)
Signed-off-by: Andrew Or <[email protected]>
This fixes the sidebar, using a pure CSS mechanism to hide it when the browser's viewport is too narrow.
Credit goes to the original author Titan-C (mentioned in the NOTICE).

Note that I am not a CSS expert, so I can only address comments up to some extent.

Default view:
<img width="936" alt="screen shot 2015-12-14 at 12 46 39 pm" src="https://cloud.githubusercontent.com/assets/7594753/11793597/6d1d6eda-a261-11e5-836b-6eb2054e9054.png">

When collapsed manually by the user:
<img width="1004" alt="screen shot 2015-12-14 at 12 54 02 pm" src="https://cloud.githubusercontent.com/assets/7594753/11793669/c991989e-a261-11e5-8bf6-aecf3bdb6319.png">

Disappears when column is too narrow:
<img width="697" alt="screen shot 2015-12-14 at 12 47 22 pm" src="https://cloud.githubusercontent.com/assets/7594753/11793607/7754dbcc-a261-11e5-8b15-e0d074b0e47c.png">

Can still be opened by the user if necessary:
<img width="651" alt="screen shot 2015-12-14 at 12 51 15 pm" src="https://cloud.githubusercontent.com/assets/7594753/11793612/7bf82968-a261-11e5-9cc3-e827a7a6b2b0.png">

Author: Timothy Hunter <[email protected]>

Closes apache#10297 from thunterdb/12324.

(cherry picked from commit a6325fc)
Signed-off-by: Joseph K. Bradley <[email protected]>
Add ```write.json``` and ```write.parquet``` for SparkR, and deprecated ```saveAsParquetFile```.

Author: Yanbo Liang <[email protected]>

Closes apache#10281 from yanboliang/spark-12310.

(cherry picked from commit 22f6cd8)
Signed-off-by: Shivaram Venkataraman <[email protected]>
cc jkbradley

Author: Yu ISHIKAWA <[email protected]>

Closes apache#10244 from yu-iskw/SPARK-12215.

(cherry picked from commit 26d70bd)
Signed-off-by: Joseph K. Bradley <[email protected]>
shivaram  Please help review.

Author: Jeff Zhang <[email protected]>

Closes apache#10290 from zjffdu/SPARK-12318.

(cherry picked from commit 2eb5af5)
Signed-off-by: Shivaram Venkataraman <[email protected]>
…h Mesos cluster mode.

SPARK_HOME is now causing problem with Mesos cluster mode since spark-submit script has been changed recently to take precendence when running spark-class scripts to look in SPARK_HOME if it's defined.

We should skip passing SPARK_HOME from the Spark client in cluster mode with Mesos, since Mesos shouldn't use this configuration but should use spark.executor.home instead.

Author: Timothy Chen <[email protected]>

Closes apache#10332 from tnachen/scheduler_ui.

(cherry picked from commit ad8c1f0)
Signed-off-by: Andrew Or <[email protected]>
… bisecting k-means

This PR includes only an example code in order to finish it quickly.
I'll send another PR for the docs soon.

Author: Yu ISHIKAWA <[email protected]>

Closes apache#9952 from yu-iskw/SPARK-6518.

(cherry picked from commit 7b6dc29)
Signed-off-by: Joseph K. Bradley <[email protected]>
No known breaking changes, but some deprecations and changes of behavior.

CC: mengxr

Author: Joseph K. Bradley <[email protected]>

Closes apache#10235 from jkbradley/mllib-guide-update-1.6.

(cherry picked from commit 8148cc7)
Signed-off-by: Joseph K. Bradley <[email protected]>
We have DataFrame example for SparkR, we also need to add ML example under ```examples/src/main/r```.

cc mengxr jkbradley shivaram

Author: Yanbo Liang <[email protected]>

Closes apache#10324 from yanboliang/spark-12364.

(cherry picked from commit 1a8b2a1)
Signed-off-by: Joseph K. Bradley <[email protected]>
markhamstra added a commit that referenced this pull request Dec 16, 2015
SKIPME merged Apache branch-1.6
@markhamstra markhamstra merged commit 514c087 into alteryx:csd-1.6 Dec 16, 2015
markhamstra pushed a commit to markhamstra/spark that referenced this pull request Nov 7, 2017
* Configure unit test build while banning flaky tests

* Clean up comment
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.