Skip to content

Commit 4da01e3

Browse files
lianhuiwangpwendell
authored andcommitted
[SPARK-2524] missing document about spark.deploy.retainedDrivers
https://issues.apache.org/jira/browse/SPARK-2524 The configuration on spark.deploy.retainedDrivers is undocumented but actually used https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/deploy/master/Master.scala#L60 Author: lianhuiwang <[email protected]> Author: Wang Lianhui <[email protected]> Author: unknown <[email protected]> Closes apache#1443 from lianhuiwang/SPARK-2524 and squashes the following commits: 64660fd [Wang Lianhui] address pwendell's comments 5f6bbb7 [Wang Lianhui] missing document about spark.deploy.retainedDrivers 44a3f50 [unknown] Merge remote-tracking branch 'upstream/master' eacf933 [lianhuiwang] Merge remote-tracking branch 'upstream/master' 8bbfe76 [lianhuiwang] Merge remote-tracking branch 'upstream/master' 480ce94 [lianhuiwang] address aarondav comments f2b5970 [lianhuiwang] bugfix worker DriverStateChanged state should match DriverState.FAILED
1 parent c119498 commit 4da01e3

File tree

1 file changed

+14
-0
lines changed

1 file changed

+14
-0
lines changed

docs/spark-standalone.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -156,6 +156,20 @@ SPARK_MASTER_OPTS supports the following system properties:
156156

157157
<table class="table">
158158
<tr><th>Property Name</th><th>Default</th><th>Meaning</th></tr>
159+
<tr>
160+
<td><code>spark.deploy.retainedApplications</code></td>
161+
<td>200</td>
162+
<td>
163+
The maximum number of completed applications to display. Older applications will be dropped from the UI to maintain this limit.<br/>
164+
</td>
165+
</tr>
166+
<tr>
167+
<td><code>spark.deploy.retainedDrivers</code></td>
168+
<td>200</td>
169+
<td>
170+
The maximum number of completed drivers to display. Older drivers will be dropped from the UI to maintain this limit.<br/>
171+
</td>
172+
</tr>
159173
<tr>
160174
<td><code>spark.deploy.spreadOut</code></td>
161175
<td>true</td>

0 commit comments

Comments
 (0)