Skip to content

Commit 2c41170

Browse files
WangTaoTheTonicandrewor14
authored andcommitted
[SPARK-3890][Docs]remove redundant spark.executor.memory in doc
Introduced in pwendell@f7e79bc, I'm not sure why we need two spark.executor.memory here. Author: WangTaoTheTonic <[email protected]> Author: WangTao <[email protected]> Closes apache#2745 from WangTaoTheTonic/redundantconfig and squashes the following commits: e7564dc [WangTao] too long line fdbdb1f [WangTaoTheTonic] trivial workaround d06b6e5 [WangTaoTheTonic] remove redundant spark.executor.memory in doc (cherry picked from commit e7f4ea8) Signed-off-by: Andrew Or <[email protected]>
1 parent 61e5903 commit 2c41170

File tree

1 file changed

+4
-12
lines changed

1 file changed

+4
-12
lines changed

docs/configuration.md

Lines changed: 4 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -153,14 +153,6 @@ Apart from these, the following properties are also available, and may be useful
153153
#### Runtime Environment
154154
<table class="table">
155155
<tr><th>Property Name</th><th>Default</th><th>Meaning</th></tr>
156-
<tr>
157-
<td><code>spark.executor.memory</code></td>
158-
<td>512m</td>
159-
<td>
160-
Amount of memory to use per executor process, in the same format as JVM memory strings
161-
(e.g. <code>512m</code>, <code>2g</code>).
162-
</td>
163-
</tr>
164156
<tr>
165157
<td><code>spark.executor.extraJavaOptions</code></td>
166158
<td>(none)</td>
@@ -329,7 +321,7 @@ Apart from these, the following properties are also available, and may be useful
329321
<td><code>spark.ui.port</code></td>
330322
<td>4040</td>
331323
<td>
332-
Port for your application's dashboard, which shows memory and workload data
324+
Port for your application's dashboard, which shows memory and workload data.
333325
</td>
334326
</tr>
335327
<tr>
@@ -843,8 +835,8 @@ Apart from these, the following properties are also available, and may be useful
843835
<td><code>spark.scheduler.revive.interval</code></td>
844836
<td>1000</td>
845837
<td>
846-
The interval length for the scheduler to revive the worker resource offers to run tasks.
847-
(in milliseconds)
838+
The interval length for the scheduler to revive the worker resource offers to run tasks
839+
(in milliseconds).
848840
</td>
849841
</tr>
850842
</tr>
@@ -856,7 +848,7 @@ Apart from these, the following properties are also available, and may be useful
856848
to wait for before scheduling begins. Specified as a double between 0 and 1.
857849
Regardless of whether the minimum ratio of resources has been reached,
858850
the maximum amount of time it will wait before scheduling begins is controlled by config
859-
<code>spark.scheduler.maxRegisteredResourcesWaitingTime</code>
851+
<code>spark.scheduler.maxRegisteredResourcesWaitingTime</code>.
860852
</td>
861853
</tr>
862854
<tr>

0 commit comments

Comments
 (0)