Skip to content

Commit 15d6f18

Browse files
committed
add docs for two configs
1 parent dadee1a commit 15d6f18

File tree

1 file changed

+17
-0
lines changed

1 file changed

+17
-0
lines changed

docs/configuration.md

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -206,6 +206,23 @@ Apart from these, the following properties are also available, and may be useful
206206
used during aggregation goes above this amount, it will spill the data into disks.
207207
</td>
208208
</tr>
209+
<tr>
210+
<td><code>spark.python.profile</code></td>
211+
<td>false</td>
212+
<td>
213+
Enable profiling in Python worker, the profile result will show up by `rdd.show_profile()`,
214+
or it will show up before the driver exit. It also can be dumped into disk by
215+
`rdd.dump_profile(path)`.
216+
</td>
217+
</tr>
218+
<tr>
219+
<td><code>spark.python.profile.dump</code></td>
220+
<td>(none)</td>
221+
<td>
222+
The directory which is used to dump the profile result. The results will be dumped
223+
as sepereted file for each RDD. They can be loaded by ptats.Stats().
224+
</td>
225+
</tr>
209226
<tr>
210227
<td><code>spark.executorEnv.[EnvironmentVariableName]</code></td>
211228
<td>(none)</td>

0 commit comments

Comments
 (0)