Skip to content

Commit c5fe412

Browse files
10110346srowen
authored andcommitted
[SPARK-18188][DOC][FOLLOW-UP] Add spark.broadcast.checksum to configuration
## What changes were proposed in this pull request? This pr add `spark.broadcast.checksum` to configuration. ## How was this patch tested? manually tested Author: liuxian <[email protected]> Closes #21825 from 10110346/checksum_config.
1 parent ce084d3 commit c5fe412

File tree

1 file changed

+9
-0
lines changed

1 file changed

+9
-0
lines changed

docs/configuration.md

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1217,6 +1217,15 @@ Apart from these, the following properties are also available, and may be useful
12171217
if it is too small, <code>BlockManager</code> might take a performance hit.
12181218
</td>
12191219
</tr>
1220+
<tr>
1221+
<td><code>spark.broadcast.checksum</code></td>
1222+
<td>true</td>
1223+
<td>
1224+
Whether to enable checksum for broadcast. If enabled, broadcasts will include a checksum, which can
1225+
help detect corrupted blocks, at the cost of computing and sending a little more data. It's possible
1226+
to disable it if the network has other mechanisms to guarantee data won't be corrupted during broadcast.
1227+
</td>
1228+
</tr>
12201229
<tr>
12211230
<td><code>spark.executor.cores</code></td>
12221231
<td>

0 commit comments

Comments
 (0)