Skip to content

Commit ea841ef

Browse files
BenFradetsrowen
authored andcommitted
[SPARK-7255] [STREAMING] [DOCUMENTATION] Added documentation for spark.streaming.kafka.maxRetries
Added documentation for spark.streaming.kafka.maxRetries Author: BenFradet <[email protected]> Closes #5808 from BenFradet/master and squashes the following commits: cc72e7a [BenFradet] updated doc for spark.streaming.kafka.maxRetries to explain the default value 18f823e [BenFradet] Added "consecutive" to the spark.streaming.kafka.maxRetries doc 597fdeb [BenFradet] Mention that spark.streaming.kafka.maxRetries only applies to the direct kafka api 0efad39 [BenFradet] Added documentation for spark.streaming.kafka.maxRetries
1 parent 5d6b90d commit ea841ef

File tree

1 file changed

+10
-0
lines changed

1 file changed

+10
-0
lines changed

docs/configuration.md

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1464,6 +1464,16 @@ Apart from these, the following properties are also available, and may be useful
14641464
for more details.
14651465
</td>
14661466
</tr>
1467+
<tr>
1468+
<td><code>spark.streaming.kafka.maxRetries</code></td>
1469+
<td>1</td>
1470+
<td>
1471+
Maximum number of consecutive retries the driver will make in order to find
1472+
the latest offsets on the leader of each partition (a default value of 1
1473+
means that the driver will make a maximum of 2 attempts). Only applies to
1474+
the new Kafka direct stream API.
1475+
</td>
1476+
</tr>
14671477
</table>
14681478

14691479
#### Cluster Managers

0 commit comments

Comments
 (0)