From 0ce2f9c3183e152eeac266486c6b46050278f4f5 Mon Sep 17 00:00:00 2001 From: Nick Pritchard Date: Fri, 9 Oct 2015 14:58:34 -0700 Subject: [PATCH] document additional ui configurations --- docs/configuration.md | 14 ++++++++++++++ 1 file changed, 14 insertions(+) diff --git a/docs/configuration.md b/docs/configuration.md index 154a3aee6855..e6662b780057 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -565,6 +565,20 @@ Apart from these, the following properties are also available, and may be useful How many finished drivers the Spark UI and status APIs remember before garbage collecting. + + spark.sql.ui.retainedExecutions + 1000 + + How many finished executions the Spark UI and status APIs remember before garbage collecting. + + + + spark.streaming.ui.retainedBatches + 1000 + + How many finished batches the Spark UI and status APIs remember before garbage collecting. + + #### Compression and Serialization