From f8cda0de9f2f55f258a3de5d331b37a0e4b05ba9 Mon Sep 17 00:00:00 2001 From: "Mark G. Whitney" Date: Sat, 30 Aug 2014 23:04:23 -0400 Subject: [PATCH 1/2] [SPARK-2558][DOCS] Add spark.yarn.queue description to YARN doc Put original YARN queue spark-submit arg description in running-on-yarn html table and example command line --- docs/running-on-yarn.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 943f06b114cb..22a8359d4fe1 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -125,6 +125,13 @@ Most of the configs are the same for Spark on YARN as for other deployment modes the environment of the executor launcher. + + spark.yarn.queue + default + + The YARN queue to use for allocation requests. + + # Launching Spark on YARN @@ -148,6 +155,7 @@ For example: --driver-memory 4g \ --executor-memory 2g \ --executor-cores 1 \ + --queue thequeue \ lib/spark-examples*.jar \ 10 From 4b5d808612a15b8aadc90df03157ed6bdc22cc74 Mon Sep 17 00:00:00 2001 From: "Mark G. Whitney" Date: Thu, 4 Sep 2014 22:01:19 -0400 Subject: [PATCH 2/2] remove yarn queue config --- docs/running-on-yarn.md | 7 ------- 1 file changed, 7 deletions(-) diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 22a8359d4fe1..b0747451ed69 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -125,13 +125,6 @@ Most of the configs are the same for Spark on YARN as for other deployment modes the environment of the executor launcher. - - spark.yarn.queue - default - - The YARN queue to use for allocation requests. - - # Launching Spark on YARN