Skip to content

Commit 6edf02a

Browse files
yaooqinnMarcelo Vanzin
authored andcommitted
[SPARK-19626][YARN] Using the correct config to set credentials update time
## What changes were proposed in this pull request? In #14065, we introduced a configurable credential manager for Spark running on YARN. Also two configs `spark.yarn.credentials.renewalTime` and `spark.yarn.credentials.updateTime` were added, one is for the credential renewer and the other updater. But now we just query `spark.yarn.credentials.renewalTime` by mistake during CREDENTIALS UPDATING, where should be actually `spark.yarn.credentials.updateTime` . This PR fixes this mistake. ## How was this patch tested? existing test cc jerryshao vanzin Author: Kent Yao <[email protected]> Closes #16955 from yaooqinn/cred_update. (cherry picked from commit 7363dde) Signed-off-by: Marcelo Vanzin <[email protected]>
1 parent c331674 commit 6edf02a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

yarn/src/main/scala/org/apache/spark/deploy/yarn/security/CredentialUpdater.scala

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -55,7 +55,7 @@ private[spark] class CredentialUpdater(
5555

5656
/** Start the credential updater task */
5757
def start(): Unit = {
58-
val startTime = sparkConf.get(CREDENTIALS_RENEWAL_TIME)
58+
val startTime = sparkConf.get(CREDENTIALS_UPDATE_TIME)
5959
val remainingTime = startTime - System.currentTimeMillis()
6060
if (remainingTime <= 0) {
6161
credentialUpdater.schedule(credentialUpdaterRunnable, 1, TimeUnit.MINUTES)

0 commit comments

Comments
 (0)