Skip to content

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Aug 4, 2025

What changes were proposed in this pull request?

This PR aims to support spark.kubernetes.executor.terminationGracePeriodSeconds.

Why are the changes needed?

To control the value of terminationGracePeriodSeconds of executor pods along with spark.kubernetes.dynamicAllocation.deleteGracePeriod.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass the CIs with the newly added test case.

Was this patch authored or co-authored using generative AI tooling?

No.

@dongjoon-hyun
Copy link
Member Author

Thank you, @peter-toth . Merged to master for Apache Spark 4.1.0.

dongjoon-hyun added a commit that referenced this pull request Oct 15, 2025
### What changes were proposed in this pull request?

This PR aims to document newly added K8s configurations as a part of Apache Spark 4.1.0 preparation.

### Why are the changes needed?

To sync the document with K8s `Config.scala`. For now, three PRs added four configurations.
- #51522
- #51811
- #52615

### Does this PR introduce _any_ user-facing change?

No behavior change. This is only adding new configuration documents.

### How was this patch tested?

Manual review.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #52618 from dongjoon-hyun/SPARK-53913.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
@dongjoon-hyun dongjoon-hyun deleted the SPARK-53096 branch November 16, 2025 16:44
huangxiaopingRD pushed a commit to huangxiaopingRD/spark that referenced this pull request Nov 25, 2025
### What changes were proposed in this pull request?

This PR aims to document newly added K8s configurations as a part of Apache Spark 4.1.0 preparation.

### Why are the changes needed?

To sync the document with K8s `Config.scala`. For now, three PRs added four configurations.
- apache#51522
- apache#51811
- apache#52615

### Does this PR introduce _any_ user-facing change?

No behavior change. This is only adding new configuration documents.

### How was this patch tested?

Manual review.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#52618 from dongjoon-hyun/SPARK-53913.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants