Skip to content

Conversation

@LiShuMing
Copy link
Contributor

What changes were proposed in this pull request?

I found it's unnecessary to use the same loop twice, so changed them into one. It's a little change...

How was this patch tested?

./build/mvn -P... -Dtest=none -DwildcardSuites=org.apache.spark.ui.jobs.JobProgressListenerSuite test

@AmplabJenkins
Copy link

Can one of the admins verify this patch?

// If there's no information for a stage, store the StageInfo received from the scheduler
// so that we can display stage descriptions for pending stages:
for (stageInfo <- jobStart.stageInfos) {
stageIdToActiveJobIds.getOrElseUpdate(stageInfo.stageId,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's not immediately clear to me they're equivalent. They'd have to contain the same set of stage IDs. Is it worth it?

@jiangxb1987
Copy link
Contributor

It seems to me that the older versions of SparkListenerJobStart don't store StageInfos, so it may be dangerous to apply this code change. @cloud-fan Should we close this?

@jerryshao
Copy link
Contributor

There's a JIRA planning to remove this JobProgressListener, so I'd suggest to not change this deprecated code unnecessarily.

@srowen srowen mentioned this pull request Jun 7, 2017
@asfgit asfgit closed this in b771fed Jun 8, 2017
zifeif2 pushed a commit to zifeif2/spark that referenced this pull request Nov 22, 2025
# What changes were proposed in this pull request?

This PR proposes to close stale PRs, mostly the same instances with apache#18017

Closes apache#11459
Closes apache#13833
Closes apache#13720
Closes apache#12506
Closes apache#12456
Closes apache#12252
Closes apache#17689
Closes apache#17791
Closes apache#18163
Closes apache#17640
Closes apache#17926
Closes apache#18163
Closes apache#12506
Closes apache#18044
Closes apache#14036
Closes apache#15831
Closes apache#14461
Closes apache#17638
Closes apache#18222

Added:
Closes apache#18045
Closes apache#18061
Closes apache#18010
Closes apache#18041
Closes apache#18124
Closes apache#18130
Closes apache#12217

Added:
Closes apache#16291
Closes apache#17480
Closes apache#14995

Added:
Closes apache#12835
Closes apache#17141

## How was this patch tested?

N/A

Author: hyukjinkwon <[email protected]>

Closes apache#18223 from HyukjinKwon/close-stale-prs.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants