[SPARK-6088] Correct how tasks that get remote results are shown in UI.

[kayousterhout]

It would be great to fix this for 1.3. since the fix is surgical and it helps understandability for users.

cc @shivaram @pwendell

[SparkQA]

Test build #28136 has finished for PR 4839 at commit 84d617c.

• This patch fails to build.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #28141 has finished for PR 4839 at commit f346b49.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[srowen]

PS I noticed when using TaskInfo recently that it has gettingResult and finished property that does this same check. I used them instead of also comparing the times to 0.

[shivaram]

I'm not familiar enough with the UI code, but one more problem I have noticed is that when the task is in the getting results stage, the UI shows the time as execution time and only after the task finishes do you see the getting results time. Is it possible to update the time waiting for results to be fetched while the task is in progress ?

[kayousterhout]

@shivaram Fixed this, and @srowen thanks for pointing out the issue with the GET_RESULT status!! Shivaram, did you run this patch on your cluster? Or was your comment just based on the old code?

[shivaram]

No it was based on the old code. Didn't get a chance to run this on the cluster yet.

[SparkQA]

Test build #28155 has finished for PR 4839 at commit 3ab012c.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[kayousterhout]

@shivaram @pwendell Does this look ok? Would be good to get into the next RC, just because this is pretty broken right now.

[shivaram]

Functionality-wise this looks good to me.

[srowen]

Although I think this missed 1.3, as far as I'm concerned you can merge it into master, at least.

[andrewor14]

LGTM I'm merging this into master 1.3 thanks