[SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS#23260

Closed

HeartSaVioR wants to merge 28 commits intoapache:masterfrom

HeartSaVioR:SPARK-26311

Commits on Jan 29, 2019

[SPARK-26311][YARN] New feature: custom log URL for stdout/stderr
HeartSaVioR
committed
Address review comments from @vanzin
HeartSaVioR
committed
Address review comments from @squito
HeartSaVioR
committed
Changed approach: only SHS provides custom executor log URLs
HeartSaVioR
committed
Fix binary compatibility issue
HeartSaVioR
committed
Clean up old stuff
HeartSaVioR
committed
Address review comments from @squito
HeartSaVioR
committed
Move the role of replacing log URLs to AppStatusStore - HistoryAppStatusStore
HeartSaVioR
committed
Fix existing UT break, as well as add unit test on acceptance test for custom url
HeartSaVioR
committed
Add missing RAT exclude, as well as code cleaning a bit
HeartSaVioR
committed
Reduce lines of new test case file
HeartSaVioR
committed
Remove @JsonIgnore which doesn't work actually
HeartSaVioR
committed
Add incomplete app to test target for custom log url as well as others
HeartSaVioR
committed
Also introduce a new config to toggle applying custom log url for incomplete apps
HeartSaVioR
committed
Also apply custom log url to driver log as well (in case of YARN cluster mode)
HeartSaVioR
committed
Add org.apache.spark.scheduler.SparkListenerApplicationStart to Mima exclude list
HeartSaVioR
committed
Fix UT in yarn
HeartSaVioR
committed
Address review comments from @squito
HeartSaVioR
committed
Fix more nits
HeartSaVioR
committed
Address review comments from @vanzin
HeartSaVioR
committed
Change log level to INFO
HeartSaVioR
committed
Addressed review comments from vanzin
HeartSaVioR
committed
Address review comments from vanzin
HeartSaVioR
committed
Fix a silly bug
HeartSaVioR
committed
Address review comments
HeartSaVioR
committed
More inlines...
HeartSaVioR
committed
Remove unnecessary lines
HeartSaVioR
committed
Fix a bug: we can't support NM_HOST / NM_PORT / NM_HTTP_PORT consistently
HeartSaVioR
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS#23260

[SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS#23260
HeartSaVioR wants to merge 28 commits intoapache:masterfrom
HeartSaVioR:SPARK-26311

Commits on Jan 29, 2019

[SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

Address review comments from @vanzin

Address review comments from @squito

Changed approach: only SHS provides custom executor log URLs

Fix binary compatibility issue

Clean up old stuff

Address review comments from @squito

Move the role of replacing log URLs to AppStatusStore - HistoryAppStatusStore

Fix existing UT break, as well as add unit test on acceptance test for custom url

Add missing RAT exclude, as well as code cleaning a bit

Reduce lines of new test case file

Remove @JsonIgnore which doesn't work actually

Add incomplete app to test target for custom log url as well as others

Also introduce a new config to toggle applying custom log url for incomplete apps

Also apply custom log url to driver log as well (in case of YARN cluster mode)

Add org.apache.spark.scheduler.SparkListenerApplicationStart to Mima exclude list

Fix UT in yarn

Address review comments from @squito

Fix more nits

Address review comments from @vanzin

Change log level to INFO

Addressed review comments from vanzin

Address review comments from vanzin

Fix a silly bug

Address review comments

More inlines...

Remove unnecessary lines

Fix a bug: we can't support NM_HOST / NM_PORT / NM_HTTP_PORT consistently

[SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS#23260HeartSaVioR wants to merge 28 commits intoapache:masterapache/spark:masterfrom HeartSaVioR:SPARK-26311HeartSaVioR/spark:SPARK-26311Copy head branch name to clipboard

Commits

Commits on Jan 29, 2019

[SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS#23260
HeartSaVioR wants to merge 28 commits intoapache:masterfrom
HeartSaVioR:SPARK-26311