[SPARK-11373] [CORE] Add metrics to the History Server and FsHistoryProvider#9571

Closed

steveloughran wants to merge 22 commits intoapache:masterfrom

steveloughran:feature/SPARK-11373

Commits on Apr 10, 2017

[SPARK-11373] First pass at adding metrics to the history server, with the FsHistoryProvider counting
steveloughran
committed
[SPARK-11373] tests and review; found and fixed a re-entrancy in HistoryServerSuite which was causing problems with counter registration
steveloughran
committed
[SPARK-11373] scala-style javadoc tuning in FsHistoryProvider
steveloughran
committed
SPARK-11373: move to MetricsSystem, though retaining/expanding health checks, which aren't part of it
steveloughran
committed
scalacheck
steveloughran
committed
SPARK-11373: cut out the notion of binding information; simplify provider launch
steveloughran
committed
SPARK-11373 cut the health checks out
steveloughran
committed
[SPARK-11373] tail end of rebase operation
steveloughran
committed
[SPARK-11373] scalastyle and import ordering
steveloughran
committed
SPARK-11373 finish review of merge with trunk; add new Timestamp gauge and set to time of update/update success. Makes update time visible for tests/users/ops
steveloughran
committed
[SPARK-11373] finish rebasing to master, correct tightened style checks
steveloughran
committed
[SPARK-11373] Address review comments and add a new counter of events played back during merge and U load
steveloughran
committed
[SPARK-11373] more metrics, all sources have prefixes, common features pulled up into HistoryMetricSource, including registration and prefix support. The existing test case "incomplete apps get ref…
steveloughran
committed
[SPARK-11373] add a check that before there's been any events loaded, the average load time is "0" and not a division by zero error. This validates the logic in the relevant lambda-expression
steveloughran
committed
[SPARK-11373] style check in the javadocs
steveloughran
committed
[SPARK-11373] IDE had mysteriously re-ordered imports in the same line. Interesting, and not in a good way
steveloughran
committed
[SPARK-11373] address latest comments
steveloughran
committed
[SPARK-1137] cull surplus lines
steveloughran
committed
[SPARK-11373] don't register appui.load.timer as a metric
steveloughran
committed
[SPARK-11373] sync with master; tests all happy
steveloughran
committed
[SPARK-11373] sync this PR up with the master branch
steveloughran
committed

Commits on Apr 11, 2017

HADOOP-11374 fix line length errors
steveloughran
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[SPARK-11373] [CORE] Add metrics to the History Server and FsHistoryProvider#9571

[SPARK-11373] [CORE] Add metrics to the History Server and FsHistoryProvider#9571
steveloughran wants to merge 22 commits intoapache:masterfrom
steveloughran:feature/SPARK-11373

Commits on Apr 10, 2017

[SPARK-11373] First pass at adding metrics to the history server, with the FsHistoryProvider counting

[SPARK-11373] tests and review; found and fixed a re-entrancy in HistoryServerSuite which was causing problems with counter registration

[SPARK-11373] scala-style javadoc tuning in FsHistoryProvider

SPARK-11373: move to MetricsSystem, though retaining/expanding health checks, which aren't part of it

scalacheck

SPARK-11373: cut out the notion of binding information; simplify provider launch

SPARK-11373 cut the health checks out

[SPARK-11373] tail end of rebase operation

[SPARK-11373] scalastyle and import ordering

SPARK-11373 finish review of merge with trunk; add new Timestamp gauge and set to time of update/update success. Makes update time visible for tests/users/ops

[SPARK-11373] finish rebasing to master, correct tightened style checks

[SPARK-11373] Address review comments and add a new counter of events played back during merge and U load

[SPARK-11373] more metrics, all sources have prefixes, common features pulled up into HistoryMetricSource, including registration and prefix support. The existing test case "incomplete apps get ref…

[SPARK-11373] add a check that before there's been any events loaded, the average load time is "0" and not a division by zero error. This validates the logic in the relevant lambda-expression

[SPARK-11373] style check in the javadocs

[SPARK-11373] IDE had mysteriously re-ordered imports in the same line. Interesting, and not in a good way

[SPARK-11373] address latest comments

[SPARK-1137] cull surplus lines

[SPARK-11373] don't register appui.load.timer as a metric

[SPARK-11373] sync with master; tests all happy

[SPARK-11373] sync this PR up with the master branch

Commits on Apr 11, 2017

HADOOP-11374 fix line length errors

[SPARK-11373] [CORE] Add metrics to the History Server and FsHistoryProvider#9571steveloughran wants to merge 22 commits intoapache:masterapache/spark:masterfrom steveloughran:feature/SPARK-11373steveloughran/spark:feature/SPARK-11373Copy head branch name to clipboard

Commits

Commits on Apr 10, 2017

Commits on Apr 11, 2017

[SPARK-11373] [CORE] Add metrics to the History Server and FsHistoryProvider#9571
steveloughran wants to merge 22 commits intoapache:masterfrom
steveloughran:feature/SPARK-11373