Skip to content

Conversation

@SteNicholas
Copy link
Member

@SteNicholas SteNicholas commented Jun 3, 2024

What changes were proposed in this pull request?

Bump Dropwizard version from 3.2.6 to 4.2.25. Meanwhile, introduce metrics_jvm_thread_peak_count_Value and metrics_jvm_thread_total_started_count_Value in celeborn-jvm-dashboard.json.

Why are the changes needed?

Dropwizard metrics has released v4.2.25 including some bugfixes and improvements including:

Meanwhile, Ratis version has upgraded to 3.0.1 which has no compatibility problem with Dropwizard 4.2.25.

Backport:

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Manual test.

@SteNicholas SteNicholas force-pushed the CELEBORN-1389 branch 3 times, most recently from 5910001 to 0c63c4d Compare June 3, 2024 08:27
@SteNicholas
Copy link
Member Author

SteNicholas commented Jun 3, 2024

Ping @pan3793, @onebox-li, @FMX.

@pan3793
Copy link
Member

pan3793 commented Jun 3, 2024

Have you verified the Grafana Dashboard?

@SteNicholas
Copy link
Member Author

SteNicholas commented Jun 3, 2024

@pan3793, I have not verified the dashboard changes because I did not use the dashboard in production environment. I only verified the dashboard display via https://stenicholas.grafana.net/goto/4ywHh1ySg?orgId=1.
BTW, I only introduced metrics_jvm_thread_peak_count_Value and metrics_jvm_thread_total_started_count_Value in dashboard which follow other metric pattern and work well in theory. cc @onebox-li.

Copy link
Contributor

@onebox-li onebox-li left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for mention, the grafana dashboard looks fine to me.
image

@SteNicholas
Copy link
Member Author

Thanks for mention, the grafana dashboard looks fine to me.

@pan3793, PTAL.

Copy link
Contributor

@FMX FMX left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Merge into main(v0.6.0) and branch-0.5.

@FMX FMX closed this in 4fc42d7 Jun 4, 2024
FMX pushed a commit that referenced this pull request Jun 4, 2024
### What changes were proposed in this pull request?

Bump Dropwizard version from 3.2.6 to 4.2.25. Meanwhile, introduce `metrics_jvm_thread_peak_count_Value` and `metrics_jvm_thread_total_started_count_Value` in `celeborn-jvm-dashboard.json`.

### Why are the changes needed?

Dropwizard metrics has released v4.2.25 including some bugfixes and improvements including:

* [JVM] Fix maximum/total memory calculation: dropwizard/metrics#3125
* [Thread] Add peak and total started thread count to `ThreadStatesGaugeSet`: dropwizard/metrics#1601

Meanwhile, Ratis version has upgraded to 3.0.1 which has no compatibility problem with Dropwizard 4.2.25.

Backport:

- apache/spark#26332
- apache/spark#29426
- apache/spark#37372

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Manual test.

Closes #2540 from SteNicholas/CELEBORN-1389.

Authored-by: SteNicholas <[email protected]>
Signed-off-by: mingji <[email protected]>
(cherry picked from commit 4fc42d7)
Signed-off-by: mingji <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants