-
Notifications
You must be signed in to change notification settings - Fork 7k
Update Ray Data histograms to show percentiles in data dashboard #58650
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Signed-off-by: Alan Guo <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request is a great initiative to improve the data dashboard by replacing histograms with P90 percentile graphs for key metrics, which should provide more actionable insights. The old histogram views are thoughtfully preserved within a collapsed "Operator Panels" row for detailed, per-operator analysis.
My review has identified a critical issue in the new PromQL queries for percentile calculations that would render the graphs incorrect. I've provided specific code suggestions to fix this. Additionally, I've included a couple of medium-severity comments to enhance code maintainability by addressing code duplication and removing unused code.
python/ray/dashboard/modules/metrics/dashboards/data_dashboard_panels.py
Outdated
Show resolved
Hide resolved
python/ray/dashboard/modules/metrics/dashboards/data_dashboard_panels.py
Outdated
Show resolved
Hide resolved
python/ray/dashboard/modules/metrics/dashboards/data_dashboard_panels.py
Outdated
Show resolved
Hide resolved
python/ray/dashboard/modules/metrics/dashboards/data_dashboard_panels.py
Outdated
Show resolved
Hide resolved
python/ray/dashboard/modules/metrics/dashboards/data_dashboard_panels.py
Show resolved
Hide resolved
python/ray/dashboard/modules/metrics/dashboards/data_dashboard_panels.py
Show resolved
Hide resolved
Signed-off-by: Alan Guo <[email protected]>
Signed-off-by: Alan Guo <[email protected]>
Signed-off-by: Alan Guo <[email protected]>
Signed-off-by: Alan Guo <[email protected]>
python/ray/dashboard/modules/metrics/grafana_dashboard_factory.py
Outdated
Show resolved
Hide resolved
Signed-off-by: Alan Guo <[email protected]>
…-project#58650) ## Description The data grafana dashboard by default should work well when viewing across all operators. Use a percentile graph that is grouped by operator instead. For the histogram bar charts, hide that in the operator panels row. This is useful for areas where we by default filter by a single operator (like in the data dashboard) <img width="1163" height="379" alt="Screenshot 2025-11-14 at 2 33 16 PM" src="https://github.com/user-attachments/assets/fd4a3d0c-4a60-4bb9-a803-859b3ed14a59" /> <img width="1158" height="430" alt="Screenshot 2025-11-14 at 2 33 08 PM" src="https://github.com/user-attachments/assets/a78b4dde-8066-478b-86b4-b838761431f2" /> --------- Signed-off-by: Alan Guo <[email protected]> Signed-off-by: Aydin Abiar <[email protected]>
…-project#58650) ## Description The data grafana dashboard by default should work well when viewing across all operators. Use a percentile graph that is grouped by operator instead. For the histogram bar charts, hide that in the operator panels row. This is useful for areas where we by default filter by a single operator (like in the data dashboard) <img width="1163" height="379" alt="Screenshot 2025-11-14 at 2 33 16 PM" src="https://github.com/user-attachments/assets/fd4a3d0c-4a60-4bb9-a803-859b3ed14a59" /> <img width="1158" height="430" alt="Screenshot 2025-11-14 at 2 33 08 PM" src="https://github.com/user-attachments/assets/a78b4dde-8066-478b-86b4-b838761431f2" /> --------- Signed-off-by: Alan Guo <[email protected]> Signed-off-by: YK <[email protected]>
…-project#58650) ## Description The data grafana dashboard by default should work well when viewing across all operators. Use a percentile graph that is grouped by operator instead. For the histogram bar charts, hide that in the operator panels row. This is useful for areas where we by default filter by a single operator (like in the data dashboard) <img width="1163" height="379" alt="Screenshot 2025-11-14 at 2 33 16 PM" src="https://github.com/user-attachments/assets/fd4a3d0c-4a60-4bb9-a803-859b3ed14a59" /> <img width="1158" height="430" alt="Screenshot 2025-11-14 at 2 33 08 PM" src="https://github.com/user-attachments/assets/a78b4dde-8066-478b-86b4-b838761431f2" /> --------- Signed-off-by: Alan Guo <[email protected]>
Description
The data grafana dashboard by default should work well when viewing across all operators. Use a percentile graph that is grouped by operator instead.
For the histogram bar charts, hide that in the operator panels row. This is useful for areas where we by default filter by a single operator (like in the data dashboard)