Skip to content

Merge L3 parity status into L3 summary card in dashboard - #187

Merged
justinchuby merged 1 commit into
mainfrom
justinchu/dashboard-l3-card
Apr 22, 2026
Merged

Merge L3 parity status into L3 summary card in dashboard#187
justinchuby merged 1 commit into
mainfrom
justinchu/dashboard-l3-card

Conversation

@justinchuby

Copy link
Copy Markdown
Member

Move the pass/xfail/skip breakdown from a separate card into the L3 level card as an annotation, consistent with L4/L5 cards that show skipped/awaiting-data counts inline.

This change was made in commit d0e6d49 on the justinchu/generate-golden-data branch but was accidentally reverted by a later commit (2fb6b80) that overwrote the dashboard template from a stale working copy. The squash merge in PR #183 faithfully reflected the branch tip, which had already lost the change.

Only file changed: scripts/templates/dashboard.html.j2 (+11, -15)

@github-actions

github-actions Bot commented Apr 22, 2026

Copy link
Copy Markdown

Performance Comparison

Comparing d6fec64cb2aea6

Model Metric Baseline Current Delta
bert (feature-extraction) model_size_bytes 359 KB 359 KB +0.0%
bert (feature-extraction) num_nodes 60 60 +0.0%
falcon model_size_bytes 364 KB 364 KB +0.0%
falcon num_nodes 66 66 +0.0%
gemma2 model_size_bytes 428 KB 428 KB +0.0%
gemma2 num_nodes 107 107 +0.0%
gpt2 model_size_bytes 388 KB 388 KB +0.0%
gpt2 num_nodes 53 53 +0.0%
llama model_size_bytes 425 KB 425 KB +0.0%
llama num_nodes 61 61 +0.0%
llama (static-cache) model_size_bytes 425 KB 425 KB +0.0%
llama (static-cache) num_nodes 58 58 +0.0%
mamba (ssm-text-generation) model_size_bytes 360 KB 360 KB +0.0%
mamba (ssm-text-generation) num_nodes 98 98 +0.0%
phi3 model_size_bytes 421 KB 421 KB +0.0%
phi3 num_nodes 59 59 +0.0%
phi3 (static-cache) model_size_bytes 421 KB 421 KB +0.0%
phi3 (static-cache) num_nodes 56 56 +0.0%
qwen2 model_size_bytes 425 KB 425 KB +0.0%
qwen2 num_nodes 61 61 +0.0%
qwen2 (static-cache) model_size_bytes 425 KB 425 KB +0.0%
qwen2 (static-cache) num_nodes 58 58 +0.0%
qwen3_5_moe (hybrid-text-generation) model_size_bytes 506 KB 506 KB +0.0%
qwen3_5_moe (hybrid-text-generation) num_nodes 275 275 +0.0%
qwen3_5_text (hybrid-text-generation) model_size_bytes 458 KB 458 KB +0.0%
qwen3_5_text (hybrid-text-generation) num_nodes 129 129 +0.0%
qwen3_5_vl (hybrid-qwen-vl) model_size_bytes 977 KB 977 KB +0.0%
qwen3_5_vl (hybrid-qwen-vl) num_nodes 408 408 +0.0%
t5 (seq2seq) model_size_bytes 836 KB 836 KB +0.0%
t5 (seq2seq) num_nodes 166 166 +0.0%
whisper (speech-to-text) model_size_bytes 1008 KB 1008 KB +0.0%
whisper (speech-to-text) num_nodes 128 128 +0.0%

No performance regressions.

Move the pass/xfail/skip breakdown from a separate card into the L3
level card as an annotation, consistent with L4/L5 cards that show
skipped/awaiting-data counts inline.

This change was lost in PR #183 when a later commit on the branch
accidentally reverted the dashboard template.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Signed-off-by: Justin Chu <justinchu@microsoft.com>
@justinchuby
justinchuby force-pushed the justinchu/dashboard-l3-card branch from 7c93002 to cb2aea6 Compare April 22, 2026 04:11

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the dashboard summary bar to inline the L3 parity (pass/xfail/skip) breakdown directly on the L3 level card, removing the previously separate “L3 Parity Status” card to reduce redundancy and align with the inline L4/L5 annotations.

Changes:

  • Add an inline annotation on the L3 summary card showing pass/xfail/skip counts.
  • Remove the standalone “L3 parity status breakdown” summary card.
  • Update the surrounding summary-bar comment to reflect the new inline annotation behavior.

Comment thread scripts/templates/dashboard.html.j2
Comment thread scripts/templates/dashboard.html.j2
@justinchuby
justinchuby merged commit 4b1e4a3 into main Apr 22, 2026
15 of 16 checks passed
@justinchuby
justinchuby deleted the justinchu/dashboard-l3-card branch April 22, 2026 04:12
@codecov

codecov Bot commented Apr 22, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants