Skip to content

[Skills] Add kernel benchmark sanity references - #54995

Merged
WoosukKwon merged 1 commit into
mainfrom
woosuk/add-ref-number-skills
Sep 3, 2026
Merged

WoosukKwon merged 1 commit into
mainfrom
woosuk/add-ref-number-skills

Conversation

@WoosukKwon

Copy link
Copy Markdown
Collaborator

Summary

  • add rough Blackwell sanity-check references for memory-bound, GEMM, and
    attention kernel benchmarks
  • clarify that the figures are diagnostic reference points rather than gold
    standards, guaranteed peaks, or hard limits
  • note the FlashAttention-4 source for the B200 BF16 attention result

Duplicate-work check

Searched open PRs for kernel-microbenchmark, PFLOP/s, and
FlashAttention-4 skill; no matching PR was found. This change is not linked
to an issue.

Tests

  • .venv/bin/python /home/woosuk/.codex/skills/.system/skill-creator/scripts/quick_validate.py .agents/skills/kernel-microbenchmark — passed (Skill is valid!)
  • git diff --check — passed
  • .venv/bin/pre-commit run --files .agents/skills/kernel-microbenchmark/SKILL.md — passed (applicable hooks, including markdownlint and typos)

Model evaluation is not applicable because this changes contributor skill
guidance only and does not affect model output, accuracy, or serving behavior.

AI assistance

OpenAI Codex assisted with editing, duplicate-work checks, validation, the
commit, and drafting this PR description. The human submitter reviewed every
changed line and is responsible for the change.

Co-authored-by: OpenAI Codex <codex@openai.com>

Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This repository is configured for manual code reviews. Comment @claude review for a one-time review, or @claude review always to subscribe this PR to a review on every future push.

Tip: disable this comment in your organization's Code Review settings.

@WoosukKwon WoosukKwon changed the title [Docs] Add kernel benchmark sanity references [Skills] Add kernel benchmark sanity references Sep 2, 2026
@WoosukKwon WoosukKwon added the ready ONLY add when PR is ready to merge/full CI is needed label Sep 2, 2026
@WoosukKwon
WoosukKwon merged commit 0e14198 into main Sep 3, 2026
19 checks passed
@WoosukKwon
WoosukKwon deleted the woosuk/add-ref-number-skills branch September 3, 2026 00:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant