Skip to content

[Docs] Add ecosystem kernels index skill - #57088

Open
benchislett wants to merge 2 commits into
vllm-project:mainfrom
benchislett:skill-kernel-ecosystem
Open

benchislett wants to merge 2 commits into
vllm-project:mainfrom
benchislett:skill-kernel-ecosystem

Conversation

@benchislett

@benchislett benchislett commented Sep 15, 2026 •

Copy link
Copy Markdown
Member

Purpose

This PR adds a new skill: kernels-ecosystem. It is a one-off snapshot of all kernels GPT-6 could find in vLLM, SGLang, TRTLLM, TokenSpeed, and FlashInfer. It is grouped by operator at the top-level for easy browsing. The skill includes a workflow to update the index, which we will need to do periodically. Ideally this index can be hosted outside of vLLM and serve a more frequently crawled index, but for now I think there is a lot of value in merging this skill.

Already, I have discovered a dozen new kernels that I hadn't previously known about.

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

Link verified provider kernels first, prefer vLLM integration fallbacks, and retain citations for material framework adaptations.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
@benchislett benchislett added the agents Related to information for agents label Sep 20, 2026
@faradawn

Copy link
Copy Markdown

Tagging a few folks from the agent-readiness survey. Please react 👍 or comment

@dllehr-amd - you described agent code not using the MoE oracle. Does this PR help?

@tlrmchlsmth — you wanted it easier to tell which backends run for a givenvllm serve + hardware.

@MatthewBonanni — mentioned attention backends (FlashInfer prims-ts,
TRTLLM CuteDSL fused GQA).

Also @WoosukKwon, @AndreasKaratzas, @tjtanaa, @jinyouzhi, @penli9 @esmeetu @aoshen02

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

agents Related to information for agents

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants