Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
Uh oh!
There was an error while loading.
Please reload this page
.
NVIDIA
/
TensorRT-LLM
Public
Notifications
You must be signed in to change notification settings
Fork
2.7k
Star
14.5k
Code
Issues
567
Pull requests
840
Discussions
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Discussions
Actions
Projects
Security and quality
Insights
[TRTLLM-13579][feat] BREAKING: Support BCG in Prefill
- #16609
#16609
Merged
longlee0622
merged 25 commits into
NVIDIA:main
NVIDIA/TensorRT-LLM:main
from
GuanhuaWang2001:feature/bcg
GuanhuaWang2001/TensorRT-LLM:feature/bcg
Copy head branch name to clipboard
Aug 15, 2026
Conversation
Commits
25
(25)
Checks
Files changed
Merged
[TRTLLM-13579][feat] BREAKING: Support BCG in Prefill
#16609
longlee0622
merged 25 commits into
NVIDIA:main
NVIDIA/TensorRT-LLM:main
from
GuanhuaWang2001:feature/bcg
GuanhuaWang2001/TensorRT-LLM:feature/bcg
Copy head branch name to clipboard
Commits
Commits on Aug 14, 2026
BCG V1
Show description for 603c8a0
GuanhuaWang2001
committed
603c8a0
View commit details
Copy full SHA for 603c8a0
Browse repository at this point
bcg v2, support more model, fix adp bug and dsv4 bug
Show description for fe93728
GuanhuaWang2001
committed
fe93728
View commit details
Copy full SHA for fe93728
Browse repository at this point
[07/23/14:03] share BCG pool across segments
Show description for 3838856
GuanhuaWang2001
committed
3838856
View commit details
Copy full SHA for 3838856
Browse repository at this point
[07/23/16:37] benchmark DSV4 1P1D AAAgent with BCG
Show description for 73d4da9
GuanhuaWang2001
committed
73d4da9
View commit details
Copy full SHA for 73d4da9
Browse repository at this point
[07/24/20:09] refactor DSv4 BCG epilogue fusion
Show description for f7b3e9f
GuanhuaWang2001
committed
f7b3e9f
View commit details
Copy full SHA for f7b3e9f
Browse repository at this point
fix bcg and epilogue
Show description for fbb0147
GuanhuaWang2001
committed
fbb0147
View commit details
Copy full SHA for fbb0147
Browse repository at this point
rename some var name to make mla more clear
Show description for 980525e
GuanhuaWang2001
committed
980525e
View commit details
Copy full SHA for 980525e
Browse repository at this point
[None][test] add focused BCG accuracy coverage
Show description for 2f46386
GuanhuaWang2001
committed
2f46386
View commit details
Copy full SHA for 2f46386
Browse repository at this point
[None][chore] apply pre-commit fixes to BCG changes
Show description for 73fb1ed
GuanhuaWang2001
committed
73fb1ed
View commit details
Copy full SHA for 73fb1ed
Browse repository at this point
[None][fix] preserve PCG behavior with breakable CUDA graphs
Show description for 8897e87
GuanhuaWang2001
committed
8897e87
View commit details
Copy full SHA for 8897e87
Browse repository at this point
[None][test] remove DeepSeek V4 BCG accuracy tests
Show description for 06f1313
GuanhuaWang2001
committed
06f1313
View commit details
Copy full SHA for 06f1313
Browse repository at this point
[None][fix] repair BCG tests after rebase
Show description for 6dacfc5
GuanhuaWang2001
committed
6dacfc5
View commit details
Copy full SHA for 6dacfc5
Browse repository at this point
[None][fix] avoid implicit legacy PCG bucket conflicts
Show description for e4c21f1
GuanhuaWang2001
committed
e4c21f1
View commit details
Copy full SHA for e4c21f1
Browse repository at this point
[None][fix] restrict eager graph captured values
Show description for 557406f
GuanhuaWang2001
committed
557406f
View commit details
Copy full SHA for 557406f
Browse repository at this point
reorganize tests
Show description for 12a879e
GuanhuaWang2001
committed
12a879e
View commit details
Copy full SHA for 12a879e
Browse repository at this point
[None][test] provide valid prepared graph inputs
Show description for 5aff7d3
GuanhuaWang2001
committed
5aff7d3
View commit details
Copy full SHA for 5aff7d3
Browse repository at this point
[None][fix] keep prefill warmup ranks aligned
Show description for 89fe680
GuanhuaWang2001
committed
89fe680
View commit details
Copy full SHA for 89fe680
Browse repository at this point
[None][fix] simplify breakable CUDA graph helpers
Show description for b401fd5
GuanhuaWang2001
committed
b401fd5
View commit details
Copy full SHA for b401fd5
Browse repository at this point
chore: apply post-rebase formatting
Show description for 9a3ff89
GuanhuaWang2001
committed
9a3ff89
View commit details
Copy full SHA for 9a3ff89
Browse repository at this point
[None][fix] address breakable CUDA graph review feedback
Show description for ab3d2b7
GuanhuaWang2001
committed
ab3d2b7
View commit details
Copy full SHA for ab3d2b7
Browse repository at this point
[None][fix] update prefill graph flag after rebase
Show description for f328f84
GuanhuaWang2001
committed
f328f84
View commit details
Copy full SHA for f328f84
Browse repository at this point
[None][fix] repair breakable graph CI regressions
Show description for 5ad889c
GuanhuaWang2001
committed
5ad889c
View commit details
Copy full SHA for 5ad889c
Browse repository at this point
[None][fix] retain eager bridge output storage
Show description for e4d0e14
GuanhuaWang2001
committed
e4d0e14
View commit details
Copy full SHA for e4d0e14
Browse repository at this point
[None][fix] clean up failed BCG capture
Show description for 6410451
GuanhuaWang2001
committed
6410451
View commit details
Copy full SHA for 6410451
Browse repository at this point
[None][docs] clarify DeepSeek-V4 output contract
Show description for e016428
GuanhuaWang2001
committed
e016428
View commit details
Copy full SHA for e016428
Browse repository at this point
You can’t perform that action at this time.
