Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
Tushar-ml
/
vllm
Public
forked from
vllm-project/vllm
Notifications
You must be signed in to change notification settings
Fork
1
Star
0
Code
Pull requests
8
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Actions
Projects
Security and quality
Insights
flash attention addition
- #5
#5
Open
Tushar-ml
wants to merge 21 commits into
main
Tushar-ml/vllm:main
from
feat/add-flash-attn-gemma4
Tushar-ml/vllm:feat/add-flash-attn-gemma4
Copy head branch name to clipboard
Conversation
Commits
21
(21)
Checks
Files changed
Open
flash attention addition
#5
Tushar-ml
wants to merge 21 commits into
main
Tushar-ml/vllm:main
from
feat/add-flash-attn-gemma4
Tushar-ml/vllm:feat/add-flash-attn-gemma4
Copy head branch name to clipboard
Commits
Commits on May 7, 2026
flash attention addition
Tushar-ml
committed
d540f3b
View commit details
Copy full SHA for d540f3b
Browse repository at this point
support mm prefix
Tushar-ml
committed
7f55bc2
View commit details
Copy full SHA for 7f55bc2
Browse repository at this point
mtp batch correction
Tushar-ml
committed
0aa9f82
View commit details
Copy full SHA for 0aa9f82
Browse repository at this point
Commits on May 20, 2026
added sgl inspired tool call parser
Tushar-ml
committed
12fa351
View commit details
Copy full SHA for 12fa351
Browse repository at this point
streaming fix
Tushar-ml
committed
2a5a759
View commit details
Copy full SHA for 2a5a759
Browse repository at this point
handled empty tool calling
Tushar-ml
committed
cd278b8
View commit details
Copy full SHA for cd278b8
Browse repository at this point
strip thought
Tushar-ml
committed
3f71c02
View commit details
Copy full SHA for 3f71c02
Browse repository at this point
strip thought
Tushar-ml
committed
396b15f
View commit details
Copy full SHA for 396b15f
Browse repository at this point
optimized
Tushar-ml
committed
a7c5b03
View commit details
Copy full SHA for a7c5b03
Browse repository at this point
enable thinking edge case
Tushar-ml
committed
9b7b5e5
View commit details
Copy full SHA for 9b7b5e5
Browse repository at this point
Commits on May 22, 2026
Merge pull request #8 from Tushar-ml/fix/parser-gemma4-sgl
Show description for 50becb1
Tushar-ml
authored
50becb1
View commit details
Copy full SHA for 50becb1
Browse repository at this point
Merge branch 'main' into feat/add-flash-attn-gemma4
Show description for d184b5c
Tushar-ml
authored
d184b5c
View commit details
Copy full SHA for d184b5c
Browse repository at this point
add prefix warmup to prime cache before server startup
Show description for f7f184b
lawjarp-simplismart
committed
f7f184b
View commit details
Copy full SHA for f7f184b
Browse repository at this point
support local path or http(s) url for prefix warmup file
lawjarp-simplismart
committed
a3ea78d
View commit details
Copy full SHA for a3ea78d
Browse repository at this point
Commits on Jun 3, 2026
added parllel warmup and count
Tushar-ml
committed
1247d7c
View commit details
Copy full SHA for 1247d7c
Browse repository at this point
added parllel warmup and count
Tushar-ml
committed
869db82
View commit details
Copy full SHA for 869db82
Browse repository at this point
Merge pull request #9 from Tushar-ml/feat/add-prefix-warmup
Show description for c58ab58
Tushar-ml
authored
c58ab58
View commit details
Copy full SHA for c58ab58
Browse repository at this point
Commits on Jun 4, 2026
support for 12b
Tushar-ml
committed
ac9f4ae
View commit details
Copy full SHA for ac9f4ae
Browse repository at this point
fix eoa token
Tushar-ml
committed
56396d9
View commit details
Copy full SHA for 56396d9
Browse repository at this point
Merge pull request #10 from Tushar-ml/feat/add-gemma4-12b
Show description for 3a963cf
Tushar-ml
authored
3a963cf
View commit details
Copy full SHA for 3a963cf
Browse repository at this point
Merge branch 'main' into feat/add-flash-attn-gemma4
Show description for 086e3ac
Tushar-ml
authored
086e3ac
View commit details
Copy full SHA for 086e3ac
Browse repository at this point
You can’t perform that action at this time.
