Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
smg-project
/
smg
Public
Notifications
You must be signed in to change notification settings
Fork
178
Star
555
Code
Issues
60
Pull requests
42
Discussions
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Discussions
Actions
Projects
Security and quality
Insights
feat(embed): add vLLM gRPC embedding support, clean up proto
- #1001
#1001
Merged
CatherineSue
merged 23 commits into
main
smg-project/smg:main
from
changsu/remove-embedding-log-metrics
smg-project/smg:changsu/remove-embedding-log-metrics
Copy head branch name to clipboard
Apr 1, 2026
Conversation
Commits
23
(23)
Checks
Files changed
Merged
feat(embed): add vLLM gRPC embedding support, clean up proto
#1001
CatherineSue
merged 23 commits into
main
smg-project/smg:main
from
changsu/remove-embedding-log-metrics
smg-project/smg:changsu/remove-embedding-log-metrics
Copy head branch name to clipboard
Commits
Commits on Apr 1, 2026
refactor(embed): remove SGLang-specific log_metrics from embedding/classify protocols
Show description for e58fda3
CatherineSue
committed
e58fda3
View commit details
Copy full SHA for e58fda3
Browse repository at this point
feat(embed): add vLLM embedding support to gRPC pipeline
Show description for 7374f2a
CatherineSue
committed
7374f2a
View commit details
Copy full SHA for 7374f2a
Browse repository at this point
feat(embed): implement vLLM Embed RPC in gRPC servicer
Show description for 16666cb
CatherineSue
committed
16666cb
View commit details
Copy full SHA for 16666cb
Browse repository at this point
refactor(embed): flatten SGLang EmbedResponse proto, remove dead types
Show description for f592561
CatherineSue
committed
f592561
View commit details
Copy full SHA for f592561
Browse repository at this point
test(embed): enable embedding e2e tests for vLLM engine
Show description for 720e23e
CatherineSue
committed
720e23e
View commit details
Copy full SHA for 720e23e
Browse repository at this point
fix(embed): address review feedback on PR #1001
Show description for dda1e31
CatherineSue
committed
dda1e31
View commit details
Copy full SHA for dda1e31
Browse repository at this point
fix(proto): use fresh field numbers in SGLang EmbedResponse for wire compat
Show description for 86b7ae8
CatherineSue
committed
86b7ae8
View commit details
Copy full SHA for 86b7ae8
Browse repository at this point
fix(servicer): address review comments — warmup, abort safety, error handling, circuit breaker
Show description for ee526bc
CatherineSue
committed
ee526bc
View commit details
Copy full SHA for ee526bc
Browse repository at this point
fix(servicer): rename span to grpc_execute and clean up vllm embed abort paths
Show description for c880d5e
CatherineSue
committed
c880d5e
View commit details
Copy full SHA for c880d5e
Browse repository at this point
fix(servicer): use logger.warning for embed no-result abort
Show description for 742f94d
CatherineSue
committed
742f94d
View commit details
Copy full SHA for 742f94d
Browse repository at this point
feat(e2e): add vllm to embedding tests and matrix e2e-1gpu-embeddings
Show description for 0d83bfc
CatherineSue
committed
0d83bfc
View commit details
Copy full SHA for 0d83bfc
Browse repository at this point
fix(servicer): flatten vllm embedding tensor before proto construction
Show description for 9d08b20
CatherineSue
committed
9d08b20
View commit details
Copy full SHA for 9d08b20
Browse repository at this point
fix(servicer): use EmbeddingOutput.from_base for proper tensor-to-list conversion
Show description for 567c526
CatherineSue
committed
567c526
View commit details
Copy full SHA for 567c526
Browse repository at this point
fix(servicer): use token_inputs() for vllm embed to fix 2D pooler output
Show description for 3b1c699
CatherineSue
committed
3b1c699
View commit details
Copy full SHA for 3b1c699
Browse repository at this point
debug(servicer): add logging to diagnose vllm embed output shape
Show description for 8f113c3
CatherineSue
committed
8f113c3
View commit details
Copy full SHA for 8f113c3
Browse repository at this point
fix(servicer): handle 2D pooler output and log input for diagnosis
Show description for cf77bd5
CatherineSue
committed
cf77bd5
View commit details
Copy full SHA for cf77bd5
Browse repository at this point
fix(servicer): set task='embed' in PoolingParams for vllm embedding
Show description for cad3d86
CatherineSue
committed
cad3d86
View commit details
Copy full SHA for cad3d86
Browse repository at this point
fix(e2e): fix MODEL_SPECS key for embedding correctness tests
Show description for 9a3c832
CatherineSue
committed
9a3c832
View commit details
Copy full SHA for 9a3c832
Browse repository at this point
revert(e2e): revert correctness test MODEL_SPECS fix — tests are broken
Show description for 24a83f3
CatherineSue
committed
24a83f3
View commit details
Copy full SHA for 24a83f3
Browse repository at this point
debug(e2e): add detailed logging to embedding correctness tests
Show description for c068a0b
CatherineSue
committed
c068a0b
View commit details
Copy full SHA for c068a0b
Browse repository at this point
fix(e2e): disable sentence-transformers prompt templates in embedding reference
Show description for d452d86
CatherineSue
committed
d452d86
View commit details
Copy full SHA for d452d86
Browse repository at this point
fix(e2e): skip embedding correctness tests for sglang
Show description for 0c40721
CatherineSue
committed
0c40721
View commit details
Copy full SHA for 0c40721
Browse repository at this point
fix(e2e): remove unnecessary prompt_name=None from HF reference
Show description for ffa76c4
CatherineSue
committed
ffa76c4
View commit details
Copy full SHA for ffa76c4
Browse repository at this point
You can’t perform that action at this time.
