Skip to content

FP8: Load model on-the-fly in vLLM #3717

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
danielhanchen merged 3 commits into from
Feb 10, 2026

Fix on-the-fly FP8: always check mapper first, fallback to on-the-fly

2150655
Select commit
Loading
Failed to load commit list.
Merged

FP8: Load model on-the-fly in vLLM #3717

Fix on-the-fly FP8: always check mapper first, fallback to on-the-fly
2150655
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs