Skip to content

[AMD] [Quantization] Add override flag for attention dtype instead of using kv_cache_dtype trigger #17331

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
gshtras merged 15 commits into from
Jun 11, 2025

check if kv cache is fp8

85ccf7c
Select commit
Loading
Failed to load commit list.
Merged

[AMD] [Quantization] Add override flag for attention dtype instead of using kv_cache_dtype trigger #17331

check if kv cache is fp8
85ccf7c
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Jun 3, 2025 in 1s

DCO

All commits are signed off!

View more details on DCO