[AMD] [Quantization] Add override flag for attention dtype instead of using kv_cache_dtype trigger#17331

gshtras merged 15 commits into

vllm-project:mainvllm-project/vllm:mainfrom

rasmith:rasmith_add_vllm_use_rocm_fp8_scalesrasmith/vllm:rasmith_add_vllm_use_rocm_fp8_scalesCopy head branch name to clipboard