feat: Add --kv-cache-bits flag for KV cache quantization#67

janhilgard wants to merge 1 commit into

waybarrios:mainwaybarrios/vllm-mlx:mainfrom

janhilgard:feature/kv-cache-quantizationjanhilgard/vllm-mlx:feature/kv-cache-quantizationCopy head branch name to clipboard