feat: Add --gpu-memory-utilization for configurable memory limits#108

janhilgard wants to merge 1 commit into

waybarrios:mainwaybarrios/vllm-mlx:mainfrom

janhilgard:feat/gpu-memory-utilizationjanhilgard/vllm-mlx:feat/gpu-memory-utilizationCopy head branch name to clipboard