feat: add prompt prefix caching to SimpleEngine#90

panbanda wants to merge 2 commits into

waybarrios:mainwaybarrios/vllm-mlx:mainfrom

panbanda:feat/prompt-prefix-cachingpanbanda/vllm-mlx:feat/prompt-prefix-cachingCopy head branch name to clipboard