Add rotating kvcache to save space#1

Blaizzy merged 1 commit intoBlaizzy:pc/add-cohere2-archBlaizzy/mlx-examples:pc/add-cohere2-archfrom

N8python:add-cohere2-arch-rotating-kv-cacheN8python/mlx-examples:add-cohere2-arch-rotating-kv-cacheCopy head branch name to clipboard