feat: min_quantize_tokens threshold + trim oversized KV buffers#73

Merged

waybarrios merged 3 commits intowaybarrios:feat/kv-cache-quantizationfrom

janhilgard:threshold-and-trim

Feb 13, 2026

Commits on Feb 11, 2026

feat: add min_quantize_tokens threshold and trim oversized KV buffers

janhilgard
and
claude
committed
style: apply black formatting

janhilgard
and
claude
committed

Commits on Feb 13, 2026

Harden _trim_to_offset and store() in memory cache
waybarrios
committed