feat: extend system-prompt KV cache to pure-LLM stream_chat path#523

Merged

waybarrios merged 9 commits into

waybarrios:mainfrom

vinayvobbili:feat/system-kv-cache-stream-chat

May 14, 2026

Commits on May 12, 2026

fix: gate stream_chat KV cache on absence of decode controls

vinayvobbili
and
claude
committed
fix: gate stream_chat KV cache on engine-feature compatibility
vinayvobbili
committed

Commits on May 14, 2026

fix: harden stream_chat KV cache against TOCTOU + rotating caches
vinayvobbili
committed
set _supports_system_kv_cache on the pydantic stream_chat test so the probe-divergence renders actually run
waybarrios
committed