[Performance][MiniCPM-o] Zero-copy block-aligned KV sliding window with in-place Re-RoPE for duplex Stage-0 - #7821

[Performance][MiniCPM-o] Zero-copy block-aligned KV sliding window with in-place Re-RoPE for duplex Stage-0#7821

amy-why-3459 merged 8 commits into

vllm-project:mainvllm-project/vllm-omni:mainfrom

BeatSeat:feat/minicpmo45-stage0-kv-window-compactBeatSeat/vllm-omni:feat/minicpmo45-stage0-kv-window-compactCopy head branch name to clipboard