Skip to content

[Sparse & HICache]: Enables hierarchical sparse KV cache management and scheduling for DeepSeek V32. #14619

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
hzh0425 wants to merge 41 commits into from

support lru evict for sparse kv cache

55faee3
Select commit
Loading
Failed to load commit list.
Closed

[Sparse & HICache]: Enables hierarchical sparse KV cache management and scheduling for DeepSeek V32. #14619

support lru evict for sparse kv cache
55faee3
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar