Implement Scissorhands KV-cache compression & SnapKV prompt compression#11

Merged

griff4692 merged 2 commits intomainfrom

Jun 11, 2024

Commits on Jun 10, 2024

Implement Scissorhands paper as KVCacheScissorHands.
Griffin Adams
committed

Commits on Jun 11, 2024

Implements prompt compression with SnapKV and Remove Middle (keep window + global).
Griffin Adams
committed