Commit 45e9854

Griffin Adams

committed

Implements prompt compression with SnapKV and Remove Middle (keep window + global).

1 parent 5bbdcf1 commit 45e9854Copy full SHA for 45e9854

5 files changed

+409

-132

lines changed

cache.py
generate.py
model.py
prompts
- noise_qa.txt
- reverse_list.txt

5 files changed

+409

-132

lines changed

Comments

(0)