Skip to content

Fix VRAM usage increase on HIP/ROCm with RDNA3 and possibly more - #71

Closed
stragulus wants to merge 2 commits into
TheTom:feature/turboquant-kv-cachefrom
stragulus:bug/vram-usage-rows-with-rocm
Closed

Fix VRAM usage increase on HIP/ROCm with RDNA3 and possibly more#71
stragulus wants to merge 2 commits into
TheTom:feature/turboquant-kv-cachefrom
stragulus:bug/vram-usage-rows-with-rocm

The batched flash attention kernel changes introduced two issues that…

f519788
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

The logs for this run have expired and are no longer available.