Skip to content

[Bugfix] fix the oom when chunkprefill with long context like 64k

4e39ecd
Select commit
Loading
Failed to load commit list.
Merged

[Bugfix] fix the oom when chunkprefill with long context like 64k #2319

[Bugfix] fix the oom when chunkprefill with long context like 64k
4e39ecd
Select commit
Loading
Failed to load commit list.