Skip to content

[Perf][DSv4.1] Run the Engram WKV ahead for GPU-resident tables too - #1

Open
ivanium wants to merge 3 commits into
yaoyaoding:dsv41-specialized-decode-perffrom
ivanium:dsv41-engram-multicast-gather
Open

[Perf][DSv4.1] Run the Engram WKV ahead for GPU-resident tables too#1
ivanium wants to merge 3 commits into
yaoyaoding:dsv41-specialized-decode-perffrom
ivanium:dsv41-engram-multicast-gather

[Bugfix][DSv4.1] Keep the Engram run-ahead all-gathers on NCCL

5df9c51
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar