[Perf] Skip blocking GPU->CPU sync of num_accepted_tokens in hybrid+a…#42574
Open
mamingyuan-nv wants to merge 1 commit into
Open
[Perf] Skip blocking GPU->CPU sync of num_accepted_tokens in hybrid+a…#42574mamingyuan-nv wants to merge 1 commit into
mamingyuan-nv wants to merge 1 commit into