Skip to content

ep: vLLM serving integration fixes (device selection, disagg proxy, test controls) - #2

Closed
fergusfinn wants to merge 7 commits into
cxi-epfrom
issue1-zero-token-rdma-count
Closed

ep: vLLM serving integration fixes (device selection, disagg proxy, test controls)#2
fergusfinn wants to merge 7 commits into
cxi-epfrom
issue1-zero-token-rdma-count

ep: use the current CUDA device; never read LOCAL_RANK

c02fb08
Select commit
Loading
Failed to load commit list.

There are no checks for this commit