[Perf] Use np.ndarray instead of list[list[int]] to reduce GC overhead#28245

zhuohan123 merged 5 commits into

vllm-project:mainvllm-project/vllm:mainfrom

Jialin:logprob-nested-listJialin/vllm:logprob-nested-listCopy head branch name to clipboard