[core] port pynvml into vllm codebase#12963

youkaichao merged 6 commits intovllm-project:mainvllm-project/vllm:mainfrom

youkaichao:pynvmlyoukaichao/vllm:pynvmlCopy head branch name to clipboard