[#8948][feat] Support custom sharding config#9143

greg-kwasniewski1 merged 15 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

nv-auto-deploy:gk/manual_sharding_sourcenv-auto-deploy/TensorRT-LLM:gk/manual_sharding_sourceCopy head branch name to clipboard