[Model] Pipeline parallel support for Mixtral#6403

binxuan wants to merge 4 commits intovllm-project:mainvllm-project/vllm:mainfrom

binxuan:binxuan-mixtral-ppbinxuan/vllm:binxuan-mixtral-ppCopy head branch name to clipboard