[llm.serving] Address dependencies related issues for llm serving#50785

aslonnie merged 2 commits intoray-project:masterray-project/ray:masterfrom

GeneDer:genesu/add-more-llm-dependenciesGeneDer/ray:genesu/add-more-llm-dependenciesCopy head branch name to clipboard