[Chore][Doc] uses model id determined from OpenAI client#17815
[Chore][Doc] uses model id determined from OpenAI client#17815russellb merged 1 commit intovllm-project:mainfrom
Conversation
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
|
👋 Hi! Thank you for contributing to the vLLM project. 💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels. Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging. To run CI, PR reviewers can either: Add 🚀 |
…t#17815) Signed-off-by: Aaron Pham <contact@aarnphm.xyz> Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
…t#17815) Signed-off-by: Aaron Pham <contact@aarnphm.xyz> Signed-off-by: Mu Huai <tianbowen.tbw@antgroup.com>
…t#17815) Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
…t#17815) Signed-off-by: Aaron Pham <contact@aarnphm.xyz> Signed-off-by: Yuqi Zhang <yuqizhang@google.com>
This PR cleanups the model id for some structured outputs examples
where before it was hard coded. This PR will determine this model id
from clien such that it will work based on the models users tests with
vllm serveSigned-off-by: Aaron Pham contact@aarnphm.xyz