chore (1.x): support vllm 0.18.0 without backwards compat#861
chore (1.x): support vllm 0.18.0 without backwards compat#861tjohnson31415 merged 7 commits intotorch-spyre:stable/1.xfrom
Conversation
|
👋 Hi! Thank you for contributing to vLLM support on Spyre. We also recommend installing prek and configuring it to check your code before every local commit. |
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
213a398 to
b4930bd
Compare
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
b4930bd to
5b1298e
Compare
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
|
Had a job fail with an client timeout / broken connection a couple times, but now it seems to have passed. I also reproduced it locally, but the was unable to reproduce it after a few more tries. So we may have a little bit of flakiness 🤔 |
|
bot:test |
|
bot:test |
|
bot:test |
1 similar comment
|
bot:test |
|
Remaining spyre-ci failures have been confirmed to be unrelated to this PR's changes. |
Description
We want to make another release on the 1.x line and need to use the latest vLLM. We are allowing this change to drop support for older vLLM versions. vLLM supported range will now have 0.17.0 as a lower bound.
Related Issues
Test Plan
Must pass all standard CI tests.
Checklist
bash format.sh)Signed-off-by:line (DCO compliance)