Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
f7f6bb6
🐛 req_ids is now a list
prashantgupta24 Jul 1, 2025
8f7acaf
🐛 req_ids is now a list
prashantgupta24 Jul 1, 2025
06b8d7d
♻️ using cached requests
prashantgupta24 Jul 1, 2025
a064d3b
🐛 first pass for sb
prashantgupta24 Jul 2, 2025
989f6d2
🐛 first pass for cb
prashantgupta24 Jul 2, 2025
1dcc582
Merge remote-tracking branch 'upstream/main' into fix-upstream
prashantgupta24 Jul 2, 2025
bd7e008
🐛 fix merge bug
prashantgupta24 Jul 2, 2025
fe8e64c
🎨 renaming vars
prashantgupta24 Jul 3, 2025
df9214b
🔥 remove commented code
prashantgupta24 Jul 3, 2025
c23f4c5
Duplicate the SamplingMetadata class
maxdebayser Jul 3, 2025
f065785
🔥 remove extra commas
prashantgupta24 Jul 3, 2025
425c3d2
fix linting
maxdebayser Jul 3, 2025
05ea423
Actually more classes need to be duplicated
maxdebayser Jul 3, 2025
6e1f712
import the right sampler
maxdebayser Jul 3, 2025
c614eb1
fix tests
maxdebayser Jul 3, 2025
a3b37c4
fix tests
maxdebayser Jul 3, 2025
d965338
🚧 wip to see if tests pass
prashantgupta24 Jul 3, 2025
7c82358
🚧 cache new tokens
prashantgupta24 Jul 4, 2025
6f4c5de
🚧 cache new tokens works???
prashantgupta24 Jul 4, 2025
a4d610b
test till logits processor commit
prashantgupta24 Jul 4, 2025
1e08815
Merge remote-tracking branch 'upstream/fix_sampling_metadata' into vl…
prashantgupta24 Jul 4, 2025
09c7c03
revert to test from main
prashantgupta24 Jul 4, 2025
c959648
🐛 fix for sb
prashantgupta24 Jul 4, 2025
efc467f
🎨 fmt
prashantgupta24 Jul 5, 2025
24a7653
🎨 fmt
prashantgupta24 Jul 5, 2025
335f461
Merge remote-tracking branch 'upstream/main' into vllm-main-updates
prashantgupta24 Jul 7, 2025
dfcbba4
🔥 remove unused var
prashantgupta24 Jul 7, 2025
6d61784
🎨 add comment, remove unused var
prashantgupta24 Jul 7, 2025
9a5769f
🎨 improve condition
prashantgupta24 Jul 7, 2025
b1a7c85
🎨 add comment
prashantgupta24 Jul 7, 2025
6a5d3a6
⬆️ bump to vllm>=0.9.2
prashantgupta24 Jul 8, 2025
cda2775
Merge branch 'main' into vllm-main-updates
prashantgupta24 Jul 8, 2025
e92a566
Merge remote-tracking branch 'upstream/main' into vllm-main-updates
prashantgupta24 Jul 8, 2025
daadc0e
🎨 fix comments
prashantgupta24 Jul 8, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ license = {text = "Apache 2"}
dependencies = [
"fms-model-optimizer>=0.2.0",
"ibm-fms==1.1.0",
"vllm>=0.9.0,!=0.9.1",
"vllm>=0.9.2",
]
requires-python = ">=3.9"
dynamic = ["version"]
Expand Down
Loading