This repository was archived by the owner on Oct 11, 2024. It is now read-only.

Upstream sync 2024 06 12#302

Merged

robertgshaw2-redhat merged 21 commits intomainfrom

upstream-sync-2024-06-12

Jun 12, 2024

Commits on Jun 12, 2024

[Doc] Add documentation for FP8 W8A8 (#5388)

mgoin
authored and
Robert Shaw
committed
[ci] Fix Buildkite agent path (#5392)

khluu
authored and
Robert Shaw
committed
[Misc] Various simplifications and typing fixes (#5368)

njhill
authored and
Robert Shaw
committed
[Bugfix] OpenAI entrypoint limits logprobs while ignoring server defined --max-logprobs (#5312)

authored and
Robert Shaw
committed
[Bugfix][Frontend] Cleanup "fix chat logprobs" (#5026)

DarkLight1337
authored and
Robert Shaw
committed
[Doc] add debugging tips (#5409)

youkaichao
authored and
Robert Shaw
committed
[Doc][Typo] Fixing Missing Comma (#5403)

ywang96
authored and
Robert Shaw
committed
[Misc] Remove VLLM_BUILD_WITH_NEURON env variable (#5389)

WoosukKwon
authored and
Robert Shaw
committed
[CI] docfix (#5410)

authored and
Robert Shaw
committed
[Speculative decoding] Initial spec decode docs (#5400)

cadedaniel
authored and
Robert Shaw
committed
[Doc] Add an automatic prefix caching section in vllm documentation (#5324)

authored and
Robert Shaw
committed
[Docs] [Spec decode] Fix docs error in code example (#5427)

cadedaniel
authored and
Robert Shaw
committed
[Bugfix] Fix `MultiprocessingGPUExecutor.check_health` when world_size == 1 (#5254)

jsato8094
authored and
Robert Shaw
committed
[Bugfix] fix lora_dtype value type in arg_utils.py (#5398)

c3-ali
authored and
Robert Shaw
committed
[Frontend] Customizable RoPE theta (#5197)

sasha0552
authored and
Robert Shaw
committed
[Core][Distributed] add same-node detection (#5369)

youkaichao
authored and
Robert Shaw
committed
[Core][Doc] Default to multiprocessing for single-node distributed case (#5230)

authored and
Robert Shaw
committed
[Doc] add common case for long waiting time (#5430)

youkaichao
authored and
Robert Shaw
committed
fix test compressed.py
Robert Shaw
committed
fix calling test_same_node
Robert Shaw
committed
format
Robert Shaw
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Upstream sync 2024 06 12#302

Upstream sync 2024 06 12#302
robertgshaw2-redhat merged 21 commits intomainfrom
upstream-sync-2024-06-12

Commits on Jun 12, 2024

[Doc] Add documentation for FP8 W8A8 (#5388)

[ci] Fix Buildkite agent path (#5392)

[Misc] Various simplifications and typing fixes (#5368)

[Bugfix] OpenAI entrypoint limits logprobs while ignoring server defined --max-logprobs (#5312)

[Bugfix][Frontend] Cleanup "fix chat logprobs" (#5026)

[Doc] add debugging tips (#5409)

[Doc][Typo] Fixing Missing Comma (#5403)

[Misc] Remove VLLM_BUILD_WITH_NEURON env variable (#5389)

[CI] docfix (#5410)

[Speculative decoding] Initial spec decode docs (#5400)

[Doc] Add an automatic prefix caching section in vllm documentation (#5324)

[Docs] [Spec decode] Fix docs error in code example (#5427)

[Bugfix] Fix `MultiprocessingGPUExecutor.check_health` when world_size == 1 (#5254)

[Bugfix] fix lora_dtype value type in arg_utils.py (#5398)

[Frontend] Customizable RoPE theta (#5197)

[Core][Distributed] add same-node detection (#5369)

[Core][Doc] Default to multiprocessing for single-node distributed case (#5230)

[Doc] add common case for long waiting time (#5430)

fix test compressed.py

fix calling test_same_node

format