Skip to content

[Docs] Troubleshooting - async + preemption#610

Merged
mgawarkiewicz-intel merged 5 commits into
releases/v0.11.0from
adobrzyn/troubleshooting_async_and_preemption
Nov 21, 2025
Merged

[Docs] Troubleshooting - async + preemption#610
mgawarkiewicz-intel merged 5 commits into
releases/v0.11.0from
adobrzyn/troubleshooting_async_and_preemption

Conversation

@adobrzyn
Copy link
Copy Markdown
Collaborator

No description provided.

Signed-off-by: Agata Dobrzyniewicz <adobrzyniewicz@habana.ai>
Copilot AI review requested due to automatic review settings November 21, 2025 06:33
@adobrzyn adobrzyn added documentation Improvements or additions to documentation skip-gaudi-tests labels Nov 21, 2025
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR adds a new troubleshooting entry to the documentation addressing issues with the async scheduler when preemption occurs in vLLM version 0.11.0.

Key changes:

  • Adds troubleshooting section #3 documenting an async scheduler error related to preemption
  • Provides three workarounds: lowering max concurrency, decreasing max-num-seqs, or disabling the async scheduler

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread docs/user_guide/troubleshooting.md Outdated
Comment thread docs/user_guide/troubleshooting.md Outdated
adobrzyn and others added 2 commits November 21, 2025 07:35
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Signed-off-by: Agata Dobrzyniewicz <160237065+adobrzyn@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Signed-off-by: Agata Dobrzyniewicz <160237065+adobrzyn@users.noreply.github.com>
adobrzyn and others added 2 commits November 21, 2025 09:37
Signed-off-by: Agata Dobrzyniewicz <adobrzyniewicz@habana.ai>
@mgawarkiewicz-intel mgawarkiewicz-intel merged commit e713f85 into releases/v0.11.0 Nov 21, 2025
12 checks passed
@adobrzyn adobrzyn deleted the adobrzyn/troubleshooting_async_and_preemption branch January 9, 2026 10:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation skip-gaudi-tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants