Skip to content

support llava video - #426

Merged
merrymercy merged 15 commits into
sgl-project:mainfrom
ZhangYuanhan-AI:official_llava_video
May 13, 2024
Merged

merrymercy merged 15 commits into
sgl-project:mainfrom
ZhangYuanhan-AI:official_llava_video

Conversation

@ZhangYuanhan-AI

Copy link
Copy Markdown
Contributor

No description provided.

Comment thread README.md Outdated
Comment thread examples/quick_start/srt_example_llava_v.sh Outdated
Comment thread python/pyproject.toml Outdated
Comment thread python/sglang/api.py Outdated
Comment thread python/sglang/backend/openai.py
Comment thread python/sglang/launch_server_llavavid.py Outdated
Comment thread python/sglang/srt/utils.py Outdated
Comment thread python/sglang/srt/utils.py Outdated
Comment thread python/sglang/utils.py Outdated
Comment thread test/srt/test_jump_forward.py Outdated
@ZhangYuanhan-AI

Copy link
Copy Markdown
Contributor Author

Looks like there are no conflict at README.md

@merrymercy merrymercy left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We are very close now, but I found several obvious errors that make the code unable to run. Could you fix them and do one test?

Comment thread python/sglang/__init__.py Outdated
Comment thread python/sglang/api.py Outdated
Comment thread python/sglang/utils.py Outdated
ZhangYuanhan-AI and others added 4 commits May 13, 2024 09:56
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Comment thread python/pyproject.toml Outdated
@merrymercy

merrymercy commented May 13, 2024

Copy link
Copy Markdown
Contributor

Your PR makes llava-v1.6 not runnable. Could you do more tests and let me know it is fully ready for merge?

cd sglang/examples/quick_start
python3 srt_example_llava.py

Error:
image

@merrymercy
merrymercy merged commit 0992d85 into sgl-project:main May 13, 2024
@merrymercy

Copy link
Copy Markdown
Contributor

@ZhangYuanhan-AI Thanks! It is merged

timethink pushed a commit to timethink/sglang that referenced this pull request Mar 9, 2025
Garrybest pushed a commit to Garrybest/sglang that referenced this pull request Jan 9, 2026
vschandramourya pushed a commit to vschandramourya/sglang that referenced this pull request Feb 3, 2026
…oject#426)

* Copy OSS code from 9054e844 on 20251123

* pdate ci

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
HanHan009527 pushed a commit to HanHan009527/sglang that referenced this pull request Apr 7, 2026
efschu added a commit to efschu/htsglang that referenced this pull request Aug 2, 2026
…fill indexer (sgl-project#449)

MiB-budgeted query-row loop over the existing KV-page loop (sgl-project#395 discipline,
sgl-project#426 composition preserved); B-fold KV-gather duplication bounded from factor B
to the budgeted row count; bit-identical (atol=0) against the unchunked path and
the untouched single-pass reference. Collective audit clean under uneven-TP rank
divergence. GPU measurement (peak VRAM per rank primary) pending — NOTE_449 §5.
Full dedup of the B-fold gather stays open as ANALYSE_447 candidate C.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants