Skip to content

Json Decode && Mutl-Turns #4

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 25 commits into from
Jan 15, 2024
Merged

Json Decode && Mutl-Turns #4

merged 25 commits into from
Jan 15, 2024

Conversation

@hnyls2002
Copy link
Collaborator

@hnyls2002 hnyls2002 commented Jan 10, 2024 •
edited
Loading

Still in progress...

  • multi-turns with uniformly sampled length.
  • Fix sglArgument.
  • New sleep policy(and it works).
  • Long and short multi-turns benchmark.
  • Mixtral on 8xA10
  • Possible improvement about manager/model_rpc/backend_config

merrymercy
merrymercy requested changes Jan 15, 2024
View reviewed changes
Copy link
Contributor

@merrymercy merrymercy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Run this unit test

@merrymercy merrymercy merged commit 08ab2a1 into main Jan 15, 2024
@merrymercy merrymercy deleted the json-mt-bench branch January 15, 2024 08:49
@Rookie-Kai Rookie-Kai mentioned this pull request Aug 14, 2024
Closed
4 tasks
@wonderisland wonderisland mentioned this pull request Sep 19, 2024
Closed
5 tasks
@yuleiqin yuleiqin mentioned this pull request May 26, 2025
Closed
5 tasks
chunyuan-w added a commit to chunyuan-w/sglang that referenced this pull request May 28, 2025
@chunyuan-w @jianan-gu
bind OpenMP threads to CPU cores (sgl-project#4)
6e79dae
chunyuan-w added a commit to chunyuan-w/sglang that referenced this pull request Jun 3, 2025
@chunyuan-w
bind OpenMP threads to CPU cores (sgl-project#4)
a49f143
@EricKing626 EricKing626 mentioned this pull request Jun 10, 2025
Closed
5 tasks
chunyuan-w added a commit to chunyuan-w/sglang that referenced this pull request Jun 17, 2025
@chunyuan-w
bind OpenMP threads to CPU cores (sgl-project#4)
4627009
chunyuan-w added a commit to chunyuan-w/sglang that referenced this pull request Jun 30, 2025
@chunyuan-w
bind OpenMP threads to CPU cores (sgl-project#4)
92c9d64
@Xerxes-cn Xerxes-cn mentioned this pull request Jul 14, 2025
Closed
5 tasks
wangqian108 pushed a commit to wangqian108/sglang that referenced this pull request Jul 17, 2025
@ZhengdQin
Merge pull request sgl-project#4 from ZhengdQin/b_npu_graph_executor
2866a80 
support NpuGraphRunner
@lingyaoluu lingyaoluu mentioned this pull request Jul 25, 2025
Open
5 tasks
yichiche pushed a commit to yichiche/sglang that referenced this pull request Jul 30, 2025
@Hardcode84
Align Wave Paged Decode with triton kernel (sgl-project#4)
e4bdfdc 
Signed-off-by: Ivan Butygin <[email protected]>
yichiche pushed a commit to yichiche/sglang that referenced this pull request Aug 7, 2025
@Hardcode84 @yichiche
Align Wave Paged Decode with triton kernel (sgl-project#4)
a1b83e1 
Signed-off-by: Ivan Butygin <[email protected]>
yichiche pushed a commit to yichiche/sglang that referenced this pull request Aug 11, 2025
@Hardcode84 @yichiche
Align Wave Paged Decode with triton kernel (sgl-project#4)
4b5ec49 
Signed-off-by: Ivan Butygin <[email protected]>
@ericschreiber ericschreiber mentioned this pull request Aug 13, 2025
Open
5 tasks
@gaolaobao gaolaobao mentioned this pull request Aug 25, 2025
Closed
5 tasks
@Johnsonms Johnsonms mentioned this pull request Oct 2, 2025
Merged
LinHeLurking pushed a commit to LinHeLurking/sglang that referenced this pull request Oct 13, 2025
@reyoung
Merge pull request sgl-project#4 from TopIdiot/hotfix/qk_norm_add_eps
4cf30a3 
add eps for qk norm
someoneexistsontheinternet pushed a commit to someoneexistsontheinternet/sglang that referenced this pull request Oct 23, 2025
@dmahan93
Merge pull request sgl-project#4 from NousResearch/add-nccl-multiproc…
c30f5ae 
…ess-weight-updates

- behold, no more waiting on param updates to run
kalyank007 pushed a commit to kalyank007/sglang that referenced this pull request Nov 7, 2025
@vshekhawat-hlab @habsvcreprotool
@polisettyvarma @kalyank007
Add XPU device support to BaseMultimodalProcessor (sgl-project#4)
52776b0 
Co-authored-by: svc_repro_tool <[email protected]>
Co-authored-by: Polisetty V R K Jyothendra Varma <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@merrymercy merrymercy merrymercy requested changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@hnyls2002 @merrymercy