Skip to content

[Kernel] Enhance MoE benchmarking & tuning script #4921

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
WoosukKwon merged 17 commits into from
Jun 4, 2024
Merged

[Kernel] Enhance MoE benchmarking & tuning script #4921

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
e00d01d
[Kernel] Improve benchmark_moe script
WoosukKwon May 20, 2024
717e8c7
Delete benchmark_mixtral_moe
WoosukKwon May 20, 2024
1bbed44
Minor fixes
WoosukKwon May 21, 2024
1324af4
Fix
WoosukKwon May 21, 2024
66f418a
Minor
WoosukKwon May 28, 2024
5c99cd6
Merge branch 'main' into bench-moe
WoosukKwon May 28, 2024
419468b
Merge branch 'main' into bench-moe
WoosukKwon Jun 3, 2024
9088e17
Update
WoosukKwon Jun 3, 2024
2e42872
Update
WoosukKwon Jun 3, 2024
e5e46e8
Add get_default_configs
WoosukKwon Jun 3, 2024
005b07c
Minor
WoosukKwon Jun 3, 2024
2b05e50
Fix search space
WoosukKwon Jun 3, 2024
6f472bb
Minor
WoosukKwon Jun 3, 2024
fe1c026
Address comments
WoosukKwon Jun 4, 2024
04c3d11
Add Ray tqdm
WoosukKwon Jun 4, 2024
f78a73b
isort
WoosukKwon Jun 4, 2024
ff474db
Merge branch 'main' into bench-moe
WoosukKwon Jun 4, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
239 changes: 0 additions & 239 deletions benchmarks/kernels/benchmark_mixtral_moe.py
View file
Open in desktop

This file was deleted.

Loading