Skip to content

[Diffusion][CPU] Adding AMX optimizations for CPU platform - #30719

Open
jianan-gu wants to merge 14 commits into
sgl-project:mainfrom
jianan-gu:amx_sgl-diffusion_opt
Open

[Diffusion][CPU] Adding AMX optimizations for CPU platform#30719
jianan-gu wants to merge 14 commits into
sgl-project:mainfrom
jianan-gu:amx_sgl-diffusion_opt

Conversation

@jianan-gu

@jianan-gu jianan-gu commented Jul 10, 2026

Copy link
Copy Markdown
Contributor

This PR is re-landing #28527, as was reverted in #30716 due to the duplicated process_weight_after_loading (mentioned in #28527 (comment)) and breaks CI.

This PR contains the changes from #28527 and also the fix to avoid such duplicating.


CI States

Latest PR Test (Base): ❌ Run #34432534333
Latest PR Test (Extra): ❌ Run #34432534063
Latest PR Test (AMD ROCm 10): ❌ Run #34432534373

@gemini-code-assist

Copy link
Copy Markdown
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@github-actions github-actions Bot added Multi-modal multi-modal language model sgl-kernel diffusion SGLang Diffusion labels Jul 10, 2026
@jianan-gu

Copy link
Copy Markdown
Contributor Author

/tag-and-rerun-ci

@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

5 similar comments
@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

@jianan-gu

Copy link
Copy Markdown
Contributor Author

Hi @mickqian , would you please help review this PR? Thanks.

@jianan-gu

Copy link
Copy Markdown
Contributor Author

Hi @mickqian , soft reminder, any chance to help review this PR? Thanks!

@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

3 similar comments
@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

2 similar comments
@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

1 similar comment
@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

1 similar comment
@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

3 similar comments
@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

1 similar comment
@jianan-gu

Copy link
Copy Markdown
Contributor Author

/rerun-failed-ci

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

diffusion SGLang Diffusion Multi-modal multi-modal language model run-ci sgl-kernel

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants