Skip to content

MROPE for VLM GRPO#5198

Merged
Datta0 merged 5 commits into
unslothai:mainfrom
Datta0:vl_grpo_mrope
May 1, 2026
Merged

MROPE for VLM GRPO#5198
Datta0 merged 5 commits into
unslothai:mainfrom
Datta0:vl_grpo_mrope

Conversation

@Datta0
Copy link
Copy Markdown
Collaborator

@Datta0 Datta0 commented Apr 27, 2026

Recreate MRoPE token type ids with adjusted seq lens for VLM GRPO

Fixes: #5176
Companion: unslothai/unsloth-zoo#614

@gemini-code-assist
Copy link
Copy Markdown
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@Datta0 Datta0 marked this pull request as ready for review April 27, 2026 07:39
@Datta0 Datta0 merged commit 329f99d into unslothai:main May 1, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] RuntimeError: shape mismatch in get_rope_index during GRPO training with Qwen3-VL(8B)

2 participants