Skip to content

Enable chunked NLL loss with VLM in SFT #5684

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
qgallouedec merged 30 commits into from
May 8, 2026
Merged

Enable chunked NLL loss with VLM in SFT #5684

Show file tree
Hide file tree
Changes from 18 commits
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
0cf0afb
Enable chunked NLL loss with PEFT in SFT
qgallouedec Apr 28, 2026
b3abe56
fix for prompt tuning
qgallouedec Apr 29, 2026
30d1d73
style
qgallouedec Apr 29, 2026
69c1b2f
better
qgallouedec Apr 29, 2026
77ba54c
Merge branch 'main' into chunked_nll_peft
qgallouedec Apr 29, 2026
68f4f94
raise
qgallouedec Apr 29, 2026
248dbeb
Enable chunked NLL loss with VLM in SFT
qgallouedec Apr 29, 2026
a4cad2e
style
qgallouedec Apr 29, 2026
c81430d
Add VLM support to chunked cross-entropy loss tests
qgallouedec Apr 29, 2026
35903e2
more vlms
qgallouedec Apr 29, 2026
eeb4a37
rm docstring
qgallouedec Apr 29, 2026
7006f11
Merge branch 'main' into chunked_nll_peft
qgallouedec Apr 30, 2026
c0e822f
Merge branch 'chunked_nll_peft' into chunked-nll-vlm
qgallouedec Apr 30, 2026
f256f32
Merge branch 'main' into chunked_nll_peft
qgallouedec May 3, 2026
5764e15
Merge branch 'chunked_nll_peft' into chunked-nll-vlm
qgallouedec May 3, 2026
e9cb282
Merge branch 'main' into chunked_nll_peft
qgallouedec May 4, 2026
5bb1309
Merge branch 'chunked_nll_peft' into chunked-nll-vlm
qgallouedec May 4, 2026
412dacf
fix base model resolution for old transformers versions
qgallouedec May 4, 2026
a080fa3
update auxiliary loss calculation to use text_config parameters
qgallouedec May 4, 2026
93ea587
allow old transformers versions
qgallouedec May 4, 2026
c48bb10
Merge branch 'main' into chunked_nll_peft
qgallouedec May 5, 2026
cd2cf7d
Merge branch 'chunked_nll_peft' into chunked-nll-vlm
qgallouedec May 5, 2026
54da4eb
Merge branch 'main' into chunked-nll-vlm
qgallouedec May 6, 2026
00cb84b
Merge branch 'main' into chunked-nll-vlm
qgallouedec May 6, 2026
de46c96
remove duplicate + consistency
qgallouedec May 6, 2026
7010136
concistency
qgallouedec May 6, 2026
e46a5b0
Merge branch 'main' into chunked-nll-vlm
qgallouedec May 7, 2026
4205b3c
align loss type doc
qgallouedec May 7, 2026
9387319
a bit better testing
qgallouedec May 7, 2026
ec0cad7
Merge branch 'main' into chunked-nll-vlm
qgallouedec May 8, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading