Skip to content

Reducing memory usage: removing useless logits computation in generate()#31292

Merged
gante merged 35 commits intohuggingface:mainfrom
Cyrilvallez:logits-dtype
Aug 23, 2024
Merged

Reducing memory usage: removing useless logits computation in generate()#31292
gante merged 35 commits intohuggingface:mainfrom
Cyrilvallez:logits-dtype

Commits

Commits on Aug 23, 2024