Skip to content

feat: chunked logprob calculation with deferred fp32 cast to help with OOM#918

Merged
terrykong merged 55 commits intomainfrom
pjin/logprob
Aug 15, 2025
Merged

feat: chunked logprob calculation with deferred fp32 cast to help with OOM#918
terrykong merged 55 commits intomainfrom
pjin/logprob

Commits

Commits on Aug 6, 2025

Commits on Aug 7, 2025

Commits on Aug 8, 2025

Commits on Aug 9, 2025

Commits on Aug 11, 2025

Commits on Aug 12, 2025

Commits on Aug 13, 2025

Commits on Aug 14, 2025

Commits on Aug 15, 2025