This repository was archived by the owner on Jun 3, 2025. It is now read-only.

[Cherry-Pick] for 1.7#1565

Merged

bfineran merged 1 commit intorelease/1.7from

cherry_pick_1.7

Jan 29, 2024

Commits on Jan 29, 2024

[TextGeneration] Split up `prep_for_generation` operator, handle edge cases, handle kv_cache full during prefill (#1562)
dsikka
committed