Skip to content

[Backend support] Allow num_logits_to_keep as Tensor and change it to logits_to_keep + add flag#35757

Merged
Cyrilvallez merged 7 commits intomainfrom
tgi-support
Jan 23, 2025
Merged

[Backend support] Allow num_logits_to_keep as Tensor and change it to logits_to_keep + add flag#35757
Cyrilvallez merged 7 commits intomainfrom
tgi-support

Commits

Commits on Jan 21, 2025