Skip to content
This repository was archived by the owner on Sep 4, 2025. It is now read-only.

[Cherry-Pick] [Bugfix] Set SamplingParams.max_tokens for OpenAI requests if not provided by user (#6954)#117

Merged
Xaenalt merged 2 commits into
opendatahub-io:mainfrom
Xaenalt:bugfix/SamplingParams
Aug 2, 2024
Merged

[Cherry-Pick] [Bugfix] Set SamplingParams.max_tokens for OpenAI requests if not provided by user (#6954)#117
Xaenalt merged 2 commits into
opendatahub-io:mainfrom
Xaenalt:bugfix/SamplingParams