You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The text was updated successfully, but these errors were encountered:
sadra-barikbin
changed the title
max_new_tokens's default in docstring of InferenceClient::chat_completion's is 20 but that of TGI is 100max_tokens's default in docstring of InferenceClient::chat_completion's is 20 but that of TGI is 100Nov 3, 2024
sadra-barikbin
changed the title
max_tokens's default in docstring of InferenceClient::chat_completion's is 20 but that of TGI is 100max_tokens's default in docstring of InferenceClient::chat_completion's is 20 but that of TGI is 100
Nov 3, 2024
Hi there!🤗
InferenceClient::chat_completion
's docstring states thatmax_tokens
's default value is20
but it seems that of the TGI is100
.huggingface_hub/src/huggingface_hub/inference/_client.py
Lines 586 to 587 in 8a99deb
https://github.com/huggingface/text-generation-inference/blob/6e3220529df5906ae586031873b7865e9923040b/router/src/lib.rs#L939
The text was updated successfully, but these errors were encountered: