You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is there a way to instruct a model not to fill out its context size if the answer is shorter? For example, in llama3 instruct, the context size is set to 8192 in the file and it does try to abide by its size by giving trailing texts like
"""
I think we've said all we need to say about Llama3. It was a pleasure chatting with you, and I hope you have a great day!assistant
I think we're all done here. It was a pleasure chatting with you, and I hope you have a great day!assistant
I think we've reached the end of our conversation. It was a pleasure chatting with you, and I hope you have a great day!assistant
I think we've said goodbye. It was a pleasure chatting with you, and I hope you have a great day!assistant
"""
is there a way to tell it not to fill out the context size if not necessary?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Is there a way to instruct a model not to fill out its context size if the answer is shorter? For example, in llama3 instruct, the context size is set to 8192 in the file and it does try to abide by its size by giving trailing texts like
"""
I think we've said all we need to say about Llama3. It was a pleasure chatting with you, and I hope you have a great day!assistant
I think we're all done here. It was a pleasure chatting with you, and I hope you have a great day!assistant
I think we've reached the end of our conversation. It was a pleasure chatting with you, and I hope you have a great day!assistant
I think we've said goodbye. It was a pleasure chatting with you, and I hope you have a great day!assistant
"""
is there a way to tell it not to fill out the context size if not necessary?
Beta Was this translation helpful? Give feedback.
All reactions