Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

max_tokens (max_completion_tokens) not allowed for all configurations of OpenAICompatible #128

Closed
IDLe-Engineering opened this issue Oct 28, 2024 · 3 comments
Closed

max_tokens (max_completion_tokens) not allowed for all configurations of OpenAICompatible #128

IDLe-Engineering opened this issue Oct 28, 2024 · 3 comments
Labels
question Further information is requested

Comments

@IDLe-Engineering
Copy link
Contributor

"object": "error",
"message": "[{'type': 'extra_forbidden', 'loc': ('body', 'max_completion_tokens'), 'msg': 'Extra inputs are not permitted', 'input': 8192}]",
"type": "BadRequestError",
"param": null,
"code": 400

Option necessary to disable max_tokens
@IDLe-Engineering IDLe-Engineering mentioned this issue Oct 28, 2024
Closed
@andrewpareles andrewpareles added the question Further information is requested label Oct 28, 2024
andrewpareles added a commit that referenced this issue Oct 28, 2024
@andrewpareles
Merge pull request #133 from voideditor/multiple-webviews
222f90b 
Max tokens is optional + other config updates - Fixes #128
@andrewpareles andrewpareles reopened this Oct 28, 2024
@andrewpareles
Copy link
Contributor

Added the ability to specify number of tokens manually or leave it blank.

Just so we know, what provider are you using (which doesn't support max_completion_tokens)?

@IDLe-Engineering
Copy link
Contributor Author

Thanks Andrew! replied in Discord

@IDLe-Engineering
Copy link
Contributor Author

Tested and it works. I am closing the issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@IDLe-Engineering @andrewpareles