Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create a /detokenize example server endpoint #2801

Closed
BruceMacD opened this issue Aug 26, 2023 · 1 comment · Fixed by #2802
Closed

Create a /detokenize example server endpoint #2801

BruceMacD opened this issue Aug 26, 2023 · 1 comment · Fixed by #2802

Comments

@BruceMacD
Copy link
Contributor

Expected Behavior

The example server has a /tokenize endpoint which converts strings to tokens. I am storing the response from this endpoint to calculate the token length of an input (for context window reasons) so I'd also like a /detokenize to convert this back into a string for prompting reasons.

Current Behavior

No /detokenize endpoint.
@BruceMacD
Copy link
Contributor Author

I can open a PR for this myself.

@BruceMacD BruceMacD mentioned this issue Aug 26, 2023
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add a /detokenize endpoint to the example server BruceMacD/llama.cpp
1 participant
@BruceMacD