Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: remove a sampler from a chain #9445

Merged
merged 3 commits into from
Sep 13, 2024

Conversation

giladgd
Copy link
Contributor

@giladgd giladgd commented Sep 12, 2024

This PR makes it possible to remove a sampler from a chain.
This is useful for removing a sampler from before freeing the chain, to keep an existing state of a specific sampler.

src/llama-sampling.cpp Outdated Show resolved Hide resolved
@giladgd giladgd requested a review from slaren September 12, 2024 01:00
src/llama-sampling.cpp Outdated Show resolved Hide resolved
@slaren slaren merged commit bd35cb0 into ggerganov:master Sep 13, 2024
51 checks passed
@giladgd giladgd deleted the removeChainSampler branch October 5, 2024 19:04
dsx1986 pushed a commit to dsx1986/llama.cpp that referenced this pull request Oct 29, 2024
* feat: remove a sampler from a chain

* fix: return removed sampler

* fix: safer casting
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants