Skip to content

Pull requests: turboderp/exllamav2

New pull request New
14 Open 112 Closed
14 Open 112 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Implementation of logit threshold sampler and confidence breaker
#657 opened Oct 17, 2024 by anchortense Loading…
Add ExLlamaV2Sampler.Settings.logits_processor
#634 opened Sep 23, 2024 by lapp0 Loading…
4
Improvement to enable quantization of Merge Models
#623 opened Sep 10, 2024 by PedroPareja Loading…
1
[kernel] switch from PYBIND11 to TORCH_LIBRARY
#617 opened Sep 6, 2024 by AlpinDale • Draft
added option for tokenized input to dynamic generator
#613 opened Sep 2, 2024 by KT313 Loading…
Add batch processing to MMLU and Humaneval evaluation scripts to prevent OOM errors
#597 opened Aug 23, 2024 by LlamaEnjoyer Loading…
8
Adding stream to 1 kernel.
#590 opened Aug 14, 2024 by Narsil Loading…
4
Simple QuaRot proof of concept.
#407 opened Apr 11, 2024 by sgsdxzy Loading…
4
Refactor token healing initialization.
#330 opened Feb 10, 2024 by bjj Loading…
4
Update setup.py UX responses and module checks with helpful messaging
#277 opened Jan 15, 2024 by bgorlick Loading…
4
Repeat layers to create FrankenModels
#275 opened Jan 12, 2024 by dnhkng Loading…
34
add QuiP quant support
#217 opened Dec 7, 2023 by waters222 Loading…
3
Adding return_lowest_perplexity
#206 opened Dec 3, 2023 by ziadloo Loading…
Add copilot server example
#23 opened Sep 13, 2023 by chenhunghan Loading…
9
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.