Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GGUF #540

Closed
bigdog3000 opened this issue Mar 5, 2024 · 3 comments · Fixed by #581
Closed

GGUF #540

bigdog3000 opened this issue Mar 5, 2024 · 3 comments · Fixed by #581
Labels
duplicate This issue or pull request already exists generators Interfaces with LLMs

Comments

@bigdog3000
Copy link

Can you add an additional type like GGUF, the successor to GGML

Thanks
@leondz leondz added the generators Interfaces with LLMs label Mar 5, 2024
@leondz
Copy link
Collaborator

leondz commented Mar 5, 2024

yep, will queue this up. thanks

@leondz
Copy link
Collaborator

leondz commented Mar 15, 2024

docs: https://huggingface.co/docs/hub/gguf

@leondz leondz mentioned this issue Mar 22, 2024
Closed
3 tasks
@leondz
Copy link
Collaborator

leondz commented Mar 24, 2024

tracking this in #568! will close this issue and defer to there.

@leondz leondz closed this as completed Mar 24, 2024
@leondz leondz linked a pull request Apr 5, 2024 that will close this issue
Convert GGML to expect GGUF format #581
Merged
@leondz leondz added the duplicate This issue or pull request already exists label Apr 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
duplicate This issue or pull request already exists generators Interfaces with LLMs
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Convert GGML to expect GGUF format jmartin-tech/garak
2 participants
@leondz @bigdog3000