Skip to content

Issues: abetlen/llama-cpp-python

Roadmap for v0.2
#487 opened Jul 18, 2023 by abetlen
Open
Add batched inference
#771 opened Sep 30, 2023 by abetlen
Open 34
Improve installation process
#1178 opened Feb 12, 2024 by abetlen
Open 7
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

421 Open 659 Closed
421 Open 659 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

CMake Error: CMAKE_CXX_COMPILER not set, after EnableLanguage
#1749 opened Sep 19, 2024 by 1431551850
serve cannot use minicpmv-2.6
#1748 opened Sep 19, 2024 by PredyDaddy
error when I using the Function Call
#1747 opened Sep 18, 2024 by PredyDaddy
How get output from fine tuned llama3 model(trained with alpaca format dataset) in a json format ?
#1744 opened Sep 18, 2024 by ApurvPujari
fatal error: intrin.h: No such file or directory
#1740 opened Sep 12, 2024 by triamozavr
LLamaDiskCache: needs a RO / 'static' disk cache for RAG use cases
#1737 opened Sep 11, 2024 by tc-wolf
phi3 chat format
#1736 opened Sep 11, 2024 by SimJeg
[Draft Issue] system crash on exit (after inference is done)
#1735 opened Sep 11, 2024 by Mrw33554432
2 of 4 tasks
How to display a chat prompt after create_chat_completion
#1733 opened Sep 10, 2024 by dtischencko
Scores are stored in a 32-bit NumPy array even when K and V are quantized
#1732 opened Sep 5, 2024 by EthanZoneCoding
4 tasks
show how to run inference using minicpm v2.6
#1731 opened Sep 4, 2024 by thistleknot
1
flux1-dev-Q8_0.gguf
#1727 opened Sep 3, 2024 by ayttop
1
How do I customize the Chat format?
#1724 opened Sep 2, 2024 by lingyezhixing
Why don't use gpu
#1723 opened Sep 2, 2024 by suwenzhuo
GGML_CUDA_ENABLE_UNIFIED_MEMORY=1　 behavior is strange.
#1720 opened Aug 31, 2024 by Enchante503
4 tasks
No matter how many times I build it, it won't start bug Something isn't working build
#1719 opened Aug 31, 2024 by Enchante503
3 of 4 tasks
1
How to use this model?
#1717 opened Aug 30, 2024 by dzy1128
2
Allow python packages to contribute to LlamaChatCompletionHandlerRegistry
#1715 opened Aug 29, 2024 by axel7083
1
1
flash attention on Nvidia Tesla P100s results in the CUDA error: unspecified launch failure - (CUDA kernel flash_attn_tile_ext_f16 has no device code compatible with CUDA arch 520) bug Something isn't working build
#1710 opened Aug 26, 2024 by AlHering
4 tasks done
2
igpu question Further information is requested
#1709 opened Aug 26, 2024 by ayttop
1
Llama CPP not working on Kaggle How to fix
#1706 opened Aug 25, 2024 by ha1772007
Use Custom GPU
#1705 opened Aug 25, 2024 by ha1772007
Installation stuck on windows
#1703 opened Aug 24, 2024 by thewh1teagle
4 tasks done
10
Feature request : NPU Support
#1702 opened Aug 24, 2024 by gformcreation
Empty output when running Q4_K_M quantization of Llama-3-8B-Instruct with llama-cpp-python
#1696 opened Aug 22, 2024 by smolraccoon
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.