Skip to content

Issues: abetlen/llama-cpp-python

Roadmap for v0.2
#487 opened Jul 18, 2023 by abetlen
Open
Add batched inference
#771 opened Sep 30, 2023 by abetlen
Open 37
Improve installation process
#1178 opened Feb 12, 2024 by abetlen
Open 8
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

524 Open 700 Closed
524 Open 700 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Support for Python 3.13 in llama-cpp-python?
#1970 opened Mar 12, 2025 by JeevanEagala
Project still supported?
#1969 opened Mar 11, 2025 by davidmezzetti
1
Metal installation documentation
#1968 opened Mar 9, 2025 by devtobi
GPU Support Missing in Version >=0.3.5 on Windows with CUDA 12.4 and RTX 3090
#1967 opened Mar 9, 2025 by mcglynnfinn
1
Issue with Installing llama-cpp-python 0.3.7: Dependency Problems with scikit-build-core
#1965 opened Mar 7, 2025 by lcnmzz00
After choosing to offload all layers onto the GPU, the Ram used for model loading is not released
#1964 opened Mar 7, 2025 by MATII13T
Steps to Build and Install llama-cpp-python 0.3.7 w/CUDA on Windows 11 [06/03/2025]
#1963 opened Mar 6, 2025 by VigneshRajan-AMRC
1
Models loading on CPU instead of GPU after updating version
#1962 opened Mar 5, 2025 by KuraiAI
1
Prebuild WHL, Cuda 12.1 win10 python 3.10
#1960 opened Mar 4, 2025 by guney45
Could not install llama-cpp-python 0.3.7 on Macbook Air M1 - Compilation issue
#1956 opened Mar 2, 2025 by vietanhdev
4 tasks done
Support for phi 4 mini
#1955 opened Mar 1, 2025 by gformcreation
2
Workflow Example for CUDA 12.6 Windows
#1954 opened Mar 1, 2025 by lyxkilo
更新llama cpp，目前不支持deepseek r1以及蒸馏模型
#1952 opened Mar 1, 2025 by hendrymax
Publish the latest llama.cpp?
#1951 opened Feb 27, 2025 by curvedinf
1
DeepSeek-R1-Distill-Qwen-1.5B inference answer is wrong
#1949 opened Feb 27, 2025 by jhxiang
successfully installed !! CUDA/v12.6 !! Visual Studio 2022!!
#1948 opened Feb 26, 2025 by dw5189
3
ERROR: Failed building wheel for llama-cpp-python Failed to build llama-cpp-python ERROR: Could not build wheels for llama-cpp-python which use PEP 517 and cannot be installed directly
#1947 opened Feb 26, 2025 by ArmsNorton
3
The results generated are different from those produced by executing commands with the llama cpp library
#1946 opened Feb 25, 2025 by HengruiZYP
4 tasks done
OK!!! ggml_cuda_init: found 1 CUDA devices:
#1945 opened Feb 24, 2025 by dw5189
1
CUDA Memory Allocation Failure and mlock Memory Lock Issue in llama-cpp-python
#1944 opened Feb 24, 2025 by caiyuanhangDicp
CMake build failed //Building wheel for llama-cpp-python (pyproject.toml) ... error
#1943 opened Feb 23, 2025 by dw5189
2
Current vendored llama.cpp won't build with MSVC 17.13
#1942 opened Feb 22, 2025 by Janzert
3
-- CUDA Toolkit found
#1941 opened Feb 21, 2025 by dw5189
No GPU usage, occupied VRAM but only CPU is working
#1939 opened Feb 18, 2025 by 0xb1te
8
Specifying additional_files for model files in directory adds additional copy of directory to download URL
#1938 opened Feb 17, 2025 by zhudotexe
4 tasks done
ProTip! Mix and match filters to narrow down what you’re looking for.