AI Tools · +10 points

llama.cpp

Efficient LLM inference in C/C++ — run quantized models on CPU/GPU.

GitHub: ggerganov/llama.cpp
Install: git clone https://github.com/ggerganov/llama.cpp
License: MIT
Stars: ★ 75k+

Integration goal

Document llama.cpp build and inference command in README.

Write build instructions
Add example inference command
Push README.md

Open Integration Workspace →

← All open source tools