Ollama
Run LLMs on your own machine.
Local InferenceFree· OSSNo ratings
Be the first to rate this site
About llama.cpp
llama.cpp is the engine under most local-AI tools — it runs quantized models efficiently on CPU and GPU across every platform, from laptops to Raspberry Pis.
Key features
- Runs quantized GGUF models
- CPU and GPU backends
- Powers Ollama, Jan, and more
Pros
- Runs on almost any hardware
- The performance reference
Cons
- Command-line and low-level
- You manage models yourself
Reviews
No reviews yet — share the first one.
More in Local Inference