O
Ollama
Run open LLMs locally with one command.
Open Source Open Source 4.6macOSWindowsLinux
What is Ollama?
Ollama lets you download and run open-weight language models on your own machine.
It exposes a simple local API so apps can talk to models without the cloud.
Installation guide
Step 1 — Download the installer from ollama.com for your OS.
Step 2 — Run ollama run llama3 to pull and start a model.
Pros
- Free and open source
- Runs fully offline
- Simple CLI
Cons
- Needs a capable machine
- No managed hosting