
Local and private AI · 4 options
Running models on your own hardware
The program that loads a language model and answers questions with it, on your own machine.
The options
Worth comparing
Ollama
Ollama, Inc. and contributors
llama.cpp
ggml.ai and contributors
LM Studio
Element Labs
vLLM
The vLLM project (PyTorch Foundation)
Think this list is missing something? Suggest it for the Stacks
Side by side
The facts at a glance
Each project’s licence, where it runs, when it started and whether it publishes a security policy and its fixes.
| Option | Licence | Runs | First released | Security policy | Published fixes |
|---|---|---|---|---|---|
| Ollama | MIT | Your server | 2023 | Yes (official site, opens outside Firefly Collective) | – |
| llama.cpp | MIT | Your server | 2023 | Yes (official site, opens outside Firefly Collective) | Yes (official site, opens outside Firefly Collective) |
| LM Studio | Proprietary (free to use) | Your server | 2023 | – | – |
| vLLM | Apache-2.0 | Your server | 2023 | Yes (official site, opens outside Firefly Collective) | Yes (official site, opens outside Firefly Collective) |
Firefly Collective is independent and not affiliated with or endorsed by the projects listed. Names and logos are the property of their owners. Summaries are provided as-is; always check the project’s official advisory.
Think something belongs here?
Suggest it for the Stacks
Anyone can suggest software for the guide. Tell us what it is, which kind it belongs to and why it fits the charter; a person reads every suggestion.