Skip to content
Firefly Collective

Local and private AI · 4 options

Running models on your own hardware

The program that loads a language model and answers questions with it, on your own machine.

The options

Worth comparing

  • Ollama

    Ollama, Inc. and contributors

    MITSince 2023

  • llama.cpp

    ggml.ai and contributors

    MITSince 2023

  • LM Studio

    Element Labs

    Proprietary (free to use)Since 2023

  • vLLM

    The vLLM project (PyTorch Foundation)

    Apache-2.0Since 2023

Think this list is missing something? Suggest it for the Stacks

Side by side

The facts at a glance

Each project’s licence, where it runs, when it started and whether it publishes a security policy and its fixes.

Firefly Collective is independent and not affiliated with or endorsed by the projects listed. Names and logos are the property of their owners. Summaries are provided as-is; always check the project’s official advisory.

Think something belongs here?

Suggest it for the Stacks

Anyone can suggest software for the guide. Tell us what it is, which kind it belongs to and why it fits the charter; a person reads every suggestion.