Skip to content
Firefly Collective

ggml.ai and contributors

llama.cpp

Runs large language models in plain C and C++ on CPUs and consumer GPUs.

Licence
MIT
First released
2023 (3 years)
Runs
On your own machine or server
Latest release
4 Nov 2026

The review

Measured against the charter

Facts as the project publishes them, with links to check each one.

Own it

Secure it

Make it last

Facts as published by the project, checked 12 Nov 2026. A dash means not found or not applicable, not a judgement.

Also in this kind

The other options

  • Ollama

    Ollama, Inc. and contributors

    MITSince 2023

  • llama.cpp

    ggml.ai and contributors

    MITSince 2023

  • LM Studio

    Element Labs

    Proprietary (free to use)Since 2023

  • vLLM

    The vLLM project (PyTorch Foundation)

    Apache-2.0Since 2023

Think this list is missing something? Suggest it for the Stacks