LocalAI
Self-hosted engine with an OpenAI-compatible API for running LLM, vision, voice and image models on your own hardware, including agents.
Updated
✨ Try AgentScout's free AI image generator →Good for: building voice agents, running agents locally
Use cases
About LocalAI
LocalAI is listed in our models & local runtimes category and is aimed at builders. Self-hosted engine with an OpenAI-compatible API for running LLM, vision, voice and image models on your own hardware, including agents. Pricing, as the maker states it: Open source. Maturity: Mature. We last checked the official link on 2026-10-16.
What is LocalAI?
LocalAI is an open-source AI engine for running LLM, vision, voice, image and video models on any hardware, no GPU required, with an OpenAI-compatible API.
It has a small core: each backend wraps an engine such as llama.cpp, vLLM, whisper.cpp, stable-diffusion or MLX in its own image, pulled only when a model needs it.
Sources: the official README and our directory listing, checked 2026-10-18. Official site: localai.io.
Who is LocalAI for?
Developers and self-hosters who want to run models, and agents on top of them, on their own hardware.
LocalAI at a glance
- Open source: Yes (MIT License)
- GitHub: mudler/LocalAI · 49,824 stars (as of Oct 21, 2026)
Key features
- OpenAI-compatible API
- LLM, vision, voice, image and video
- No GPU required
- Backends pulled on demand
LocalAI FAQ
What is LocalAI?
LocalAI is an open-source AI engine for running LLM, vision, voice, image and video models on any hardware, no GPU required, with an OpenAI-compatible API.
Who is LocalAI for?
Developers and self-hosters who want to run models, and agents on top of them, on their own hardware.
Is LocalAI free?
LocalAI's pricing, as the maker states it: Open source. Open-source tools are free to use, though you may still pay for model API usage or a hosted plan. Check the official site for current plans.
Is LocalAI open source?
Yes. LocalAI is released under the MIT License, according to its GitHub repository.
What are alternatives to LocalAI?
Similar tools include pooled, Meta Muse Wonder, LM Studio, MiroThinker, Lemonade and ASI:One.
LocalAI ratings and reviews
Be the first to rate LocalAI: tap 1 to 5 stars below. A written review is optional.
LocalAI alternatives
Other models & local runtimes tools in our directory. See all models & local runtimes tools →
pooled
Peer-to-peer LLM inference in the browser: pool your laptops, phones and other devices into a room to run large open models for chat and coding agents, with no GPU server.
Meta Muse Wonder
Meta's new models for personal and professional agent tasks, available via Meta Model API and Muse Code.
LM Studio
Desktop app for running local and open models, with Bionic, its agent for work and code that creates documents, slides, PDFs and software.
MiroThinker
Deep research agent and open models tuned for complex research and forecasting tasks.
Lemonade
Local server that runs optimized LLMs on your GPU or NPU for local AI apps and agents.
ASI:One
Agentic LLM and chat app from Fetch.ai built to reason, plan and call other agents on the ASI Alliance network.
Popular searches with this tool
💲 Estimate API cost: compare per-request and monthly costs for GPT, Claude, Gemini and Grok models.
Badge for makers
Built LocalAI? Add this badge to your README or site. It links back to this page. About badges
