Open-source voice AI agent frameworks (2026)
Open-source frameworks and tools for building voice agents that listen, think and talk in real time. Here are all 16 from the AgentScout directory.
Updated
How we picked and ranked: tools are matched by category, the pricing each maker states and what each tool says it does. They are ranked by GitHub stars as recorded on each listing (link checks 2026-10-21); tools without a tracked repo follow, by listing maturity. No paid placements.
1. XiaoZhi ESP32
Open-source voice chatbot firmware for ESP32 devices that talks through LLMs like Qwen and DeepSeek and controls hardware and services via MCP.
Pricing (as stated): Open source · Mature
2. FunASR
ModelScope's speech recognition toolkit for offline, streaming and edge ASR, with VAD, punctuation, speaker diarization and OpenAI-compatible/MCP serving.
Pricing (as stated): Open source · Mature
3. Pipecat
Open-source framework for voice and multimodal conversational agents.
Pricing (as stated): Open source · Mature
4. Vision Agents
Stream's open framework for building real-time voice and video agents with any model.
Pricing (as stated): Open source · Mature
5. Dograh
Self-hostable voice agent platform with a visual call-flow builder, bring-your-own speech and LLM providers and MCP control, pitched as an open alternative to Vapi and Retell.
Pricing (as stated): Open source + cloud · Mature
6. vocode
Open-source library for building voice-based LLM agents for phone calls and apps.
Pricing (as stated): Open source + cloud · No recent updates (last commit Nov 2024)
7. Qwen Audio Agent
Real-time voice runtime from the Qwen Audio team that keeps agents talking while they think and work on tasks.
Pricing (as stated): Open source · Active
8. Vexa
Open-source meeting transcription API with bots for Meet, Teams and Zoom.
Pricing (as stated): Open source + cloud · Active
9. ElevenLabs UI
Component library on shadcn/ui with orbs, waveforms and voice-agent components for building audio and agentic apps.
Pricing (as stated): Open source · Active
10. ElatoAI
Realtime voice AI for ESP32 devices and toys with 100+ speech and LLM model options.
Pricing (as stated): Open source · Active
11. VoiceMode
Adds natural voice conversations to Claude Code and other assistants.
Pricing (as stated): Open source · Active
12. Patter
Open-source SDK that gives your AI agent a phone number, handling speech, real-time voice and telephony carriers in Python or TypeScript.
Pricing (as stated): Open source · Active
13. TryVoice
Hands-free voice runtime for coding agents with wake word, push-to-talk and streaming replies.
Pricing (as stated): Open source · Early
14. Cicero
Self-hosted voice interface for coding agents (Claude Code, Codex, ACP); talk from a browser or Telegram call.
Pricing (as stated): Open source · Early
15. Voiceloop
Zero-dependency JS library for an interruptible in-browser voice loop (VAD, STT, LLM, TTS).
Pricing (as stated): Open source (MIT) · Early
16. LiveKit Agents
voiceOpen source + cloudReal-time voice and video infrastructure with an agents framework.
Pricing (as stated): Open source + paid cloud · Mature
FAQ
What are the best open-source voice AI agents?
Ranked by tracked GitHub stars, the top open-source voice AI agents in our directory are XiaoZhi ESP32, FunASR, Pipecat, Vision Agents, Dograh. Stars measure popularity, not fit, so compare a few against your own task.
How many open-source voice AI agents does AgentScout list?
16 tools match. This page shows the top 16. Pricing mix on this page: Open source (12), Open source + cloud (4).
How much do these tools cost?
Pricing is what each maker states on their site. Open-source tools are free to self-host but may need a paid model API key or offer paid cloud plans; freemium tools have a free plan with limits. Check each official site.
Where can I see every tool for building voice agents?
Our task page lists all 90 tools we match to building voice agents.
Related: All tools for building voice agents · Best AI Voice Agent Platforms · voice (16)
Similar searches: Free AI voice agents
By role: For game developers
All popular searches · AI agents by role · Free tools
Related categories: Voice
Facts come from our directory listings; pricing is as each maker states it and can change. Check official sites before you choose.