Voice and phone agents for building AI agents
Platforms for agents that listen and talk: phone lines, real-time speech and voice assistants. Of the 247 tools on our building AI agents page, 19 fit this narrower job. By pricing: 13 open source, 2 source-available, 1 free or freemium, 2 paid, usage-based or enterprise, 1 pricing on the maker's site. The most-starred open repos here are LiteLLM (61,465 stars), Fish Audio (33,333 stars), FunASR (20,738 stars). Most come from the voice (10), agent infra (3), security & governance (2) categories.
Updated
LiteLLM
Open-source AI gateway and Python SDK that calls 100+ LLM providers in the OpenAI format, with cost tracking, guardrails, load balancing and logging.
Added
Fish Audio
Fish Audio is a voice AI platform for text to speech, voice cloning and speech to text, with a real-time API for voice agents. Its Drama 3 and S2 models take inline emotion and delivery tags such as whispering, laughing or pauses, it can clone a voice from a few seconds of audio, and its library has more than two million community voices for narration, characters, audiobooks and support agents. The Fish Speech models behind it are published on GitHub and Hugging Face.
Added
FunASR
ModelScope's speech recognition toolkit for offline, streaming and edge ASR, with VAD, punctuation, speaker diarization and OpenAI-compatible/MCP serving.
Added
Pipecat
Open-source framework for voice and multimodal conversational agents.
Added
TEN Framework
Open-source framework for real-time multimodal voice agents, including the TEN Agent demo.
Added
Vision Agents
Stream's open framework for building real-time voice and video agents with any model.
Added
Superagent
SDK for AI agent safety that blocks prompt injections and unsafe tool calls, redacts PII and secrets, and runs red-team scenarios.
Added
Raven
Host agent that plans complex jobs as task graphs and coordinates built-in and third-party agents for research, coding, design and on-call work.
Added
vocode
Open-source library for building voice-based LLM agents for phone calls and apps.
Added
ElevenLabs UI
Component library on shadcn/ui with orbs, waveforms and voice-agent components for building audio and agentic apps.
Added
Reticle
Verification layer for AI coding agents: a dev-only SDK inside your web or desktop app lets the agent drive real flows and read network calls, app state and console, then returns a pass, fail or cannot-tell verdict with the file and line to fix; saved flows replay without an AI model and can gate CI.
Added
OpenInference
OpenTelemetry-based instrumentation that traces LLM and agent framework calls so any observability backend can show them.
Added
Patter
Open-source SDK that gives your AI agent a phone number, handling speech, real-time voice and telephony carriers in Python or TypeScript.
Added
pooled
Peer-to-peer LLM inference in the browser: pool your laptops, phones and other devices into a room to run large open models for chat and coding agents, with no GPU server.
Added
OpenComputer
OpenComputer is a platform for building and deploying long-running AI agents as code. You define an agent as a TypeScript function with its model, tools and MCP servers, deploy it with one command, and every session gets its own real cloud computer, with managed sessions, schedules and API keys kept outside the agent's runtime. Templates include a coding agent that edits a repo, runs checks and opens a draft pull request, and market-research and GTM agents; its own Slack coding agent runs on it. Pricing is pay-as-you-go for model calls and per-second machine time.
Added
Voiceloop
Zero-dependency JS library for an interruptible in-browser voice loop (VAD, STT, LLM, TTS).
Added
LiveKit Agents
Real-time voice and video infrastructure with an agents framework.
Added
TypeSafe Jev
Jev is TypeSafe's System One decision model, built for the small decisions inside software and agents. You send a state and typed questions (choice, score and more) and get typed answers with probabilities back instead of free-form text, so code can branch on them directly to route, classify, score or rank options. Agents can use it to settle narrow calls cheaply and save the larger LLM for open-ended work. Available through TypeSafe's API, Python and JavaScript SDKs, an agent skill, and OpenRouter.
Added
Wren Pre-sign Check
Wren Pre-sign Check is a pay-per-call x402 API that an AI agent calls before it signs anything with its wallet. Send a transaction (to + data), an EIP-712 typed-data payload or untrusted text, and it returns block, review or allow, the decoded call in plain words and every finding: unlimited approvals, Permit and Permit2 signatures, setApprovalForAll, EIP-7702 delegation, contract deployment and injected instructions. With an optional wren-guard policy (allowlist, spenders, caps) it also blocks unknown recipients, over-cap amounts and lookalike addresses. It is a static check and stores nothing you send; free demos show real output.
Added
GitHub repos (16)
| Repo | GitHub stars | Licence | Last push |
|---|---|---|---|
| 61,465 | MIT | 2026-10-21 | |
| 33,333 | — | — | |
| 20,738 | MIT | 2026-10-21 | |
| 16,446 | BSD 2-Clause | 2026-10-21 | |
| 11,172 | Apache License 2.0 with additional conditions | 2026-10-21 | |
| 8,171 | Apache License 2.0 | 2026-09-23 | |
| 6,770 | MIT | 2026-08-25 | |
| 5,518 | — | 2026-10-21 | |
| 3,804 | MIT | 2024-11-15 | |
| 2,425 | — | 2026-10-16 | |
| 1,275 | Apache-2.0 for the SDK packages, FSL-1.1-ALv2 for the server (source-available) | — | |
| 1,268 | — | 2026-10-20 | |
| 1,076 | — | 2026-08-24 | |
| 601 | — | 2026-10-16 | |
| 568 | — | — |
Top 15 of 16 by stars. Stars and licence come from each repo, checked when the listing was last verified.
FAQ
What are the best AI tools for building AI agents focused on voice and phone agents?
We list 19. The first three by GitHub stars and featured status are LiteLLM: Open-source AI gateway and Python SDK that calls 100+ LLM providers in the OpenAI format, with cost tracking, guardrails, load balancing and logging.; Fish Audio: Fish Audio is a voice AI platform for text to speech, voice cloning and speech to text, with a real-time API for voice agents. Its Drama 3 and S2 models take inline emotion and delivery tags such as whispering, laughing or pauses, it can clone a voice from a few seconds of audio, and its library has more than two million community voices for narration, characters, audiobooks and support agents. The Fish Speech models behind it are published on GitHub and Hugging Face.; FunASR: ModelScope's speech recognition toolkit for offline, streaming and edge ASR, with VAD, punctuation, speaker diarization and OpenAI-compatible/MCP serving.
Are there free or open-source options?
Yes: 13 open source, 2 source-available, 1 free or freemium, 2 paid, usage-based or enterprise, 1 pricing on the maker's site. Pricing is as each maker states it.
More from building AI agents
Tools are grouped by what each says it does. Missing one? Submit it free.