AgentScout / Tasks / Building AI agents / Voice and phone agents

Voice and phone agents for building AI agents

Platforms for agents that listen and talk: phone lines, real-time speech and voice assistants. Of the 247 tools on our building AI agents page, 19 fit this narrower job. By pricing: 13 open source, 2 source-available, 1 free or freemium, 2 paid, usage-based or enterprise, 1 pricing on the maker's site. The most-starred open repos here are LiteLLM (61,465 stars), Fish Audio (33,333 stars), FunASR (20,738 stars). Most come from the voice (10), agent infra (3), security & governance (2) categories.

Updated

LiteLLM logo

LiteLLM

Newagent infraOpen source + cloud

Open-source AI gateway and Python SDK that calls 100+ LLM providers in the OpenAI format, with cost tracking, guardrails, load balancing and logging.

Added

Fish Audio logo

Fish Audio

NewvoiceFreemium

Fish Audio is a voice AI platform for text to speech, voice cloning and speech to text, with a real-time API for voice agents. Its Drama 3 and S2 models take inline emotion and delivery tags such as whispering, laughing or pauses, it can clone a voice from a few seconds of audio, and its library has more than two million community voices for narration, characters, audiobooks and support agents. The Fish Speech models behind it are published on GitHub and Hugging Face.

Added

FunASR logo

FunASR

NewvoiceOpen source

ModelScope's speech recognition toolkit for offline, streaming and edge ASR, with VAD, punctuation, speaker diarization and OpenAI-compatible/MCP serving.

Added

Pipecat logo

Pipecat

voiceOpen source

Open-source framework for voice and multimodal conversational agents.

Added

TEN Framework logo

TEN Framework

voiceSource-available

Open-source framework for real-time multimodal voice agents, including the TEN Agent demo.

Added

Vision Agents logo

Vision Agents

voiceOpen source

Stream's open framework for building real-time voice and video agents with any model.

Added

Superagent logo

Superagent

Newsecurity & governanceOpen source + cloud

SDK for AI agent safety that blocks prompt injections and unsafe tool calls, redacts PII and secrets, and runs red-team scenarios.

Added

Raven logo

Raven

NewframeworksOpen source

Host agent that plans complex jobs as task graphs and coordinates built-in and third-party agents for research, coding, design and on-call work.

Added

vocode logo

vocode

voiceOpen source + cloud

Open-source library for building voice-based LLM agents for phone calls and apps.

Added

ElevenLabs UI logo

ElevenLabs UI

NewvoiceOpen source

Component library on shadcn/ui with orbs, waveforms and voice-agent components for building audio and agentic apps.

Added

Reticle logo

Reticle

NewcodingSource-available + cloud

Verification layer for AI coding agents: a dev-only SDK inside your web or desktop app lets the agent drive real flows and read network calls, app state and console, then returns a pass, fail or cannot-tell verdict with the file and line to fix; saved flows replay without an AI model and can gate CI.

Added

OpenInference logo

OpenInference

Newevals & observabilityOpen source

OpenTelemetry-based instrumentation that traces LLM and agent framework calls so any observability backend can show them.

Added

Patter logo

Patter

NewvoiceOpen source

Open-source SDK that gives your AI agent a phone number, handling speech, real-time voice and telephony carriers in Python or TypeScript.

Added

pooled logo

pooled

Newmodels & local runtimesOpen source

Peer-to-peer LLM inference in the browser: pool your laptops, phones and other devices into a room to run large open models for chat and coding agents, with no GPU server.

Added

OpenComputer logo

OpenComputer

Newagent infraUsage-based

OpenComputer is a platform for building and deploying long-running AI agents as code. You define an agent as a TypeScript function with its model, tools and MCP servers, deploy it with one command, and every session gets its own real cloud computer, with managed sessions, schedules and API keys kept outside the agent's runtime. Templates include a coding agent that edits a repo, runs checks and opens a draft pull request, and market-research and GTM agents; its own Slack coding agent runs on it. Pricing is pay-as-you-go for model calls and per-second machine time.

Added

Voiceloop logo

Voiceloop

voiceOpen source

Zero-dependency JS library for an interruptible in-browser voice loop (VAD, STT, LLM, TTS).

Added

LiveKit Agents logo

LiveKit Agents

voiceOpen source + cloud

Real-time voice and video infrastructure with an agents framework.

Added

TypeSafe Jev logo

TypeSafe Jev

Newagent infraUsage-based: pay per input token, output free; Jev 1.14 listed at $0.042 per million input tokens in TypeSafe docs; also on OpenRouter; enterprise plans via sales

Jev is TypeSafe's System One decision model, built for the small decisions inside software and agents. You send a state and typed questions (choice, score and more) and get typed answers with probabilities back instead of free-form text, so code can branch on them directly to route, classify, score or rank options. Agents can use it to settle narrow calls cheaply and save the larger LLM for open-ended work. Available through TypeSafe's API, Python and JavaScript SDKs, an agent skill, and OpenRouter.

Added

Wren Pre-sign Check logo

Wren Pre-sign Check

Newsecurity & governancePaid

Wren Pre-sign Check is a pay-per-call x402 API that an AI agent calls before it signs anything with its wallet. Send a transaction (to + data), an EIP-712 typed-data payload or untrusted text, and it returns block, review or allow, the decoded call in plain words and every finding: unlimited approvals, Permit and Permit2 signatures, setApprovalForAll, EIP-7702 delegation, contract deployment and injected instructions. With an optional wren-guard policy (allowlist, spenders, caps) it also blocks unknown recipients, over-cap amounts and lookalike addresses. It is a static check and stores nothing you send; free demos show real output.

Added

GitHub repos (16)

RepoGitHub starsLicenceLast push
LiteLLM ↗61,465MIT2026-10-21
Fish Audio ↗33,333——
FunASR ↗20,738MIT2026-10-21
Pipecat ↗16,446BSD 2-Clause2026-10-21
TEN Framework ↗11,172Apache License 2.0 with additional conditions2026-10-21
Vision Agents ↗8,171Apache License 2.02026-09-23
Superagent ↗6,770MIT2026-08-25
Raven ↗5,518—2026-10-21
vocode ↗3,804MIT2024-11-15
ElevenLabs UI ↗2,425—2026-10-16
Reticle ↗1,275Apache-2.0 for the SDK packages, FSL-1.1-ALv2 for the server (source-available)—
OpenInference ↗1,268—2026-10-20
Patter ↗1,076—2026-08-24
pooled ↗601—2026-10-16
OpenComputer ↗568——

Top 15 of 16 by stars. Stars and licence come from each repo, checked when the listing was last verified.

FAQ

What are the best AI tools for building AI agents focused on voice and phone agents?

We list 19. The first three by GitHub stars and featured status are LiteLLM: Open-source AI gateway and Python SDK that calls 100+ LLM providers in the OpenAI format, with cost tracking, guardrails, load balancing and logging.; Fish Audio: Fish Audio is a voice AI platform for text to speech, voice cloning and speech to text, with a real-time API for voice agents. Its Drama 3 and S2 models take inline emotion and delivery tags such as whispering, laughing or pauses, it can clone a voice from a few seconds of audio, and its library has more than two million community voices for narration, characters, audiobooks and support agents. The Fish Speech models behind it are published on GitHub and Hugging Face.; FunASR: ModelScope's speech recognition toolkit for offline, streaming and edge ASR, with VAD, punctuation, speaker diarization and OpenAI-compatible/MCP serving.

Are there free or open-source options?

Yes: 13 open source, 2 source-available, 1 free or freemium, 2 paid, usage-based or enterprise, 1 pricing on the maker's site. Pricing is as each maker states it.

More from building AI agents

Tools are grouped by what each says it does. Missing one? Submit it free.

Get the best new AI agents, weekly

One short email with new tools, launches and what's worth trying. Free, unsubscribe anytime.