AgentEnv Framework
AgentEnv Framework is Scale AI's open-source Python SDK and CLI for building RL environments for agents: containerized worlds with realistic apps and data behind an MCP gateway, plus tasks (as DAGs) that grade any agent in any sandbox.
Updated
✨ Try AgentScout's free AI image generator →Good for: coding in the terminal, building AI agents, connecting tools with MCP, building MCP servers, evaluating agents, running code safely, training and fine-tuning agents
Official channels
Use cases
About AgentEnv Framework
AgentEnv Framework is listed in our evals & observability category and is aimed at builders. AgentEnv Framework is Scale AI's open-source Python SDK and CLI for building RL environments for agents: containerized worlds with realistic apps and data behind an MCP gateway, plus tasks (as DAGs) that grade any agent in any sandbox. Pricing, as the maker states it: Free and open source (Apache-2.0); pip install agentenv-framework. Maturity: Active. We last checked the official link on 2026-10-20.
AgentEnv Framework at a glance
- Category: Evals & observability
- Built for: Developers and teams building with AI agents
- Pricing: Free and open source (Apache-2.0); pip install agentenv-framework (as the maker states it)
- GitHub: scaleapi/agentenv-framework · 350 stars (as of Oct 21, 2026)
- Latest release: v0.9.1339, Oct 21, 2026
- Last commit: Oct 21, 2026
- Official site: agentenvframework.com
- Listed on AgentScout: Oct 20, 2026
AgentEnv Framework FAQ
What is AgentEnv Framework?
AgentEnv Framework is Scale AI's open-source Python SDK and CLI for building RL environments for agents: containerized worlds with realistic apps and data behind an MCP gateway, plus tasks (as DAGs) that grade any agent in any sandbox.
How much does AgentEnv Framework cost?
AgentEnv Framework's pricing, as the maker states it: Free and open source (Apache-2.0); pip install agentenv-framework. Check the official site for current plans.
Where can I find AgentEnv Framework's source code?
On GitHub at scaleapi/agentenv-framework, which had 350 stars as of Oct 21, 2026. The latest release is v0.9.1339 (Oct 21, 2026).
What are alternatives to AgentEnv Framework?
Similar tools include Kiln, MCPJam Inspector, BrowserGym, Firedrill, Judgeval and agent-qa (Vostride).
Facts from our link-checked listing, the GitHub repository and the official site. See something wrong? Suggest an edit.
AgentEnv Framework ratings and reviews
Be the first to rate AgentEnv Framework: tap 1 to 5 stars below. A written review is optional.
AgentEnv Framework alternatives
Other evals & observability tools in our directory. See all evals & observability tools →
Kiln
Free desktop app and open-source library for building AI systems with evals, RAG, agents, fine-tuning and synthetic data in one workbench.
MCPJam Inspector
Open-source testing and evals platform for MCP servers, MCP apps and ChatGPT apps across many clients and models.
BrowserGym
ServiceNow's Gym environment for building, testing and evaluating web agents across browser benchmarks.
Firedrill
A simulation platform for testing AI agents before launch: it runs your agent through realistic scenarios with simulated users and tools, scores results against checks or rubrics and shows where it fails. Includes a remote MCP server.
Judgeval
Open-source SDK for tracing agents and scoring them with agent judges, so failures in production can be found and fixes checked.
agent-qa (Vostride)
A self-improving AI QA agent with persistent memory that tests web, Android and iOS apps from plain-English test steps, for developers and coding agents.
Popular searches with this tool
🏆 See also: Best AI Agent Observability & Eval Tools · All best-of lists
🧭 Task guides: Training and fine-tuning tools for building AI agents · Agent frameworks and SDKs for terminal coding · Agent frameworks and SDKs for building MCP servers
💲 Estimate API cost: compare per-request and monthly costs for GPT, Claude, Gemini and Grok models.
Badge for makers
Built AgentEnv Framework? Add this badge to your README or site. It links back to this page. About badges
