Galileo Agent Leaderboard
Galileo's leaderboard that ranks how well LLMs perform as agents on tool use and multi-step tasks.
Updated
✨ Try AgentScout's free AI image generator →Good for: sales outreach, evaluating agents
Use cases
About Galileo Agent Leaderboard
Galileo Agent Leaderboard is listed in our evals & observability category and is aimed at builders. Galileo's leaderboard that ranks how well LLMs perform as agents on tool use and multi-step tasks. Pricing, as the maker states it: Open source. Maturity: Active. We last checked the official link on 2026-10-16.
What is Galileo Agent Leaderboard?
Galileo Agent Leaderboard is an evaluation framework for AI agents across real-world business scenarios.
v1 ranks tool-calling performance; v2 adds synthetic dataset generation and a simulation engine for task completion.
Sources: the official README and our directory listing, checked 2026-10-18. Official site: huggingface.co/spaces/galileo-ai/agent-leaderboard.
Who is Galileo Agent Leaderboard for?
Teams choosing LLMs for agent use.
Galileo Agent Leaderboard at a glance
- Open source: Yes (MIT License)
- GitHub: rungalileo/agent-leaderboard · 226 stars (as of Oct 21, 2026)
Key features
- Tool-calling rankings
- Task-completion simulation
- Business scenarios
Galileo Agent Leaderboard FAQ
What is Galileo Agent Leaderboard?
Galileo Agent Leaderboard is an evaluation framework for AI agents across real-world business scenarios.
Who is Galileo Agent Leaderboard for?
Teams choosing LLMs for agent use.
Is Galileo Agent Leaderboard free?
Galileo Agent Leaderboard's pricing, as the maker states it: Open source. Open-source tools are free to use, though you may still pay for model API usage or a hosted plan. Check the official site for current plans.
Is Galileo Agent Leaderboard open source?
Yes. Galileo Agent Leaderboard is released under the MIT License, according to its GitHub repository.
What are alternatives to Galileo Agent Leaderboard?
Similar tools include Agent Memory Leaderboard, CoreWeave Forge, Future AGI, OSWorld, Tracely and agent-qa (Vostride).
Galileo Agent Leaderboard ratings and reviews
Be the first to rate Galileo Agent Leaderboard: tap 1 to 5 stars below. A written review is optional.
Galileo Agent Leaderboard alternatives
Other evals & observability tools in our directory. See all evals & observability tools →
Agent Memory Leaderboard
Public leaderboard and open evaluation protocol, run by a group of universities and labs, for comparing long-term memory systems for agents in recurring submission rounds.
CoreWeave Forge
One product to run, observe, evaluate and post-train agents (W&B, OpenPipe, sandboxes).
Future AGI
Open-source platform for evaluating, tracing, simulating and guarding LLM and AI agent applications, self-hostable or cloud.
OSWorld
Benchmark for multimodal computer-use agents on open-ended tasks in real desktop environments.
Tracely
Tracely is open-source, trace-native CI/CD for AI agents: it grades every production trace with evaluators, clusters failures into issues, freezes bad runs into replayable test cases and blocks pull requests that would reintroduce them.
agent-qa (Vostride)
A self-improving AI QA agent with persistent memory that tests web, Android and iOS apps from plain-English test steps, for developers and coding agents.
Popular searches with this tool
🏆 See also: Best AI Agent Observability & Eval Tools · All best-of lists
💲 Estimate API cost: compare per-request and monthly costs for GPT, Claude, Gemini and Grok models.
Badge for makers
Built Galileo Agent Leaderboard? Add this badge to your README or site. It links back to this page. About badges
