AI agents for QA engineers (2026)
Testing agents, review bots and security scanners that help QA engineers find bugs before users do. We picked the top tools for 4 jobs QA engineers do every day: 24 tools in all, 22 of them free or with a free tier.
Jump to: Test your app · Review pull requests · Security testing · Evaluate AI features
Free tools from AgentScout for QA engineers: Prompt builder
How we picked: each section takes the tools matched to that task in our directory, putting tools whose category and stated use cases fit the task first, then ordering by tracked GitHub stars. No paid placements.
Test your app
Agents that write and run tests, click through your app and report what breaks. All 25 tools →
Goose Open source
Extensible open-source AI agent that installs, runs, edits and tests code on your machine with any LLM and MCP extensions. · ★ 55,347
Midscene.js Open source
Vision-driven UI automation and E2E testing framework where a GUI agent carries out natural-language steps on web, mobile and desktop apps. · ★ 15,311
MCP Inspector Open source
Official developer tool for testing and debugging MCP servers through a web UI, CLI or terminal UI. · ★ 11,095
MobileBuildMCP Open source
Sentry's MCP server and CLI that gives coding agents build, test and run tools for iOS and macOS projects. · ★ 6,497
Unity MCP Open source
MCP tools and CLI that let AI agents develop and test inside the Unity engine. · ★ 4,482
NitroStack Open source + cloud
TypeScript framework with decorators and dependency injection for building, testing and deploying MCP servers and MCP apps, with a companion desktop studio. · ★ 2,524
Review pull requests
Agents that read diffs, leave review comments and catch bugs before a pull request is merged. All 24 tools →
Open Code Review Open source
Alibaba's AI code review CLI that combines deterministic pipelines with an LLM agent to post line-level comments on Git diffs, using OpenAI or Anthropic models. · ★ 47,560
GitHub MCP Server Open source
GitHub's official MCP server for letting agents work with repositories, issues, pull requests and Actions. · ★ 33,663
Qodo Freemium
AI code review and testing agents that work in the IDE, the terminal and pull requests to catch issues before merge. · ★ 13,415
Open SWE Open source
LangChain's asynchronous coding agent that takes work from GitHub issues, Slack or Linear, implements it in an isolated sandbox and opens a pull request. · ★ 11,034
Emdash Open source
A free, open-source agentic development environment (YC W26) for running Claude Code, Codex and other coding agents in parallel, each in its own worktree, then reviewing diffs, PRs and CI in one place. · ★ 6,037
Shippie Open source
Extendable code review and QA agent that reads your diff, explores the codebase and posts focused review comments. · ★ 2,510
Security testing
Agents that probe your app, code and smart contracts the way an attacker would: running penetration tests, red-teaming AI systems and flagging vulnerabilities with suggested fixes. All 16 tools →
Strix Open source + cloud
Open-source AI agents that run penetration tests on your app to find and help fix security vulnerabilities. · ★ 69,022
PentAGI Open source
Autonomous multi-agent system for running penetration testing tasks. · ★ 30,728
AI-Infra-Guard Open source
Tencent's AI red-teaming platform that scans agents, skills and MCP servers for risks. · ★ 6,887
Superagent Open source + cloud
SDK for AI agent safety that blocks prompt injections and unsafe tool calls, redacts PII and secrets, and runs red-team scenarios. · ★ 6,770
CyberStrike Open source
Terminal agent for authorized penetration testing that runs recon, vulnerability discovery and reporting with specialized security agents on your own LLM. · ★ 3,192
PentestAgent Open source
Agent framework for black-box security testing and bug bounty work. · ★ 3,188
Evaluate AI features
Evaluation tools for scoring agent outputs, catching regressions and comparing prompts and models. All 115 tools →
MLflow Open source + cloud
Open-source platform for tracing, evaluating and managing agents, LLM apps and ML models. · ★ 28,418
Opik Open source + cloud
Comet's open-source platform for tracing, evaluating and monitoring LLM apps, RAG systems and agent workflows, self-hosted or in the cloud. · ★ 22,700
Arize Phoenix Source-available + cloud
Open-source tracing and evaluation for LLM apps. · ★ 11,828
SWE-bench Open source
Benchmark that tests whether language models and coding agents can resolve real GitHub issues, with multimodal and verified variants. · ★ 6,067
Kiln Source-available
Free desktop app and open-source library for building AI systems with evals, RAG, agents, fine-tuning and synthetic data in one workbench. · ★ 5,195
Agenta Open source + cloud
Open-source LLMOps platform for prompt management, evaluation and observability. · ★ 4,840
Other roles: Developers · AI engineers · Marketers · Sales teams · Customer support teams · Designers · Artists · Photographers · Filmmakers · Video editors · Musicians and producers · Researchers · Data analysts · Crypto traders · Founders and small businesses · DevOps and SRE engineers · Security engineers · Game developers · Content creators · Data engineers · Product managers · Students · Operations teams · Startup CTOs · Agencies · Open-source maintainers · MCP developers · Automation engineers · E-commerce teams · All roles
Best-of lists for QA engineers: Cursor alternatives · Strix alternatives · All best lists
Related categories: Coding · Security & governance · Evals & observability · MCP servers
Facts come from our directory listings; pricing is as each maker states it and can change. Missing a tool? Submit it free.