AI red teaming & evals
Tools and services that attack models and agents on purpose to find weaknesses before attackers do.
14 tools · listed alphabetically · no paid ranking
Adversa AI
Lab: pendingAI red teaming and protection, including monitoring of what coding agents do.
AgentDojo
Lab: pendingResearch benchmark environment for evaluating prompt-injection attacks and defenses on LLM agents.
DeepTeam
Lab: pendingOpen-source framework to red team LLMs and AI agents.
Enkrypt AI
Lab: pendingRed teaming, guardrails and monitoring platform for AI security and safety.
FuzzyAI
Lab: pendingAutomated LLM fuzzing tool to find jailbreaks in LLM APIs.
garak
Lab: pendingLLM vulnerability scanner that probes models for jailbreaks, injection, leakage and more.
Giskard
Lab: pendingContinuous red teaming for AI agents, plus an open-source testing library.
Gray Swan
Lab: pendingSecurity tools and red-teaming for LLMs from researchers behind major AI vulnerability work.
Inspect
Lab: pendingOpen-source framework for LLM and agent evaluations from the UK AI Security Institute.
Mindgard
Lab: pendingDiscovers, assesses and red teams AI models, agents and applications.
Promptfoo
Lab: pendingOpen-source CLI and platform for evals, red teaming and vulnerability scanning of LLM apps.
promptmap
Lab: pendingPrompt-injection scanner for custom LLM applications.
PyRIT
Lab: pendingMicrosoft's Python Risk Identification Tool for red teaming generative AI systems.
SPLX
Lab: pendingAI security testing and red-teaming platform for AI assistants and agents.