Agent Security Indexbeta
Home / AI red teaming & evals

AI red teaming & evals

Tools and services that attack models and agents on purpose to find weaknesses before attackers do.

14 tools · listed alphabetically · no paid ranking

Adversa AI

Lab: pending

AI red teaming and protection, including monitoring of what coding agents do.

CommercialAI red teaming & evals

AgentDojo

Lab: pending

Research benchmark environment for evaluating prompt-injection attacks and defenses on LLM agents.

Open sourceAI red teaming & evals

DeepTeam

Lab: pending

Open-source framework to red team LLMs and AI agents.

Open sourceAI red teaming & evals

Enkrypt AI

Lab: pending

Red teaming, guardrails and monitoring platform for AI security and safety.

CommercialAI red teaming & evals

FuzzyAI

Lab: pending

Automated LLM fuzzing tool to find jailbreaks in LLM APIs.

Open sourceAI red teaming & evals

garak

Lab: pending

LLM vulnerability scanner that probes models for jailbreaks, injection, leakage and more.

Open sourceAI red teaming & evals

Giskard

Lab: pending

Continuous red teaming for AI agents, plus an open-source testing library.

Open source + commercialAI red teaming & evals

Gray Swan

Lab: pending

Security tools and red-teaming for LLMs from researchers behind major AI vulnerability work.

CommercialAI red teaming & evals

Inspect

Lab: pending

Open-source framework for LLM and agent evaluations from the UK AI Security Institute.

Open sourceAI red teaming & evals

Mindgard

Lab: pending

Discovers, assesses and red teams AI models, agents and applications.

CommercialAI red teaming & evals

Promptfoo

Lab: pending

Open-source CLI and platform for evals, red teaming and vulnerability scanning of LLM apps.

Open source + commercialAcquired / parentAI red teaming & evals

promptmap

Lab: pending

Prompt-injection scanner for custom LLM applications.

Open sourceAI red teaming & evals

PyRIT

Lab: pending

Microsoft's Python Risk Identification Tool for red teaming generative AI systems.

Open sourceAI red teaming & evals

SPLX

Lab: pending

AI security testing and red-teaming platform for AI assistants and agents.

CommercialAcquired / parentAI red teaming & evals