Agent Security Indexbeta
Home / Agent audit & observability

Agent audit & observability

Tracing and logging platforms that record what agents did, step by step, for debugging and audit.

11 tools · listed alphabetically · no paid ranking

AgentOps

Lab: pending

Tracing, debugging and replay for AI agents.

Open source + commercialAgent audit & observability

Arize Phoenix

Lab: pending

Self-hostable tracing, evaluation and debugging for agents and LLM apps.

Open source + commercialAgent audit & observability

Datadog LLM Observability

Lab: pending

Tracing, evaluation and experimentation for AI agents inside Datadog.

CommercialAgent audit & observability

Galileo

Lab: pending

AI evaluation, observability and real-time guardrails for agents; now part of Splunk Observability.

CommercialAcquired / parentAgent audit & observability

Helicone

Lab: pending

Open-source LLM gateway with routing, logging and monitoring.

Open source + commercialAcquired / parentAgent audit & observability

Laminar

Lab: pending

Open-source platform to trace, evaluate and debug AI agents.

Open source + commercialAgent audit & observability

Langfuse

Lab: pending

Open platform to trace, evaluate and improve AI agents using production data.

Open source + commercialAcquired / parentAgent audit & observability

LangSmith

Lab: pending

Agent and LLM observability with tracing and real-time monitoring.

CommercialAgent audit & observability

OpenLLMetry

Lab: pending

OpenTelemetry-based open-source instrumentation for GenAI and LLM apps.

Open sourceAgent audit & observability

Opik

Lab: pending

Open-source AI observability to test, trace and monitor LLM apps and agents.

Open source + commercialAgent audit & observability

W&B Weave

Lab: pending

Tracing and evaluation toolkit for LLM and agent applications.

Open source + commercialAcquired / parentAgent audit & observability