Agent audit & observability
Tracing and logging platforms that record what agents did, step by step, for debugging and audit.
11 tools · listed alphabetically · no paid ranking
AgentOps
Lab: pendingTracing, debugging and replay for AI agents.
Arize Phoenix
Lab: pendingSelf-hostable tracing, evaluation and debugging for agents and LLM apps.
Datadog LLM Observability
Lab: pendingTracing, evaluation and experimentation for AI agents inside Datadog.
Galileo
Lab: pendingAI evaluation, observability and real-time guardrails for agents; now part of Splunk Observability.
Helicone
Lab: pendingOpen-source LLM gateway with routing, logging and monitoring.
Laminar
Lab: pendingOpen-source platform to trace, evaluate and debug AI agents.
Langfuse
Lab: pendingOpen platform to trace, evaluate and improve AI agents using production data.
LangSmith
Lab: pendingAgent and LLM observability with tracing and real-time monitoring.
OpenLLMetry
Lab: pendingOpenTelemetry-based open-source instrumentation for GenAI and LLM apps.
Opik
Lab: pendingOpen-source AI observability to test, trace and monitor LLM apps and agents.
W&B Weave
Lab: pendingTracing and evaluation toolkit for LLM and agent applications.