5 free AI agent observability tools. Half of the paid plans start at $160 a month or less. 2 are open source. Newest check: 22 Nov 2026.
339 of 786 tools were checked against the vendor's own page in the last 30 days.
| Tool | Price from | Free plan | Runs on | Checked |
|---|---|---|---|---|
| Datadog LLM ObservabilityTraces, evaluates and monitors LLM apps and AI agents inside Datadog, billing only on LLM spans, with up to 40K of them free each month. | $160/mo | Yes | Web | 22 Nov |
| CodagCuts AI coding-agent costs by trimming oversized tool results, from test runs to grep output, down to the lines that matter, with the rest kept on your machine. | $499/mo | Yes | Mac · Windows | 9 Nov |
| Confident AILLM evaluation and tracing platform from the DeepEval team, with a free plan, CI regression tests and SOC 2 Type II. | $200/mo | Yes | Web | 15 Oct |
| SuperPenguinAI spend platform with 2 native SDKs (Python, TypeScript) that attributes provider costs to a customer, feature, or pull request instead of one monthly total. | $30/mo | Yes | Web · Mac | 19 Aug |
| OpenlayerAI governance platform with an AI system inventory, 175+ evaluation tests and runtime guardrails that produce audit-ready evidence for regulators. | -- | Yes | Web | 25 Oct |
A person checks every record against the vendor's own page. Rankings cannot be bought. How Hokai checks records. Not sure what you need? Describe the job to Smart Match and get three picks with reasons.