agent-observability

What problem does it solve?

This Skill addresses the challenge of understanding and debugging AI agent performance by providing tools for comprehensive monitoring.

Core Features & Use Cases

• Performance Tracking: Monitor request latency, token usage, and tool call success rates.
• Cost Management: Track costs per task and per customer.
• Reliability & Debugging: Identify issues like hallucinations and retry frequency for improved agent stability.
• Use Case: A product team wants to ensure their AI assistant is responsive and cost-effective. They use this Skill to set up alerts for high latency or unexpected token spikes, ensuring a smooth user experience and controlled operational expenses.

Quick Start

Instrument the current AI agent with trace IDs and capture LLM calls as child spans.