Cekura Metric Design

What problem does it solve?

This Skill guides users through the complex process of creating, testing, and iterating on metrics that accurately evaluate AI voice agent performance, ensuring robust and meaningful quality assessments.

Core Features & Use Cases

• Metric Creation Workflow: Follows a structured process from context gathering to iteration for designing effective metrics.
• LLM Judge & Custom Code: Supports both LLM-based evaluation and custom Python code for diverse metric needs.
• Prompt Engineering Guidance: Provides proven prompt structures and best practices for clear and consistent metric evaluation.
• Use Case: A product manager needs to define a new metric to track how well an AI agent handles customer complaints. This Skill will guide them through understanding the complaint scenario, writing an LLM prompt to evaluate agent responses, and deploying it.

Quick Start

Use the metric-design skill to create a new LLM judge metric for evaluating agent empathy.