eval-check

What problem does it solve?

This Skill ensures the AI agent's quality and correctness by automatically running evaluations after code changes, preventing regressions and maintaining performance.

Core Features & Use Cases

• Automated Code Change Detection: Identifies modified agent files across core, tools, and services.
• Tiered Evaluation Execution: Runs fast, deterministic tests first, then prompts for confirmation before executing expensive LLM-based evaluations.
• Selective Evals: Allows running only relevant LLM evaluations based on the type of code changes detected.
• Use Case: After a developer modifies the agent's prompt templates, this skill runs evaluations to confirm that the agent's responses remain grounded, correct, and properly cited.

Quick Start

Run agent quality evaluations after core agent code changes.