error-analysis
CommunityDiagnose and categorize LLM failures.
Authorhamelsmu
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill helps users systematically identify and categorize failure modes in an LLM pipeline by guiding them through reading traces and building a catalog of how the system fails.
Core Features & Use Cases
- Trace Analysis: Guides users through reviewing LLM traces (inputs, intermediate calls, tool uses, outputs).
- Failure Categorization: Assists in grouping similar failures into distinct, actionable categories.
- Prioritization: Helps compute failure rates to identify areas needing the most attention.
- Use Case: After a significant LLM pipeline change, use this skill to understand new failure modes and prioritize fixes by analyzing ~100 traces.
Quick Start
Use the error-analysis skill to help me categorize failures by reading through the provided traces.
Dependency Matrix
Required Modules
None requiredComponents
references
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: error-analysis Download link: https://github.com/hamelsmu/evals-skills/archive/main.zip#error-analysis Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.