Skills
.Work. You
Rest

trace-annotation-tool

Official

Build custom LLM trace annotation tools.

Software Engineering#llm#error analysis#annotation#trace analysis#open coding#web app generation
Authormaragudk
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill automates the creation of a local web application for qualitative analysis of LLM traces, enabling users to perform open coding and identify failure modes efficiently.

Core Features & Use Cases

  • Custom Web App Generation: Creates a self-contained Python web app using FastHTML, TailwindCSS, and HTMX.
  • Trace Annotation: Allows users to review LLM traces, add freeform notes, and mark traces as pass/fail/defer.
  • Use Case: When you need to manually inspect and label the outputs of an LLM pipeline to understand its errors before building a structured failure taxonomy.

Quick Start

Use the trace-annotation-tool skill to generate a local web application for annotating LLM traces.

Dependency Matrix

Required Modules

None required

Components

references

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: trace-annotation-tool
Download link: https://github.com/maragudk/evals-skills/archive/main.zip#trace-annotation-tool

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.