codebook-yaml

What problem does it solve?

This Skill codifies a single, enforceable format for YAML codebooks used to drive LLM-based annotation and evaluation, removing ambiguity and ensuring reproducible behavioral testing across C1-C4 codebooks.

Core Features & Use Cases

• Formalized Structure: Enforces required top-level fields, class definitions, and example formats for prompts/c1_.yml through prompts/c4_.yml.
• Validation & Testing Guidance: Specifies S0-S3 stage-gate workflow, S1 behavioral tests, and S3 ablation procedures to verify model behavior.
• Country-Agnostic & Ablation-Ready Rules: Mandates neutral terminology in definitions and independent clarification items for robust ablation studies.
• Use Case: Create or revise a C2 motivation codebook and verify it passes definition recovery, example recovery, and order-invariance tests before evaluation.

Quick Start

Create a new YAML codebook in prompts/ following the SKILL conventions and run the S1 behavioral tests for immediate validation.