skill-creator

Create, evaluate, and iteratively improve Claude skills with benchmarked test runs.

Updated May 8, 2026
One-click install
npx skills add https://github.com/tomw200082-collab/gt-factory-os-production-brain --skill skill-creator-tomw200082-collab
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/tomw200082-collab/gt-factory-os-production-brain/tree/main/.claude/skills/skill-creator
Command: npx skills add https://github.com/tomw200082-collab/gt-factory-os-production-brain --skill skill-creator-tomw200082-collab

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Writing a skill that triggers reliably and produces good outputs is hard to do by intuition alone. This Skill guides the full lifecycle of skill development: drafting SKILL.md files, running test prompts with and without the skill, grading outputs against assertions, aggregating benchmark statistics, and optimizing the description field for accurate triggering. ## Core Features & Use Cases - Guided Skill Authoring: Interviews the user about intent, trigger contexts, and output formats, then drafts a SKILL.md following progressive disclosure and writing-style best practices. - Evaluation & Benchmarking: Spawns parallel with-skill and baseline runs, grades outputs against assertions, and aggregates pass rates, timing, and token usage into benchmark.json with mean, stddev, and deltas. - Description Optimization: Generates realistic trigger/no-trigger eval queries, runs an automated optimization loop with train/test splits, and applies the best-performing description. - Use Case: You want a skill that formats weekly sales reports. This Skill helps you draft it, creates test prompts, runs them with and without the skill, shows results in a browser-based review viewer, and iterates until the outputs pass your review. ## Quick Start Help me create a new skill that converts meeting transcripts into structured action-item lists, then test and improve it.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new Claude skill from scratch?▼

Start by defining what the skill should do, when it should trigger, and its output format. Then write a SKILL.md with name and description frontmatter, draft 2-3 realistic test prompts, run them with and without the skill, and iterate based on feedback.

How do I test whether a skill actually improves outputs?▼

Run each test prompt twice in parallel: once with the skill and once without as a baseline. Grade both against objective assertions, then aggregate pass rates, timing, and token usage into a benchmark comparing the two configurations.

How do I improve a skill description for better triggering?▼

Generate 20 realistic eval queries mixing should-trigger and should-not-trigger cases, then run the optimization loop. It evaluates descriptions on a train split, proposes improvements, and selects the best by held-out test score to avoid overfitting.

What makes a good skill description for triggering?▼

Include both what the skill does and specific contexts for when to use it, since all triggering information lives in the description. Slightly pushy phrasing helps because Claude tends to undertrigger skills when descriptions are too narrow.

When should a skill include test cases and assertions?▼

Skills with objectively verifiable outputs like file transforms, data extraction, or code generation benefit from assertions. Skills with subjective outputs like writing style or design are better evaluated through qualitative human review instead.

Does skill evaluation work on Claude.ai without subagents?▼

Yes, but with adaptations: run test prompts sequentially yourself instead of spawning subagents, skip baseline runs and quantitative benchmarking, and present results inline for feedback rather than using the browser-based review viewer.