skill-creator

Create, evaluate, and iteratively improve AI skills with benchmark-driven testing workflows.

Updated May 22, 2026
One-click install
npx skills add https://github.com/kitfunso/claude-config --skill skill-creator-kitfunso
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/kitfunso/claude-config/tree/main/skills/skill-creator
Command: npx skills add https://github.com/kitfunso/claude-config --skill skill-creator-kitfunso

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Building effective AI skills requires more than writing instructions — descriptions must trigger reliably, outputs must be verified, and improvements must be measured. This Skill provides a structured draft-test-review-iterate loop with quantitative benchmarking so skill quality is validated rather than assumed. ## Core Features & Use Cases - Guided Skill Authoring: Interviews the user to capture intent, then drafts SKILL.md files following progressive disclosure and writing-style best practices. - Evaluation Harness: Runs test prompts with and without the skill via parallel subagents, grades outputs against assertions, and aggregates pass rates, timing, and token usage into benchmark reports. - Description Optimization: Generates realistic trigger eval queries and runs an automated train/test optimization loop to improve skill triggering accuracy. - Use Case: You want to build a skill that converts meeting notes into Jira tickets. This Skill helps you draft it, creates test cases, runs comparative benchmarks, presents results in a review viewer, and iterates until the outputs meet your standards. ## Quick Start Help me create a new skill that reformats my weekly status emails into a structured Markdown report, then test it with a few realistic prompts.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new AI skill from scratch?▼

Start by capturing intent: what the skill should do, when it should trigger, and the expected output format. Then draft the SKILL.md with a name and description in YAML frontmatter, write 2-3 realistic test prompts, and iterate based on evaluation results.

How do I test whether my skill actually improves outputs?▼

Run each test prompt twice in parallel — once with the skill and once without — then grade both against objective assertions. The aggregate_benchmark script compares pass rates, execution time, and token usage between configurations.

How do I optimize a skill description for better triggering?▼

Generate 20 realistic eval queries mixing should-trigger and should-not-trigger cases, then run the run_loop optimization script. It splits queries into train and held-out test sets and iteratively rewrites the description, selecting the best by test score.

What makes a good skill description for triggering?▼

A good description states both what the skill does and specific contexts for when to use it, including phrasings users might actually type. Slightly pushy descriptions improve recall, while lean descriptions suit crowded clusters of similar skills.

When should a skill not use quantitative test assertions?▼

Skills with subjective outputs like writing style or design quality should be evaluated qualitatively through human review rather than forced assertions. Assertions work best for objectively verifiable outputs like file transforms, data extraction, or fixed workflow steps.

Does skill evaluation work without subagents, like on Claude.ai?▼

Yes, but with adaptations: run test cases sequentially by following the skill yourself, skip baseline runs and quantitative benchmarking, and present results inline in conversation for feedback instead of using the browser-based review viewer.