skill-creator

Create, evaluate, and iteratively improve Claude skills with benchmarked test runs.

Updated Mar 26, 2026
One-click install
npx skills add https://github.com/TranVanTienDat/Milkyway --skill skill-creator-tranvantiendat
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/TranVanTienDat/Milkyway/tree/main/.agents/skills/skill-creator
Command: npx skills add https://github.com/TranVanTienDat/Milkyway --skill skill-creator-tranvantiendat

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Writing an effective skill is hard to get right on the first try, and there is no built-in way to know whether a skill actually improves Claude's output or triggers when it should. This Skill provides a structured draft-test-review-iterate workflow with quantitative benchmarking and description optimization. ## Core Features & Use Cases - Guided Skill Authoring: Interviews the user about intent, trigger contexts, and output formats, then drafts a SKILL.md following progressive disclosure and writing best practices. - Evaluation & Benchmarking: Runs test prompts with and without the skill in parallel, grades outputs against assertions, and aggregates pass rates, timing, and token usage into benchmark reports with an interactive HTML review viewer. - Description Optimization: Generates realistic trigger/no-trigger eval queries and runs an automated optimization loop with train/test splits to improve skill triggering accuracy. - Use Case: You want to build a skill that formats weekly sales reports. This Skill helps you draft it, creates test cases, runs them with and without the skill, shows you side-by-side results in a browser viewer, and iterates until the outputs meet your standards. ## Quick Start Help me create a new skill that converts meeting transcripts into structured action-item lists, then test and refine it.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new Claude skill from scratch?▼

Start by defining what the skill should do, when it should trigger, and its expected output format. Then write a SKILL.md with name and description frontmatter, draft 2-3 realistic test prompts, and iterate based on evaluation results.

How do I test whether my skill actually improves Claude's output?▼

Run each test prompt twice in parallel: once with the skill and once without as a baseline. Grade both outputs against objective assertions, then aggregate pass rates, timing, and token usage into a benchmark comparison.

How do I improve a skill description so it triggers correctly?▼

Generate 20 realistic eval queries mixing should-trigger and should-not-trigger cases, then run the automated optimization loop. It tests description variants against a train/test split and selects the best performer on held-out queries.

What makes a good SKILL.md description for triggering?▼

Include both what the skill does and specific contexts for when to use it, since Claude tends to undertrigger skills. Make descriptions slightly pushy by listing related phrases and scenarios, even ones where the user does not explicitly name the skill.

When should a skill include test cases versus skip them?▼

Skills with objectively verifiable outputs like file transforms, data extraction, or code generation benefit from test cases with assertions. Skills with subjective outputs like writing style or art are better evaluated through qualitative human review.

What are the limitations of skill evaluation on Claude.ai?▼

Claude.ai lacks subagents, so test cases run sequentially without baseline comparisons or quantitative benchmarking. Description optimization and blind comparison require the Claude Code CLI and are skipped on Claude.ai.