skill-creator

Create, evaluate, and iteratively improve Claude skills with benchmark-driven workflows.

Updated Jan 30, 2026
One-click install
npx skills add https://github.com/RyoMa99/chezmoi_dotfiles --skill skill-creator-ryoma99
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/RyoMa99/chezmoi_dotfiles/tree/main/dot_claude/skills/skill-creator
Command: npx skills add https://github.com/RyoMa99/chezmoi_dotfiles --skill skill-creator-ryoma99

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Writing an effective skill is hard to get right on the first try, and without structured testing there is no way to know whether a skill actually improves Claude's output or triggers when it should. This Skill provides a complete draft-test-review-improve loop with quantitative benchmarking and description optimization. ## Core Features & Use Cases - Guided Skill Authoring: Interviews the user to capture intent, then drafts a SKILL.md with proper frontmatter, progressive disclosure structure, and writing patterns. - Parallel Evaluation Runs: Spawns with-skill and baseline subagent runs for each test case, grades outputs against assertions, and aggregates pass rates, timing, and token usage into benchmark reports. - Interactive Review Viewer: Generates an HTML viewer (via generate_review.py) so users can inspect outputs side-by-side and leave feedback that drives the next iteration. - Description Optimization: Runs an automated train/test loop that rewrites the skill's description to maximize triggering accuracy on realistic queries. - Use Case: You want Claude to consistently generate properly formatted weekly status reports. Use this Skill to draft the skill, run three realistic test prompts with and without it, review the outputs in the browser viewer, and iterate until the results satisfy you. ## Quick Start Help me create a new skill that formats my weekly status reports, then test it and iterate until it works well.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new Claude skill from scratch?▼

Start by defining what the skill should do and when it should trigger, then write a SKILL.md with name and description frontmatter plus markdown instructions. This Skill guides the interview, drafts the file, and runs test prompts to validate it.

How do I test whether my skill actually improves Claude's output?▼

Run each test prompt twice in parallel: once with the skill and once without as a baseline. Grade both outputs against objective assertions, then aggregate pass rates, timing, and token usage into a benchmark for comparison.

How can I improve my skill description so it triggers correctly?▼

Build a set of 20 realistic should-trigger and should-not-trigger queries, then run the automated optimization loop. It evaluates description variants on a train split and selects the best by held-out test score to avoid overfitting.

What is the difference between with-skill and baseline runs in skill evaluation?▼

With-skill runs execute the test prompt with the skill loaded, while baseline runs use no skill (for new skills) or the previous version (for improvements). Comparing them isolates the skill's actual contribution to output quality.

Does skill evaluation work on Claude.ai without subagents?▼

Yes, but with limitations. Without subagents you run test prompts sequentially yourself, skip baseline comparisons and quantitative benchmarking, and collect feedback inline in the conversation instead of using the browser viewer.

When should a skill bundle scripts instead of inline instructions?▼

Bundle a script when test runs show subagents repeatedly writing the same helper code across cases, or when a task is deterministic and repetitive. Scripts save every future invocation from reinventing the logic.