skill-creator

Create, evaluate, and iteratively improve Claude skills with benchmarked test runs.

Updated Jul 6, 2026
One-click install
npx skills add https://github.com/chenziyang110/launchdeck --skill skill-creator-chenziyang110
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/chenziyang110/launchdeck/tree/main/.claude/skills/skill-creator
Command: npx skills add https://github.com/chenziyang110/launchdeck --skill skill-creator-chenziyang110

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and assets (resource) components.

What problem does it solve? Writing an effective skill is hard to get right on the first try: descriptions undertrigger, instructions overfit to a few examples, and there is no systematic way to know whether a change actually helped. This Skill provides a structured draft-test-review-improve loop with quantitative benchmarks so skill quality is measured rather than guessed. ## Core Features & Use Cases - Guided Skill Authoring: Interviews the user about intent, trigger contexts, and output formats, then writes a SKILL.md following progressive-disclosure and writing-style best practices. - Parallel Eval Runs with Baselines: Spawns with-skill and without-skill (or old-version) subagent runs for each test prompt, captures timing and token data, and grades outputs against assertions. - Benchmark Aggregation and Review Viewer: Aggregates grading results into benchmark.json/benchmark.md with mean, stddev, and deltas, then launches an HTML viewer for qualitative feedback. - Description Optimization Loop: Generates realistic should-trigger/should-not-trigger queries, reviews them in an HTML template, and runs an automated train/test optimization loop to improve triggering accuracy. - Use Case: You drafted a skill that converts meeting notes into Jira tickets but it only triggers half the time. Use this Skill to run trigger evals, optimize the description, and verify the improvement on a held-out test set. ## Quick Start Help me create a new skill that turns my weekly status notes into a formatted report, then test it with a few realistic prompts.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new Claude skill from scratch?▼

Start by defining what the skill should do, when it should trigger, and its output format. Then write a SKILL.md with name and description frontmatter, draft 2-3 realistic test prompts, run them with and without the skill, and iterate based on feedback and benchmark results.

How do I test whether my skill actually improves outputs?▼

Run each test prompt twice in parallel: once with the skill and once without (or against the old version). Grade both against objective assertions, then aggregate results into a benchmark comparing pass rates, time, and token usage with mean and standard deviation.

How can I improve a skill description so it triggers more reliably?▼

Generate about 20 realistic should-trigger and should-not-trigger queries, review them with the user, then run the automated optimization loop. It evaluates descriptions on a 60/40 train/test split over up to 5 iterations and selects the best by held-out test score.

Does skill evaluation work on Claude.ai without subagents?▼

Yes, but with adaptations. Without subagents you run test prompts sequentially yourself, skip baseline runs and quantitative benchmarking, and collect qualitative feedback inline in the conversation instead of using the browser-based review viewer.

Why does my skill fail to trigger on simple queries?▼

Claude only consults skills for tasks it cannot easily handle alone, so simple one-step queries may not trigger regardless of description quality. Design trigger eval queries that are substantive, multi-step, and detailed enough to benefit from skill guidance.