skill-creator

Create, evaluate, and iteratively improve Claude Skills with benchmark testing and description optimization.

Updated Aug 15, 2026
One-click install
npx skills add https://github.com/jacksonlee-tw/mystock-vue --skill skill-creator-jacksonlee-tw
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/jacksonlee-tw/mystock-vue/tree/main/mystock-analysis/.github/skills/skill-creator
Command: npx skills add https://github.com/jacksonlee-tw/mystock-vue --skill skill-creator-jacksonlee-tw

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Building effective AI Skills requires more than writing instructions — descriptions must trigger reliably, outputs must be validated against real test cases, and improvements need evidence rather than guesswork. This Skill provides a structured workflow for drafting Skills, running controlled evaluations with baselines, collecting human feedback, and optimizing trigger descriptions. ## Core Features & Use Cases - Guided Skill Authoring: Interview-driven process to capture intent, write SKILL.md files with proper frontmatter, and structure scripts, references, and assets following progressive disclosure principles. - Benchmark Evaluation Loop: Runs test prompts in parallel with and without the Skill, grades outputs against assertions, aggregates pass rates and timing into benchmark reports, and launches an HTML review viewer for human feedback. - Description Optimization: Generates realistic trigger/no-trigger query sets, runs an automated optimization loop with train/test splits, and applies the best-performing description to improve triggering accuracy. - Use Case: You want to build a Skill that formats weekly sales reports. This Skill helps you draft it, creates test prompts, runs evaluations comparing performance with and without the Skill, presents results in a browser viewer, and iterates until the output meets your standards. ## Quick Start Help me create a new Skill that converts meeting transcripts into structured action-item lists, then test and refine it.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new Claude Skill from scratch?▼

Define what the Skill should do and when it should trigger, then write a SKILL.md file with name and description frontmatter plus Markdown instructions. This Skill guides the interview, drafting, test case creation, and iterative evaluation process.

How do I test whether my Skill actually improves outputs?▼

Run each test prompt twice in parallel — once with the Skill and once without as a baseline — then grade outputs against objective assertions. The aggregate_benchmark script computes pass rates, timing, and token deltas between configurations.

How do I improve a Skill description so it triggers correctly?▼

Build an evaluation set of realistic queries labeled should-trigger or should-not-trigger, then run the optimization loop script. It splits queries into train and test sets, evaluates candidate descriptions over multiple iterations, and selects the best by held-out test score.

What is the required structure of a SKILL.md file?▼

A SKILL.md file requires YAML frontmatter with name and description fields, followed by Markdown instructions. Optional sibling directories include scripts for executable code, references for on-demand documentation, and assets for templates or files used in outputs.

Why does my Skill fail to trigger on simple queries?▼

Claude only consults Skills for tasks it cannot easily handle alone, so simple single-step queries may not trigger regardless of description quality. Test with substantive multi-step queries that genuinely benefit from the Skill's instructions.

Can I use this Skill in Claude.ai without subagents?▼

Yes, but with adjustments: run test cases sequentially yourself instead of in parallel, skip baseline comparisons and quantitative benchmarks, and present results directly in conversation. Packaging via the package script still works since it only needs Python and a filesystem.