skill-creator

Create, evaluate, and iteratively improve Claude skills with benchmarked test runs.

Updated Apr 16, 2026
One-click install
npx skills add https://github.com/quangtuyennguyen/loan-application-workflow --skill skill-creator-quangtuyennguyen
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/quangtuyennguyen/loan-application-workflow/tree/main/.claude/skills/skill-creator
Command: npx skills add https://github.com/quangtuyennguyen/loan-application-workflow --skill skill-creator-quangtuyennguyen

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Writing an effective skill is hard to get right on the first try — descriptions may fail to trigger, instructions may be ambiguous, and there is no built-in way to know whether a skill actually improves outcomes. This Skill provides a structured draft-test-review-improve loop with quantitative benchmarking so skills are validated against real test prompts rather than guesswork. ## Core Features & Use Cases - Guided Skill Authoring: Captures intent through interview questions, then writes SKILL.md frontmatter and body following progressive disclosure and writing-style best practices. - Evaluation & Benchmarking: Runs test prompts with and without the skill in parallel, grades outputs against assertions, and aggregates pass rates, timing, and token usage into benchmark reports. - Description Optimization: Generates trigger/no-trigger eval queries, reviews them in an HTML tool, and runs an automated loop that rewrites the skill description to maximize triggering accuracy on held-out test queries. - Use Case: You want a skill that formats weekly sales spreadsheets. This Skill helps you draft it, creates realistic test prompts, runs with-skill vs baseline comparisons, shows results in a review viewer, and iterates until the outputs pass your review. ## Quick Start Ask the assistant to create a new skill for your workflow and let it draft, test, and refine the skill through evaluation iterations.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new Claude skill from scratch?▼

Start by defining what the skill should do, when it should trigger, and its expected output format. Then write a SKILL.md with name and description frontmatter, draft 2-3 realistic test prompts, and iterate based on evaluation results.

How do I test whether my skill actually improves results?▼

Run each test prompt twice in parallel — once with the skill and once without — then grade outputs against objective assertions. The aggregate_benchmark script computes pass rates, timing, and token deltas between configurations.

How can I improve a skill description so it triggers correctly?▼

Generate 20 realistic should-trigger and should-not-trigger queries, review them in the HTML eval tool, then run the optimization loop. It rewrites the description and scores each version on held-out test queries to avoid overfitting.

What makes a good SKILL.md description for triggering?▼

A good description states both what the skill does and specific contexts when to use it, including phrasings users might actually type. Slightly assertive wording helps because models tend to undertrigger skills by default.

Does skill evaluation work without subagents, like on Claude.ai?▼

Yes, but with adaptations: run test prompts sequentially yourself instead of spawning parallel subagents, skip baseline runs and quantitative benchmarking, and collect feedback inline in the conversation rather than through the browser viewer.

When should a skill bundle scripts instead of instructions?▼

Bundle a script when test runs show agents repeatedly writing the same helper code across cases, or when a task is deterministic and repetitive. Scripts in the scripts/ directory execute without loading into context, saving effort on every invocation.