skill-creator

Create, evaluate, and iteratively improve Claude skills with benchmarked test runs.

Updated May 5, 2026
One-click install
npx skills add https://github.com/UlaYuga/promo-preflight --skill skill-creator-ulayuga
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/UlaYuga/promo-preflight/tree/main/.agents/skills/skill-creator
Command: npx skills add https://github.com/UlaYuga/promo-preflight --skill skill-creator-ulayuga

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Writing an effective skill is hard to get right on the first try, and there is no built-in way to know whether a skill actually improves Claude's output or triggers on the right prompts. This Skill provides a structured draft-test-review-iterate workflow with quantitative benchmarking so skill quality is measured rather than guessed. ## Core Features & Use Cases - Guided skill authoring: Interview-driven capture of intent, trigger conditions, and output formats, then generation of a well-structured SKILL.md following progressive disclosure and writing best practices. - Evaluation and benchmarking: Runs test prompts with and without the skill via parallel subagents, grades outputs against assertions, and aggregates pass rate, time, and token statistics into benchmark reports with an interactive HTML review viewer. - Description optimization: Generates realistic trigger/no-trigger eval queries and runs an automated optimization loop with train/test splits to improve skill triggering accuracy. - Use Case: A user wants a skill that formats weekly sales reports. This Skill drafts the SKILL.md, creates three realistic test prompts, runs with-skill and baseline comparisons, presents results in a browser viewer, and iterates based on feedback until the outputs pass review. ## Quick Start Help me create a new skill that converts meeting notes into structured action items, then test it and iterate until it works well.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new Claude skill from scratch?▼

Start by defining what the skill should do, when it should trigger, and its output format. Then write a SKILL.md with YAML frontmatter containing name and description, followed by markdown instructions, and optionally add scripts, references, or assets directories.

How do I test whether my skill actually improves Claude's output?▼

Create realistic test prompts, then run each prompt with the skill and without it as a baseline. Grade outputs against objective assertions and compare pass rates, execution time, and token usage between the two configurations.

What makes a good skill description for triggering?▼

A good description states both what the skill does and specific contexts when to use it, including phrasings users might actually type. Slightly assertive descriptions work better because Claude tends to undertrigger skills by default.

Can I benchmark a skill on Claude.ai without subagents?▼

Claude.ai lacks subagents, so parallel benchmark runs and blind comparisons are unavailable. You can still run test prompts sequentially yourself, present outputs inline for feedback, and iterate on the skill qualitatively.

Why does my skill not trigger when it should?▼

Skills may undertrigger when descriptions are too narrow or when queries are simple enough for Claude to handle directly. Use the description optimization loop with realistic should-trigger and near-miss should-not-trigger queries to measure and improve triggering accuracy.