skill-creator

Create, evaluate, and iteratively improve AI agent skills with benchmarked testing workflows.

2|Updated Jan 26, 2026
One-click install
npx skills add https://github.com/Nzettodess/Awesome-Agent-Skills --skill skill-creator-nzettodess
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/Nzettodess/Awesome-Agent-Skills/tree/main/Skills/Claude%20Skill%20Creator
Command: npx skills add https://github.com/Nzettodess/Awesome-Agent-Skills --skill skill-creator-nzettodess

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Building effective AI agent skills requires more than writing instructions — descriptions must trigger reliably, outputs must be verified, and improvements must be measured. This Skill provides a structured draft-test-review-iterate loop with quantitative benchmarking so skill quality is validated rather than assumed. ## Core Features & Use Cases - Guided Skill Authoring: Captures intent through interview questions, then drafts SKILL.md files following progressive disclosure and anatomy best practices. - Evaluation Harness: Runs test prompts with and without the skill in parallel, grades assertions, aggregates pass rates, timing, and token usage into benchmark reports, and renders results in an HTML review viewer. - Description Optimization: Generates realistic trigger/no-trigger query sets and runs an automated train/test optimization loop to improve skill triggering accuracy. - Use Case: A user wants a skill that converts meeting notes into Jira tickets. This Skill drafts the SKILL.md, creates test prompts, runs baseline comparisons, presents results for review, and iterates until the outputs pass. ## Quick Start Help me create a new skill that extracts action items from meeting transcripts and test it with a few realistic prompts.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new AI agent skill from scratch?▼

Start by defining what the skill should do, when it should trigger, and its expected output format. Then draft a SKILL.md with name and description frontmatter, write 2-3 realistic test prompts, run them with and without the skill, and iterate based on feedback.

How do I test whether a skill actually improves agent output?▼

Run each test prompt twice in parallel: once with the skill and once without as a baseline. Grade both against objective assertions, then aggregate pass rates, timing, and token usage into a benchmark comparing the two configurations.

How can I improve a skill description for better triggering?▼

Generate 20 realistic queries split between should-trigger and should-not-trigger cases, including tricky near-misses. Run the optimization loop, which evaluates descriptions on a train split and selects the best performer on a held-out test split.

What is the required structure of a valid skill directory?▼

A skill requires a SKILL.md file with YAML frontmatter containing name and description, followed by Markdown instructions. Optional directories include scripts for executable code, references for on-demand documentation, and assets for templates or files used in output.

When should skill test cases include quantitative assertions?▼

Add assertions when outputs are objectively verifiable, such as file transforms, data extraction, or code generation. Skills with subjective outputs like writing style or design quality are better evaluated through qualitative human review instead.

Does skill evaluation work without subagents or a browser?▼

Yes, but with adaptations. Without subagents, run test prompts sequentially yourself and skip baseline comparisons. Without a browser display, generate a static HTML review file and collect feedback through a downloaded feedback.json file.