skill-creator-normal

Create, evaluate, and iteratively improve single-agent skills with benchmark analysis.

Updated Aug 31, 2026
One-click install
npx skills add https://github.com/DreamMacer/jiuwenswarm --skill skill-creator-normal-dreammacer
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-creator-normal
Source: https://github.com/DreamMacer/jiuwenswarm/tree/main/resources/agent/workspace/skills/skill-creator-normal
Command: npx skills add https://github.com/DreamMacer/jiuwenswarm --skill skill-creator-normal-dreammacer

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and assets (resource) components.

What problem does it solve? Building a reliable skill requires more than writing a prompt — it needs structured drafting, realistic test cases, quantitative benchmarking against baselines, and iterative refinement based on user feedback, which is hard to do systematically by hand. ## Core Features & Use Cases - Guided Skill Authoring: Captures intent through interview questions, searches community skills for proven structural patterns, and plans directory layouts with scripts, references, and assets before writing. - Evaluation & Benchmarking: Runs with-skill and baseline test cases in parallel, grades assertions, aggregates pass rates, timing, and token usage with variance analysis, and renders results in an interactive review viewer. - Description Optimization: Generates trigger/no-trigger eval queries and iteratively rewrites the skill description to improve triggering accuracy, with train/test split reporting. - Use Case: A user wants a skill that generates changelogs from git history. This skill interviews them, drafts the SKILL.md, creates test prompts, runs benchmarked evaluations, and iterates until the outputs pass review. ## Quick Start Help me create a new skill that converts meeting transcripts into structured action-item lists, then test and refine it.

Frequently Asked Questions about skill-creator-normal

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new AI agent skill from scratch?▼

Start by defining what the skill should do, when it should trigger, and its expected output format. Then draft a SKILL.md with YAML frontmatter containing name and description, add test prompts, run evaluations against a baseline, and iterate based on feedback.

How do I test whether a skill actually improves results?▼

Run each test prompt twice in parallel — once with the skill and once without — then grade outputs against objective assertions. Aggregate pass rates, execution time, and token usage across runs to compute mean, standard deviation, and the delta between configurations.

How can I improve a skill description for better triggering?▼

Generate around 20 realistic should-trigger and should-not-trigger queries, then iteratively rewrite the description while measuring accuracy on a train set and validating on held-out test queries. Apply the best-performing description to the skill.

What directories should a non-trivial skill contain?▼

Beyond SKILL.md, add scripts/ for deterministic executable tasks, references/ for domain knowledge too large to inline, assets/ for output templates, and agents/ for subagent prompt files. SKILL.md should point to each resource with guidance on when to read it.

Why does npx skills find return empty results on Windows?▼

On Windows, running npx skills find directly can silently produce empty output due to an npx compatibility bug. Wrap the command in powershell -Command to get correct results before concluding no matching skills exist.

When should a skill skip quantitative test cases?▼

Skills with subjective outputs like writing style or visual design often do not benefit from assertions, since quality requires human judgment. Skills with objectively verifiable outputs such as file transforms or data extraction benefit most from quantitative evals.