skill-creator

Create, evaluate, and iteratively improve AI skills with benchmarked test runs.

1|Updated Nov 20, 2025
One-click install
npx skills add https://github.com/tony-zhelonkin/scio --skill skill-creator-tony-zhelonkin
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/tony-zhelonkin/scio/tree/main/skills/skill-creator
Command: npx skills add https://github.com/tony-zhelonkin/scio --skill skill-creator-tony-zhelonkin

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Writing an effective skill is hard to get right on the first try, and without structured evaluation there is no way to know whether a skill actually improves the model's output or triggers when it should. This Skill provides a complete draft-test-review-improve loop with quantitative benchmarking and description optimization. ## Core Features & Use Cases - Guided Skill Authoring: Interviews the user to capture intent, then drafts a SKILL.md with proper frontmatter, progressive disclosure structure, and writing-style guidance. - Parallel Evaluation Runs: Spawns with-skill and baseline subagent runs for each test prompt, grades outputs against assertions, and aggregates pass rates, timing, and token usage into benchmark.json. - Interactive Review Viewer: Generates an HTML viewer (via eval-viewer/generate_review.py) so users can inspect outputs side-by-side and leave feedback per test case. - Description Optimization: Runs an automated train/test loop (scripts/run_loop) that rewrites the skill's description to improve triggering accuracy on realistic queries. - Use Case: A user says "I want a skill that formats my lab notebooks." This Skill drafts it, creates test prompts, runs benchmarked evaluations, presents results for review, and iterates until the user is satisfied. ## Quick Start Help me create a new skill that converts my meeting notes into structured action items, then test and refine it with me.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new skill for Claude?▼

Start by defining what the skill should do and when it should trigger, then write a SKILL.md with name and description frontmatter plus markdown instructions. This Skill guides the interview, drafts the file, and sets up test cases to verify it works.

How do I test whether my skill actually improves results?▼

Run each test prompt twice in parallel: once with the skill and once without (baseline). Grade both outputs against objective assertions, then aggregate pass rates, timing, and token usage into a benchmark for comparison.

How can I improve a skill's description so it triggers correctly?▼

Generate 20 realistic should-trigger and should-not-trigger queries, then run the automated optimization loop. It evaluates candidate descriptions on a train split, selects the best by held-out test score, and updates the SKILL.md frontmatter.

What makes a good skill description for triggering?▼

A good description states both what the skill does and specific contexts when to use it, including phrasings a user might actually type. Slightly assertive wording helps because models tend to undertrigger skills by default.

When should a skill include scripts or reference files?▼

Add scripts when test runs show the model repeatedly rewriting the same helper code, and references when instructions exceed roughly 500 lines. This keeps SKILL.md lean while deterministic tasks execute without loading into context.

Can I use this skill workflow on Claude.ai without subagents?▼

Yes, but run test cases sequentially yourself instead of spawning parallel subagents, skip baseline comparisons and quantitative benchmarking, and present outputs inline for feedback rather than using the browser-based review viewer.