skill-creator

Create, evaluate, and iteratively improve AI agent skills with benchmarked test runs.

1|2|Updated Mar 5, 2026
One-click install
npx skills add https://github.com/zhizhunbao/textbook-rag --skill skill-creator-zhizhunbao
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/zhizhunbao/textbook-rag/tree/main/.agent/skills/skill-creator
Command: npx skills add https://github.com/zhizhunbao/textbook-rag --skill skill-creator-zhizhunbao

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyyaml, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Writing effective agent skills is hard to get right on the first try, and there is no systematic way to know whether a skill actually improves agent behavior. This Skill provides a structured workflow for drafting skills, running controlled test cases with and without the skill, grading results against assertions, and iterating based on quantitative benchmarks and user feedback. ## Core Features & Use Cases - Guided Skill Authoring: Interview-driven process to capture intent, write SKILL.md files with proper frontmatter, and structure scripts, references, and assets following progressive disclosure principles. - Evaluation & Benchmarking: Run test prompts with and without the skill in parallel, grade outputs against assertions, and aggregate pass rates, timing, and token usage into benchmark reports with variance analysis. - Description Optimization: Generate trigger/no-trigger eval queries and run an automated optimization loop to improve the skill description's triggering accuracy. - Use Case: You want to build a skill that formats weekly sales reports. Use this Skill to draft it, run three realistic test prompts, review outputs side-by-side in an HTML viewer, and iterate until the benchmark shows consistent improvement over the baseline. ## Quick Start Help me create a new skill that converts meeting transcripts into structured action-item lists, then test it with a few realistic prompts.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new AI agent skill from scratch?▼

Start by defining what the skill should do and when it should trigger, then write a SKILL.md file with name and description frontmatter plus markdown instructions. Test it with realistic prompts, gather feedback, and iterate until the outputs are consistently good.

How do I test whether my skill actually improves agent performance?▼

Run each test prompt twice in parallel: once with the skill and once without as a baseline. Grade both outputs against objective assertions, then aggregate pass rates, timing, and token usage into a benchmark to measure the delta.

What makes a good skill description for triggering?▼

A good description states both what the skill does and specific contexts when it should be used, including phrasings a user might actually type. Slightly assertive wording helps because agents tend to undertrigger skills by default.

Does skill evaluation work without subagents or a browser?▼

Yes, on platforms like Claude.ai you run test prompts sequentially yourself and present results inline for feedback. The eval viewer also supports a --static flag that writes a standalone HTML file instead of starting a server.

Why does my skill fail to trigger on simple user queries?▼

Agents often skip skills for simple one-step tasks they can handle directly, even when the description matches. Test triggering with substantive multi-step queries, and use the description optimization loop with realistic should-trigger and near-miss queries.