skill-creator

Create, evaluate, benchmark, and optimize AI skills through iterative test-driven workflows.

Updated Oct 30, 2025
One-click install
npx skills add https://github.com/MauricioDMO/config --skill skill-creator-mauriciodmo
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/MauricioDMO/config/tree/main/opencode/skills/skill-creator
Command: npx skills add https://github.com/MauricioDMO/config --skill skill-creator-mauriciodmo

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and assets (resource) components.

What problem does it solve? Building effective AI skills requires more than writing instructions — descriptions must trigger reliably, outputs must be validated against real prompts, and improvements must be measured rather than guessed. This Skill provides a structured create-test-review-iterate loop with quantitative benchmarking so skill quality is verified with data instead of intuition. ## Core Features & Use Cases - Guided Skill Authoring: Interviews the user about intent, triggers, and output formats, then drafts a SKILL.md following progressive disclosure and anatomy best practices. - Evaluation & Benchmarking: Runs test prompts with and without the skill via parallel subagents, grades assertions, and aggregates pass rates, timing, and token usage into benchmark reports with an interactive HTML review viewer. - Description Optimization: Generates realistic trigger/no-trigger query sets and runs an automated train/test optimization loop to improve skill triggering accuracy. - Use Case: You want to build a skill that converts meeting notes into Jira tickets. This Skill helps you draft it, creates test cases, runs comparative evaluations, shows results in a browser viewer, and iterates until the outputs pass review. ## Quick Start Help me create a new skill that turns my weekly meeting notes into structured action items, then test it with a few realistic prompts.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new AI skill from scratch?▼

Start by defining what the skill should do, when it should trigger, and its expected output format. Then draft a SKILL.md with name and description frontmatter, create 2-3 realistic test prompts, run them with and without the skill, and iterate based on feedback.

How to benchmark skill performance with variance analysis?▼

Run each test case multiple times with and without the skill, grade outputs against assertions, then aggregate results with the aggregate_benchmark.py script. It produces benchmark.json and benchmark.md showing pass rate, time, and token usage with mean, standard deviation, and deltas.

How do I improve a skill description for better triggering?▼

Generate 20 realistic eval queries mixing should-trigger and should-not-trigger cases, review them in the HTML template, then run the run_loop optimization script. It splits queries into train and test sets, evaluates descriptions across iterations, and returns the best-scoring description.

Does skill evaluation work without subagents, like on Claude.ai?▼

Yes, but with adaptations. Without subagents you run test cases sequentially yourself, skip baseline comparisons and quantitative benchmarking, and collect feedback inline in the conversation instead of using the browser-based review viewer.

What makes a good skill test assertion?▼

Good assertions are objectively verifiable conditions with descriptive names, such as checking that an output file exists or contains specific data. Subjective qualities like writing style should be evaluated qualitatively by human review rather than forced into assertions.