skill-creator

Create, evaluate, and iteratively improve AI agent skills with benchmark testing.

Updated Oct 2, 2025
One-click install
npx skills add https://github.com/YuriiYInno/Innogram --skill skill-creator-yuriiyinno
Or copy as Structured Prompt for Agentโ–ผ
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/YuriiYInno/Innogram/tree/main/.codex/skills/skill-creator
Command: npx skills add https://github.com/YuriiYInno/Innogram --skill skill-creator-yuriiyinno

SYSTEM DOCUMENTATION & REQUIREMENTS

๐Ÿ’ก This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Building effective AI agent skills requires more than writing instructions โ€” descriptions must trigger reliably, outputs must be verified, and improvements must be validated against baselines. This Skill provides a complete workflow for drafting skills, running test cases with and without the skill, grading results quantitatively, and iterating based on user feedback. ## Core Features & Use Cases - Skill Authoring: Interview the user, capture intent, and generate a SKILL.md template with scripts, references, and assets directories via the init_skill.py script. - Benchmark Evaluation: Run test prompts with-skill and baseline configurations in parallel, grade assertions, and aggregate pass rates, timing, and token statistics into benchmark.json reports. - Description Optimization: Generate trigger/no-trigger eval queries, review them in an HTML interface, and run an automated optimization loop that improves the skill's description for better triggering accuracy. - Use Case: A user wants to build a skill that converts meeting notes into action items. This Skill helps draft the instructions, creates realistic test prompts, runs comparative evaluations, presents results in a browser-based review viewer, and iterates until the outputs meet expectations. ## Quick Start Ask the assistant to create a new skill for your desired workflow and it will interview you, draft the skill, and set up test cases to validate it.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new AI agent skill from scratch?โ–ผ

Start by defining what the skill should do and when it should trigger, then run the init_skill.py script to generate a template directory with SKILL.md and resource folders. Fill in the frontmatter name and description, write the instructions, and create test prompts to validate behavior.

How do I test whether a skill actually improves agent output?โ–ผ

Run each test prompt twice in parallel โ€” once with the skill and once without โ€” then grade both outputs against objective assertions. The aggregate_benchmark.py script computes pass rates, timing, and token usage with mean and standard deviation for comparison.

How do I optimize a skill description for better triggering?โ–ผ

Generate 20 realistic eval queries split between should-trigger and should-not-trigger cases, review them in the HTML interface, then run the run_loop optimization script. It tests description variants against a train/test split and selects the best by held-out test score.

What makes a good skill description for triggering accuracy?โ–ผ

A good description states both what the skill does and specific contexts when to use it, including phrasings a user might actually type. Slightly assertive wording helps because agents tend to undertrigger skills when descriptions are too passive.

What are the limitations of skill evaluation without subagents?โ–ผ

Without subagents, test cases must run sequentially and baseline comparisons are skipped, making results less rigorous. Quantitative benchmarking and blind comparison are unavailable, so evaluation relies on qualitative user feedback instead.