skill-creator

Automates creation, evaluation, and iteration of AI skills with run_eval.py and run_loop.py scripts.

316|42|Updated Apr 5, 2026
One-click install
npx skills add https://github.com/xwtro0tk1t-cloud/harness --skill skill-creator-xwtro0tk1t-cloud
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-creator
Source: https://github.com/xwtro0tk1t-cloud/harness/tree/main/bundled-skills/skill-creator
Command: npx skills add https://github.com/xwtro0tk1t-cloud/harness --skill skill-creator-xwtro0tk1t-cloud

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pypdf, pdfplumber, pdf2image, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill provides a structured methodology to create, improve, evaluate, and benchmark AI skills. It guides users through drafting skills, running trigger-evaluation loops, performing iterations, and delivering measurable improvements.

Core Features & Use Cases

  • End-to-end skill development workflow: draft → test prompts → run evals → iterate to convergence.
  • Built-in evaluation, benchmarking, and results visualization to compare iterations.
  • Auto-improvement of the skill description via history-aware optimization and holdout testing.
  • Packaging and distribution support to create a distributable .skill artifact and reuse in multiple projects.

Quick Start

Kick off the loop by drafting a skill, launching the evaluation loop, and iterating until you achieve a stable, high-performing description.

Frequently Asked Questions about skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate the workflow for creating and evaluating AI skills?▼

You can automate AI skill creation by running an evaluation loop that drafts skills, tests prompts, benchmarks iterations, and auto-improves descriptions using history-aware optimization until achieving stable performance.

What is trigger-evaluation loop iteration for prompt engineering?▼

Trigger-evaluation loop iteration is a testing mechanism that repeatedly runs prompts against holdout test sets, benchmarks the results, and refines the skill description to produce consistent, traceable upgrades with measurable improvements.

Can I benchmark AI skill performance across multiple prompts and holdout test sets?▼

Yes, you can benchmark AI skill performance across multiple prompts and holdout test sets by using built-in evaluation scripts that compare iterations and visualize results to deliver measurable, traceable skill improvements.

Does AI skill development require integration with specific evaluation scripts?▼

Yes, AI skill development requires integration with evaluation scripts like run_eval.py and run_loop.py to perform frontmatter validation, script packaging, and optional live reporting for consistent, traceable skill upgrades.

What's the best way to package a distributable AI skill artifact for reuse?▼

The best way to package a distributable AI skill artifact is to use the built-in packaging and distribution support, which compiles the validated scripts and assets into a reusable .skill artifact for deployment across multiple projects.

Why does my AI skill description not converge during iteration testing?▼

Your AI skill description may not converge during iteration testing if the history-aware optimization lacks sufficient holdout test sets or if the trigger-evaluation loop fails to apply consistent benchmarking across multiple prompts.