skill-autoresearch-loop

Scaffolds a bounded autoresearch workspace to iteratively improve one existing skill with a fixed harness and metric.

Updated Apr 14, 2026
One-click install
npx skills add https://github.com/amitkarpe/agent-skills --skill skill-autoresearch-loop-amitkarpe
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-autoresearch-loop
Source: https://github.com/amitkarpe/agent-skills/tree/main/skills/skill-autoresearch-loop
Command: npx skills add https://github.com/amitkarpe/agent-skills --skill skill-autoresearch-loop-amitkarpe

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve? Improving an existing agent skill often turns into open-ended, unmeasured tweaking. This Skill enforces a bounded autoresearch loop with one primary metric, a fixed 3-5 scenario harness, and explicit keep-or-reject decisions so skill quality ratchets upward without uncontrolled experimentation. ## Core Features & Use Cases - Workspace Scaffolding: A bash script creates a durable autoresearch workspace under ~/.AGENTS-temp/<repo>/autoresearch/<skill>/ with goal, harness, baseline, iteration template, and decision log files. - Metric and Harness Guidance: A reference document defines good primary metrics (first-try success rate, retries, manual commands) and harness shapes for operator, build-and-validate, and investigation workflows. - Keep-or-Reject Iteration Log: Each iteration makes one bounded change, re-runs the same harness, and records a keep, reject, or defer decision. - Use Case: You have a skill like imagebuilder-bake-validate that works but requires too many manual commands. Run the scaffold script, define "first-try success rate" as the metric, record a baseline, then iterate one change at a time until the metric improves. ## Quick Start Ask the agent to scaffold an autoresearch workspace for a chosen skill and repo with a primary metric, then record a baseline before making any changes.

Frequently Asked Questions about skill-autoresearch-loop

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I improve an existing agent skill with a repeatable evaluation loop?▼

Run the init-autoresearch-workspace.sh script with your repo name, skill name, and a primary metric. It creates goal, harness, baseline, iteration, and decision log templates under ~/.AGENTS-temp, then you iterate one bounded change at a time against the fixed harness.

What metrics should I use to measure skill quality?▼

Good primary metrics include first-try success rate, number of manual commands still required, time to a valid result, repo-specific edits per run, and retries before success. Pick exactly one primary metric and at most two secondary observations.

When should I not use an autoresearch loop for a skill?▼

Do not use it when the skill does not exist yet, when there is no stable test harness, when the first validation path requires risky production mutation, or when the goal is vague like "make it better somehow".

Where are autoresearch run artifacts stored?▼

All artifacts are stored outside the source repository under ~/.AGENTS-temp/<repo>/autoresearch/<skill>/, including the goal, harness, baseline, iteration template, decision log, and a runs/ directory for evidence.

How many changes should I make per autoresearch iteration?▼

Make exactly one meaningful change per iteration, such as one edit to SKILL.md, one script, or one default parameter. Keep the harness fixed, re-run the same scenarios, and record a keep, reject, or defer decision in the log.