loop-audit

Audit self-improvement loop cycles against git history and ledger claims.

1|Updated Sep 12, 2025
One-click install
npx skills add https://github.com/metabench/copilot-dl-news --skill loop-audit-metabench
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: loop-audit
Source: https://github.com/metabench/copilot-dl-news/tree/main/.claude/skills/loop-audit
Command: npx skills add https://github.com/metabench/copilot-dl-news --skill loop-audit-metabench

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? A self-improving agent loop that writes its own report card can silently drift into busy-work, over-claiming, and self-congratulation. This Skill independently verifies whether improvement cycles actually delivered value, whether ledger claims survive contact with git history, and whether the loop should keep running or stop. ## Core Features & Use Cases - Compounding vs Oscillation Analysis: Parses cycle stanzas from the improvement ledger to measure verified improvements per cycle, cost per improvement, scaffold accretion vs pruning, and reversals that signal busy-work. - Claim Substantiation Against Git: Samples at least 8 cycles across the full range and checks claimed work, verification entries, and defect classifications against git log and git show, reporting a falsifiable unsubstantiated-claim rate. - Tech Tree and Owner-Signal Health Checks: Validates that available tech-tree nodes represent real work, and that owner requests in data/agi-signals.jsonl were acknowledged with actual shipped changes. - Adversarial Verification Method: Runs one agent per audit question plus a separate refutation agent per material finding, with every finding marked measured, source-read, or inferred. - Use Case: After 30 autonomous improvement cycles, ask whether the loop is still producing product value — the audit returns a health verdict, a claim-substantiation rate, refuted findings for calibration, and a stop/continue recommendation. ## Quick Start Audit the self-improvement loop by checking the improvement ledger against git history and report whether the cycles are compounding real value or just polishing instrumentation.

Frequently Asked Questions about loop-audit

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I audit whether an AI self-improvement loop is actually working?▼

Parse every cycle stanza in the improvement ledger and compute verified improvements per cycle, cost per improvement, and scaffold added versus retired. Then sample at least 8 cycles and check their claims against git log and git show, reporting a substantiation rate rather than anecdotes.

How to detect busy-work in autonomous agent improvement cycles?▼

Look for reversals where the same file or surface is moved one way and then back, repeated restatements of the same lesson, and scaffold accreting faster than it is pruned. Also measure what fraction of cycles improved the product versus the loop's own instrumentation.

What is the difference between the loop-audit and singularity skills?▼

The singularity skill runs improvement cycles, while loop-audit judges them. Use singularity to execute the loop and loop-audit when you need to verify the loop's claims, check convergence, or decide whether it should stop.

Why does a self-auditing loop need an adversarial verification pass?▼

A loop auditing itself reproduces the same bias being audited, so each material finding gets a separate agent whose job is to refute it, defaulting to refuted. An audit with nothing refuted probably did not try hard enough.

When should an autonomous improvement loop stop running?▼

The loop should stop when every remaining item is polish rather than substantive work. The audit explicitly recommends stopping in that case, since a recursive improvement process without a stopping condition manufactures the busy-work it exists to avoid.