meta-skill-audit

Audit a catalogue of shipped skills and scripts for stale claims, dangling references, and defects.

1|Updated Jun 23, 2026
One-click install
npx skills add https://github.com/bitranox/bitranox-skills --skill meta-skill-audit-bitranox
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: meta-skill-audit
Source: https://github.com/bitranox/bitranox-skills/tree/main/plugins/bitranox/skills/meta-skill-audit
Command: npx skills add https://github.com/bitranox/bitranox-skills --skill meta-skill-audit-bitranox

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve? A shipped skill catalogue decays silently: claims stop being true, references stop resolving, and instructions stop being executable, and a single reviewer cannot reliably catch this across dozens of skills. This Skill runs a structured audit that separates deterministic checks from judgement calls and isolates reviewers from contaminated context. ## Core Features & Use Cases - Clean-room skill sweep: Copies the whole plugin into an isolated room and runs one reviewer per skill in parallel, writing a report per skill with verbatim-quote findings classified as WRONG, DANGLING, UNEXECUTABLE, or STALE. - Script audit mode: Reviews shipped Python and JavaScript (hooks, shims, skill scripts) with an evidence contract requiring runnable reproductions or traced line numbers, plus a deterministic pre-pass that separates settled facts from leads. - Triage guidance: Pairs every finding class with its usual false positive and ranks defects by what a reader does with them. - Use Case: Before a release touching many skills, run the sweep to catch a shipped example that no longer parses, a sibling reference that no longer resolves, or a documented flag the script no longer accepts. ## Quick Start Ask the AI to audit the shipped skill catalogue with meta-skill-audit, walling off recall first and running scripts/audit_skills.py against a clean room outside the knowledge tree.

Frequently Asked Questions about meta-skill-audit

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I audit a catalogue of shipped Claude Code skills?▼

Run scripts/audit_skills.py with --plugin pointing at the plugin directory and --room pointing at a directory outside the knowledge tree. It copies the plugin into the room, runs one reviewer per skill in parallel, and writes a report per skill under <room>/reports/.

How do I review shipped hooks and scripts instead of skills?▼

Pass --scripts to audit_skills.py to switch to the script sweep, which reviews hooks, shims, and skill scripts one file at a time. Use --kind to slice by hook, hook-lib, shim, skill-script, or js, and --skip-existing with --reuse-room to resume an interrupted run.

Why must the audit room be outside the knowledge tree?▼

A reviewer running inside the tree gets matching memory entries injected by the recall hook and the CLAUDE.md cascade, so it reports skills as complete because it already knew the answers. Walling recall and placing the room outside the tree keeps the measurement honest.

Why does the audit treat the plugin as the install unit?▼

Skills legitimately reference sibling skills and plugin hooks that ship together. Judging reachability against a single skill directory reports every sibling reference as dangling, which measured as 5 of 6 false positives in one run.

Can I trust a clean sweep report as verification?▼

No. One reviewer per skill per run is a sample, so a skill that reports clean once is unmeasured rather than verified clean. Also verify every finding's quote against the real file before acting, since a reviewer's quote is a claim, not evidence.

What are the limitations of the script audit mode?▼

Vendored upstream sample code is excluded by default because fixing it diverges from the source. Reviewers must not install dependencies or run scripts against real hosts, so anything needing a network, browser, or root is recorded as unmeasured rather than a finding.