analysis-review

Reviews data analyses for silent failures like leakage, fanned-out joins, and fished specifications.

2|Updated Jun 8, 2026
One-click install
npx skills add https://github.com/lancegui/causal-powers --skill analysis-review-lancegui
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: analysis-review
Source: https://github.com/lancegui/causal-powers/tree/main/skills/analysis-review
Command: npx skills add https://github.com/lancegui/causal-powers --skill analysis-review-lancegui

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Code review catches syntax bugs, but analytical work fails silently: clean code in R, Julia, Python, or Stata can still produce a confidently wrong number through unchecked joins, target leakage, undefined metrics, or unsupported causal claims. This Skill reviews the path from data to conclusion rather than just the code. ## Core Features & Use Cases - Adversarial review checklist: Hunts for silent-failure classes including fanned-out joins, leakage, specification fishing, unreconciled totals, undefined estimands, and identification gaps in causal and structural models. - Independent reviewer agent: For your own pre-ship analysis, it requires dispatching a fresh-context reviewer agent that returns concrete findings with severity instead of a rubber stamp. - Feedback verification: When receiving critique on your analysis, it verifies each claim against the data before agreeing or defending, avoiding performative fixes. - Use Case: Before sending a regression result to a colleague, run the review to confirm the metric is defined, joins are row-count checked, totals reconcile, leakage is ruled out, and identification assumptions are stated. ## Quick Start Ask the assistant to review this analysis or sanity-check these numbers before you send them.

Frequently Asked Questions about analysis-review

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I review a data analysis before publishing it?▼

Review the path from data to claim, not just the code. Check that the metric is precisely defined, joins are row-count verified, totals reconcile to source, leakage is ruled out, and any causal claim has stated identification assumptions.

What silent failures should I check in an analysis review?▼

The main classes are fanned-out joins, undefined metrics, target leakage, train/test overlap, fished specifications, unreconciled totals, and missing identification assumptions. Structural models additionally need parameter identification statements and Monte-Carlo recovery tests.

Can I review my own analysis or do I need an independent reviewer?▼

For your own pre-ship analysis, an independent reviewer agent is required because self-review cannot supply fresh context. When reviewing someone else's work, you already are the fresh context, so inline review is acceptable.

How should I respond to review feedback on my analysis?▼

Verify each critique against the data before acting on it. Run the check that would settle the claim, such as a row-count test for an alleged double-counting join, rather than reflexively agreeing or defending.

Does analysis review replace result verification?▼

No, they catch different failure classes. Verification proves a number reproduces and reconciles, while review hunts what reproducibility cannot catch, such as leakage, bad controls, and fished specifications. Both should run.