analysis-checkpoints

Enforces human-in-the-loop checkpoints before consequential analytical decisions during data analysis execution.

2|Updated Jun 8, 2026
One-click install
npx skills add https://github.com/lancegui/causal-powers --skill analysis-checkpoints-lancegui
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: analysis-checkpoints
Source: https://github.com/lancegui/causal-powers/tree/main/evals/prompt-pilot-state-did/transcripts/current/stage1/instructions/skills/analysis-checkpoints
Command: npx skills add https://github.com/lancegui/causal-powers --skill analysis-checkpoints-lancegui

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? During data analysis, debugging and iteration can silently drift into unauthorized changes — dropping outliers, switching estimators, or redefining the estimand — producing results the user never agreed to. This Skill draws a hard line between decisions an analyst may make autonomously and decisions that must stop for explicit user approval. ## Core Features & Use Cases - Decision classification: Distinguishes checkpoint-required changes (design, estimand, sample, specification, metric, any number the user has seen) from autonomous fixes (mechanical bug repairs that restore the agreed computation). - Structured checkpoint protocol: Name the decision, show the evidence, present at least two options with tradeoffs, give a recommendation, and wait — never implement past the gate. - Locked-document gate mechanics: Shared sign-off rules for planning artifacts like the framing brief, pre-analysis plan, causal Design Card, structural model card, and Prediction Spec. - Use Case: While debugging a difference-in-differences estimate, you discover a recording artifact that a triple-difference would absorb. Instead of silently upgrading the design, the Skill forces you to present options and wait for the user's choice before re-estimating. ## Quick Start Ask the assistant to apply analysis checkpoints while executing your analysis plan so it stops and asks before changing the design, sample, specification, or any reported number.

Frequently Asked Questions about analysis-checkpoints

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I prevent an AI analyst from changing my research design mid-analysis?▼

Apply a checkpoint discipline that classifies any change to the design, estimand, sample, or specification as a user-owned decision. The analysis stops, presents options with tradeoffs and a recommendation, and waits for explicit approval before implementing anything.

What decisions can a data analyst make autonomously during execution?▼

Mechanical bug fixes that restore the agreed computation — deduplicating a key meant to be unique, fixing a wrong join type, correcting units — may proceed autonomously but must be reported. Anything changing what is estimated, on what data, or a number already seen requires approval.

How should deviations from a pre-analysis plan be handled?▼

A deviation from a pre-analysis plan is allowed but must be disclosed and approved, never hidden. The change is presented as a checkpoint with evidence and options, then recorded as an approved deviation before estimation resumes.

What happens to checkpoints in non-interactive or batch analysis runs?▼

When the user cannot be reached, execution stops at the last validated state without implementing the checkpoint-class change. The options and recommendation are returned as the deliverable so a human can resolve the decision later.

When is dropping outliers or winsorizing data not allowed autonomously?▼

Dropping, filtering, winsorizing, or trimming data always changes the sample, which is a user-owned decision. It requires a checkpoint with evidence and alternatives unless the user explicitly authorized that exact sample change beforehand.