result_analysis

Interprets experiment results against pre-registered expectations and diagnoses which causal link failed.

5|1|Updated Jul 17, 2026
One-click install
npx skills add https://github.com/WissingChen/my_code_config --skill result-analysis-wissingchen
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: result_analysis
Source: https://github.com/WissingChen/my_code_config/tree/main/my_skills/result_analysis
Command: npx skills add https://github.com/WissingChen/my_code_config --skill result-analysis-wissingchen

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Research teams often misread experiment outcomes: they retrofit explanations to match results, draw conclusions from weak evidence, or keep tweaking without converging on a decision. This Skill enforces disciplined evidence interpretation so every run either shrinks the set of live explanations or produces a clear kill/pivot/continue verdict. ## Core Features & Use Cases - Baseline-Expected-Actual Comparison: Recovers pre-registered baselines, expected ranges, and mechanisms before looking at results, then tabulates deviations per metric. - Causal Chain Diagnosis: Locates which link broke—validity, intervention, mechanism, target, or value—using a decision tree in references/causal-chain-diagnosis.md, with a filled failure-diagnosis example. - Statistical Verdicts & Convergence Accounting: Selects analysis methods by experimental design, reports effect sizes with uncertainty intervals, and records how each run updated hypotheses, live explanations, and the next decision. - Use Case: After a training run misses its expected +6pp gain, use this Skill to determine whether the intervention signal never appeared, the mechanism failed to transfer, or the metric decoupled from the research goal—then get a concrete discriminating next test. ## Quick Start Analyze the results of experiment E05 against its pre-registered expectations and tell me whether to continue, pivot, or stop this direction.

Frequently Asked Questions about result_analysis

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze experiment results against pre-registered expectations?▼

Recover the registered baseline metrics, expected ranges, and predicted mechanisms before viewing results, then build a baseline-expected-actual comparison table per metric. Deviations are traced along the registered causal chain to find which link failed rather than retrofitting explanations.

How to diagnose why a machine learning experiment failed?▼

Walk the causal chain in order: validity, intervention, mechanism, target, value. Check whether the intervention produced its expected intermediate signal before blaming the theory, and use a failure diagnosis table listing candidate explanations with supporting evidence, opposing evidence, and a discriminating next test.

When should I kill or pivot a research direction based on results?▼

Decide based on convergence, not raw metrics: continue if the run shrank the live explanation set, stop or pivot when no cheap discriminating test remains and no mechanism-level expectation survives. Two consecutive rounds without reducing any decision-relevant uncertainty triggers a problem review.

What statistical methods should I use for small-sample experiments?▼

Choose methods by experimental design, not fixed recipes. Small-sample mechanism questions use descriptive statistics and intermediate-signal analysis without inferential claims; paired or repeated measurements must be resampled by unit, never treated as independent samples.

Can this skill generate charts for my experiment report?▼

No, it only performs a mandatory visual-needs check and selects candidate figures with purpose, data source, and uncertainty representation. Actual chart generation is delegated to the result_visualization skill, and statistical conclusions cannot change during handoff.