results-analysis

Analyze ML experimental results and generate publication-ready Results sections with statistical tests and visualizations.

1|Updated Mar 5, 2026
One-click install
npx skills add https://github.com/Clay-HHK/claude-skills --skill results-analysis-clay-hhk
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: results-analysis
Source: https://github.com/Clay-HHK/claude-skills/tree/main/results-analysis
Command: npx skills add https://github.com/Clay-HHK/claude-skills --skill results-analysis-clay-hhk

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Turning raw experimental outputs (CSV, JSON, TensorBoard logs) into statistically rigorous, publication-ready Results sections is error-prone: researchers cherry-pick runs, skip assumption checks, misuse standard deviation vs standard error, and produce non-colorblind-friendly figures. This Skill provides a systematic pipeline from data loading through statistical validation to paper-ready writing. ## Core Features & Use Cases - Statistical Analysis: Performs pre-tests (Shapiro-Wilk normality, Levene variance homogeneity), selects appropriate parametric or non-parametric tests (t-test, ANOVA, Wilcoxon, Kruskal-Wallis), applies multiple-comparison corrections (Bonferroni, FDR), and reports effect sizes (Cohen's d). - Publication-Quality Visualization: Generates vector-format figures (PDF/EPS) with colorblind-friendly palettes (Okabe-Ito, Paul Tol), error bars, and proper axis ranges. - Results Section Drafting: Produces structured Results drafts with complete statistical reporting, ablation tables, and quality checklists for reproducibility (random seeds, hyperparameter search ranges, compute resources). - Use Case: You have 5 runs each of three models in CSV files. The Skill loads the data, verifies assumptions, runs paired t-tests with Bonferroni correction, and outputs an analysis report, figure specifications, and a Results section draft ready for your paper. ## Quick Start Ask the assistant to analyze the experimental results in your CSV files, compare model performance with statistical significance tests, and draft a Results section for your paper.

Frequently Asked Questions about results-analysis

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze ML experimental results for a paper?▼

Load your result files (CSV, JSON, or TensorBoard logs), validate data completeness, then compute means with standard deviations across runs. Run pre-tests for normality and variance homogeneity, apply the appropriate significance test, and report p-values with effect sizes before drafting the Results section.

Which statistical test should I use to compare model performance?▼

For two paired models with normal data use a paired t-test; for non-normal data use Wilcoxon signed-rank. For three or more models use ANOVA with Tukey HSD post-hoc, or Kruskal-Wallis with Dunn's test when normality fails. Always verify assumptions first with Shapiro-Wilk and Levene tests.

What input data formats does results analysis support?▼

The workflow supports CSV files for tabular metrics, JSON files for structured results, TensorBoard logs for training curves, and Python pickle files for complex objects. Data validation checks completeness, consistency, and reproducibility information such as random seeds.

How many experiment runs are needed for statistical significance?▼

Run experiments at least 3-5 times with different fixed random seeds; use 10 or more runs for high-variance tasks. Report all runs as mean plus or minus standard deviation, and never cherry-pick the best single run.

Why should I avoid PNG figures in research papers?▼

Raster formats like PNG and JPG lose quality when scaled and often fail publisher requirements. Use vector formats (PDF or EPS) instead, with colorblind-friendly palettes such as Okabe-Ito, error bars, and fonts of at least 8 points so figures remain readable in black-and-white print.

What is the difference between standard deviation and standard error in reporting?▼

Standard deviation describes the spread of your data across runs, while standard error describes uncertainty in the estimated mean and shrinks with sample size. Always state explicitly which one you report, since standard error appears smaller and can mislead readers if unlabeled.