analyze-results

Analyze ML experiment results and generate comparison tables with statistical insights.

75|7|Updated May 2, 2026
One-click install
npx skills add https://github.com/zjunlp/Mechanist --skill analyze-results-zjunlp
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: analyze-results
Source: https://github.com/zjunlp/Mechanist/tree/main/skills/analyze-results
Command: npx skills add https://github.com/zjunlp/Mechanist --skill analyze-results-zjunlp

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Interpreting raw experiment outputs scattered across JSON and CSV files is tedious and error-prone, especially when comparing runs across models, hyperparameters, and seeds. This Skill automates the analysis workflow so researchers get structured findings instead of manual spreadsheet work. ## Core Features & Use Cases - Result Aggregation: Locates and parses JSON/CSV result files from figures/, results/, or project output directories into structured data. - Comparison Tables: Organizes results by independent variables (model type, hyperparameters, data config) and dependent metrics, always computing delta versus baseline. - Statistical Analysis: Reports mean and standard deviation across seeds, identifies parameter sweep trends, and flags outliers or suspicious results. - Use Case: After running a hyperparameter sweep with three random seeds, ask the Skill to analyze the results directory and receive a comparison table, key findings with interpretations, and suggested follow-up experiments. ## Quick Start Ask the assistant to analyze the experiment results in the results directory and compare them against the baseline.

Frequently Asked Questions about analyze-results

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze ML experiment results across multiple runs?▼

Point the Skill at your results directory and it locates all JSON and CSV result files, parses them into structured data, and builds a comparison table organized by model type, hyperparameters, and metrics with deltas versus baseline.

How to compare experiment results with multiple random seeds?▼

The Skill reports mean plus or minus standard deviation across seeds to check reproducibility. It flags high-variance results and outliers so you can distinguish genuine effects from seed noise.

What output format does the results analysis produce?▼

Output always includes a raw data table, numbered key findings with observation, interpretation, implication, and next step, plus suggested follow-up experiments. Significant findings can be drafted into project documentation updates.

Can it detect trends in hyperparameter sweeps?▼

Yes, when results sweep a parameter the Skill identifies trend shapes such as monotonic, U-shaped, or plateau behavior. It also flags suspicious or outlier data points that may indicate bugs or misconfigured runs.

What file formats does the results analysis support?▼

The Skill parses JSON and CSV result files, searching standard output locations like figures/ and results/ directories as well as project-specific output paths. Other formats would need conversion to JSON or CSV first.