One-click install
npx skills add https://github.com/dongzhuoyao/deepresearch --skill wandb-analysis
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: wandb-analysis
Source: https://github.com/dongzhuoyao/deepresearch/tree/main/.codex/skills/wandb-analysis
Command: npx skills add https://github.com/dongzhuoyao/deepresearch --skill wandb-analysis

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Manually reviewing and comparing Weights & Biases experiment runs to extract metrics, verify results, and generate analysis outputs is slow, error-prone, and difficult to scale when working with large numbers of runs, sweeps, or ablation studies.

Core Features & Use Cases

  • Run Comparison & Metric Extraction: Programmatically query the W&B API to pull metrics across runs, compare hyperparameters, seeds, or method variants for paper tables, leaderboards, or internal reporting.
  • Ablation & Sweep Analysis: Isolate component contributions via grouped ablation runs, run statistical significance tests across seeds, and identify top-performing hyperparameter configurations from sweeps.
  • Result Verification & Export: Cross-check reported metrics against actual logged W&B values, export run data to CSV/JSON for offline plotting, and validate git provenance to ensure results match the correct code version.

Quick Start

Use the wandb-analysis skill to pull final accuracy metrics for all finished runs in your W&B project and generate a sorted comparison table for your experiment report.

Frequently Asked Questions about wandb-analysis

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract and compare metrics from multiple W&B experiment runs?▼

To extract and compare W&B experiment metrics, programmatically query the W&B API to pull final values across runs, compare hyperparameters or seeds, and generate sorted comparison tables for papers or reports.

Can I run statistical significance tests across seeds for an ablation study?▼

Yes, ablation study analysis supports isolating component contributions via grouped runs and running statistical significance tests across multiple seeds to validate experiment results.

What is the best way to export Weights & Biases run data for offline plotting?▼

The best way to export W&B run data for offline plotting is to use automated extraction to pull metrics and export the data to standard CSV or JSON formats.

How does hyperparameter sweep analysis identify top-performing configurations?▼

Hyperparameter sweep analysis identifies top configurations by programmatically querying the W&B API to aggregate metrics across runs and isolate the best performing parameter settings.

How do I verify reported ML experiment metrics against actual logged W&B values?▼

Result verification cross-checks reported metrics against actual logged W&B values and validates git provenance to ensure your reported results match the correct code version.