autoresearch

Automates ML experiments by iteratively modifying train.py and committing git-ratcheted improvements.

Updated Aug 23, 2026
One-click install
npx skills add https://github.com/TheBoomerDev/feedback_proyect --skill autoresearch-theboomerdev
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: autoresearch
Source: https://github.com/TheBoomerDev/feedback_proyect/tree/main/.agents/skills/autoresearch
Command: npx skills add https://github.com/TheBoomerDev/feedback_proyect --skill autoresearch-theboomerdev

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

Autonomous ML experimentation framework that enables an AI agent to iteratively modify train.py, run fixed 5-minute GPU experiments, and commit only improvements via git ratcheting — so you wake up to 100+ experiments and a better model.

Core Features & Use Cases

  • AI-driven loop reads directives, patches train.py, executes an experiment, and logs results for traceability.
  • Reproducible research with git ratcheting and a persistent results.tsv log.
  • Overnight experimentation on single-GPU machines with a strict time budget.

Quick Start

Update program.md with precise directives and run the autonomous loop to begin overnight experiments.

Frequently Asked Questions about autoresearch

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate ML experiments to run overnight on a single GPU?▼

To automate ML experiments overnight, you can use an autonomous loop that iteratively patches train.py, executes fixed 5-minute GPU runs, and logs results. This enables continuous architecture exploration and hyperparameter tuning while you sleep.

What is git ratcheting for reproducible machine learning research?▼

Git ratcheting for reproducible machine learning is a workflow that commits only experimental improvements to train.py. It preserves a monotonic history of successful changes, ensuring traceability and reproducibility of your autonomous ML research results.

How do I set up an autonomous experiment loop for hyperparameter tuning?▼

To set up an autonomous experiment loop, you need a locked evaluation harness in prepare.py and precise directives in program.md. Running the loop then patches train.py, executes time-budgeted experiments, and logs outcomes to a persistent results.tsv file.

Can I run autonomous architecture exploration with a strict time budget per experiment?▼

Yes, autonomous architecture exploration can run with a strict time budget by executing fixed 5-minute GPU experiments. The AI-driven loop patches your training script, evaluates the modification, and only commits changes that yield improvements.

How does an autonomous ML agent decide which training script changes to keep?▼

An autonomous ML agent decides which training script changes to keep by evaluating each 5-minute GPU run against a locked evaluation harness. It uses git ratcheting to commit only modifications that produce measurable improvements, discarding unsuccessful patches.

What are the limitations of running autonomous ML experimentation on a single-GPU machine?▼

Running autonomous ML experimentation on a single-GPU machine limits you to sequential, fixed 5-minute experiments rather than parallel runs. It is designed for overnight research and requires a locked evaluation harness to ensure valid, reproducible comparisons across iterations.