arbor

Coordinate iterative artifact improvement against measurable objectives with hypothesis trees and held-out gating.

74|5|Updated Dec 10, 2025
One-click install
npx skills add https://github.com/dralkh/seerai --skill arbor
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: arbor
Source: https://github.com/dralkh/seerai/tree/main/skills/arbor
Command: npx skills add https://github.com/dralkh/seerai --skill arbor

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

It coordinates long-horizon improvement of a concrete artifact against a measurable objective, so you can run many experiments without losing track of what was learned.

Core Features & Use Cases

  • Hypothesis tree planning: organize competing directions, refinements, and negative constraints.
  • Isolated executor runs: test one hypothesis at a time in separate worktrees to avoid cross-contamination.
  • Dev/test gating: use a fast development evaluator during search and admit changes only after held-out confirmation.
  • Use cases: model training recipes, agent harness tuning, data pipelines, benchmark submissions, and prompt optimization.

Quick Start

Ask Arbor to improve your current artifact against a named dev evaluator and held-out test evaluator, then let it run iterative experiments, record evidence, and merge only the changes that generalize.

Frequently Asked Questions about arbor

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I track iterative experiments without losing what was learned?▼

Iterative experiment tracking uses a hypothesis tree to organize competing directions and isolated worktree execution to test one hypothesis at a time, recording evidence to prevent knowledge loss. It coordinates long-horizon improvement of a concrete artifact against a measurable objective.

What is dev/test separation for autonomous optimization?▼

Dev/test separation uses a fast development evaluator during the search phase and admits changes only after held-out confirmation. This merge gating prevents overfitting to evaluator metrics and ensures changes generalize before merging.

How do I run isolated experiments in git worktrees?▼

Isolated worktree execution tests one hypothesis per worktree to avoid cross-contamination between concurrent changes. Each worktree runs independently against a dev evaluator, recording evidence before merging the successful artifact updates.

Can I use this for prompt refinement and agent harness tuning?▼

Yes, prompt refinement and agent harness tuning are core use cases alongside model training recipes, data pipelines, and benchmark submissions. Any task requiring iterative improvement of a concrete artifact against a measurable objective applies.

Do I need a hypothesis tree for structured experiment tracking?▼

Yes, a hypothesis tree is required to organize competing directions, refinements, and negative constraints before executing isolated runs. It structures the search space so that evidence propagation and held-out merge gating can operate effectively.

Why does iterative refinement need held-out merge gating?▼

Held-out merge gating prevents overfitting by only merging changes that pass a separate test evaluator after succeeding on the fast dev evaluator. This ensures iterative artifact improvements generalize rather than just fitting the development metric.