caveman-manage

Inspect Caveman Cloud experiment lifecycle state and block unsafe lifecycle mutations.

1|Updated May 3, 2021
One-click install
npx skills add https://github.com/leogurja/dotfiles --skill caveman-manage-leogurja
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: caveman-manage
Source: https://github.com/leogurja/dotfiles/tree/main/home/dot_agents/skills/caveman-manage
Command: npx skills add https://github.com/leogurja/dotfiles --skill caveman-manage-leogurja

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Managing eval-gated experiments in Caveman Cloud requires strict evidence checks before any lifecycle change, but the current control API does not yet enforce a complete lifecycle transition table and evidence gate atomically. This Skill ensures every start, approve, cancel, promote, or rollback request is evaluated against read-only evidence and that unsafe execution is blocked rather than silently performed. ## Core Features & Use Cases - Read-only experiment inspection: Load project context, experiment detail, and results via MCP tools (caveman_context, caveman_experiment_get) or the caveman CLI fallback. - Evidence evaluation: Report lifecycle state, safety class, sample sizes, quality results, guardrails (latency, error, cost, retry, drop, escalation), and evidence cost, treating absent fields as incomplete rather than passing. - Action recommendation with hard gates: Propose exactly one of start, approve, cancel, or rollback with explicit blocking rules, and never execute a lifecycle mutation even after user approval. - Use Case: A user asks to approve experiment 7f after seeing positive lift. The Skill reads the results, finds a guardrail report missing, states evidence is incomplete, and refuses to propose approval. ## Quick Start Ask the assistant to review the current state and results of a Caveman experiment and recommend whether it can be approved.

Frequently Asked Questions about caveman-manage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I approve a Caveman Cloud experiment safely?▼

Read the experiment detail and results first, then approve only when evidence is complete, all configured guardrails pass, and the safety class permits the current role. The Skill proposes the approval but blocks execution because the server does not yet enforce lifecycle gates atomically.

How do I check experiment results and guardrails in Caveman Cloud?▼

Use the MCP tools caveman_context and caveman_experiment_get with actions get and results, or fall back to the CLI commands caveman cloud experiments show and results. The Skill reports sample sizes, quality, latency, error, cost, retry, drop, and escalation guardrails.

Can the agent execute experiment lifecycle changes directly?▼

No. The current agent MCP surface is intentionally read-only because the control API does not yet enforce the lifecycle transition table and evidence gate atomically. The Skill proposes one action and explains why execution is blocked.

What happens when experiment evidence is incomplete or missing?▼

Missing required fields are treated as evidence incomplete, not as a pass. The Skill states the gap explicitly and refuses to propose approval until complete passing evidence is available.

Why does a rollback request return cave_not_implemented?▼

Current deployments may honestly reject rollback through the linked policy path with cave_not_implemented. The Skill reports that response verbatim and never describes it as a completed rollback, then re-reads state after any external operator action.