caveman-optimize

Evaluates Caveman report-only optimization observations with operator-chosen candidates and paired baseline evaluations.

1|Updated May 3, 2021
One-click install
npx skills add https://github.com/leogurja/dotfiles --skill caveman-optimize-leogurja
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: caveman-optimize
Source: https://github.com/leogurja/dotfiles/tree/main/home/dot_agents/skills/caveman-optimize
Command: npx skills add https://github.com/leogurja/dotfiles --skill caveman-optimize-leogurja

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Caveman optimization reports contain aggregate observations that are easy to misread as savings estimates or ready-made fixes. This Skill enforces an evidence-first workflow that turns a report-only observation into an operator-approved candidate change validated by a paired baseline evaluation, preventing unsupported claims about cost savings or code safety. ## Core Features & Use Cases - Observation Reading: Runs caveman opportunities list and reads only the report_only_observations array, preserving server-provided titles and observations verbatim while rejecting retired profile ids. - Operator-Chosen Selection: Presents supported observations without ranking and requires explicit operator approval before inspecting callsites or editing code. - Paired Baseline Evaluation: Designs and runs baseline versus candidate measurements on identical fixed inputs, recording quality checks, token or byte costs, fixtures, and confounders before keeping or reverting a change. - Use Case: A Caveman report shows a tool-output-size-profile observation. Use this Skill to present it to the operator, design one minimal candidate change at the evidenced callsite, run a paired eval on a fixed fixture, and report keep, reject, or inconclusive without claiming dollar savings. ## Quick Start Ask the assistant to evaluate the current Caveman optimization report and walk through the supported observations for an operator-chosen candidate with a paired baseline evaluation.

Frequently Asked Questions about caveman-optimize

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate a Caveman optimization report?▼

Run `caveman opportunities list` with a logged-in CLI session and read only the `report_only_observations` array. Present the supported observations to the operator for an explicit choice, then design one candidate change with a paired baseline evaluation before editing any code.

What are report-only observations in Caveman?▼

Report-only observations are diagnostic aggregates describing recorded profile shapes, such as context-window or tool-output-size profiles. They are not savings estimates, implementation recipes, or proof that a code change is safe, and they carry an immutable zero dollar band.

Can Caveman observations be converted into dollar savings?▼

No. Token or byte reductions from a local paired eval cannot be converted into dollars without provider-complete, same-request accounting from verified product methods. A local result supports only the stated candidate on the stated fixture, not production savings.

What happens if the Caveman CLI is unavailable or unauthenticated?▼

The workflow stops without editing anything and reports the exact blocker. It does not fall back to a raw gateway Cave Plan or a project API key, because those surfaces do not provide the report-only observation contract.

Why are retired observation ids like context-window-bloat rejected?▼

Retired ids such as context-window-bloat, tool-catalog-utilization, and verbose-tool-output are treated as historical context only. Their money figures, recipes, and lifecycle claims must never be revived or selected for optimization work.

When should unlabeled-traffic be handed off instead of optimized?▼

When the only actionable-looking item is `unlabeled-traffic`, the work is handed off to the caveman-discover skill. Labeling traffic is a discovery task, not a profile optimization, so this Skill does not attempt it.