opp-eval

Aggregate per-skill eval verdicts into run-level scorecards with weighted category scores.

1|2|Updated Apr 1, 2026
One-click install
npx skills add https://github.com/jjackson/ace --skill opp-eval
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: opp-eval
Source: https://github.com/jjackson/ace/tree/main/skills/opp-eval
Command: npx skills add https://github.com/jjackson/ace --skill opp-eval

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Consolidates individual per-skill evaluation verdicts into a single run-level scorecard to reveal overall health of an opportunity and point to improvement areas.

Core Features & Use Cases

  • Aggregate per-skill verdicts across modes (--quick, --deep, --monitor) into a single scorecard.
  • Produce per-skill breakdowns, identify the weakest dimensions, and surface improvement recommendations.
  • Generate both machine-readable verdict YAML and human-readable scorecards for governance and operator reviews.

Quick Start

Run opp-eval after an opportunity run to generate the run-level scorecard and recommendations.

Frequently Asked Questions about opp-eval

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I aggregate per-skill evaluation verdicts into a run-level scorecard?▼

You aggregate per-skill evaluation verdicts into a run-level scorecard by reading individual verdict files, computing weighted category scores, and handling missing data gracefully to output both machine-readable YAML and human-readable scorecards.

What is a run-level scorecard for opportunity evaluation?▼

A run-level scorecard for opportunity evaluation consolidates individual per-skill verdicts to reveal overall opportunity health, identify the weakest dimensions, and surface improvement recommendations for governance reviews.

How do I generate machine-readable verdict YAML from opportunity evaluations?▼

You generate machine-readable verdict YAML from opportunity evaluations by running an aggregation process across per-skill verdicts that computes weighted category scores and writes structured YAML files alongside human-readable scorecards.

Does opportunity evaluation support different evaluation modes like quick and deep?▼

Opportunity evaluation supports --quick, --deep, and --monitor modes, allowing you to aggregate per-skill verdicts across different analysis depths to produce both machine-readable and human-readable scorecards.

How are missing data points handled when computing weighted category scores?▼

Missing data points are handled gracefully when computing weighted category scores, ensuring the aggregation process continues to produce a complete run-level scorecard without failing on incomplete per-skill verdict files.