evaluator

Verify Generator outputs against the Spec with Codex cross-checks.

38|2|Updated Mar 31, 2026
One-click install
npx skills add https://github.com/FlineDev/TandemKit --skill evaluator-flinedev
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: evaluator
Source: https://github.com/FlineDev/TandemKit/tree/main/skills/evaluator
Command: npx skills add https://github.com/FlineDev/TandemKit --skill evaluator-flinedev

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Autonomous quality gate for TandemKit outputs: it verifies the Generator’s work against the Spec and leverages Codex as a second opinion to ensure robust evaluation.

Core Features & Use Cases

  • Independent verification: evaluates Generator results against Spec.md without human-in-the-loop.
  • Codex second opinion: runs Codex in parallel to cross-check findings and prevent rubber-stamping.
  • Round-based convergence: produces Claude-01.md, Claude-02.md, Codex-01.md, and final Round-NN.md artifacts for audit trails.

Quick Start

Invoke the Evaluator with the session command for your mission, e.g., /tandemkit:evaluator 005-AddDarkMode to begin an autonomous evaluation cycle.

Frequently Asked Questions about evaluator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate code verification against a spec?▼

To automate code verification against a spec, you can use an autonomous evaluator that cross-checks Generator outputs against Spec.md. It leverages Codex as a second opinion to ensure robust evaluation without requiring a human-in-the-loop.

How does Codex provide a second opinion for autonomous evaluation?▼

Codex provides a second opinion for autonomous evaluation by running in parallel to cross-check findings. This cross-verification mechanism prevents rubber-stamping and ensures robust evaluation of Generator results against the Spec.

What is the best way to generate audit-ready artifacts for multi-round missions?▼

Generating audit-ready artifacts for multi-round missions is best achieved through a round-based convergence process. This mechanism produces Claude-01.md, Claude-02.md, Codex-01.md, and final Round-NN.md artifacts stored in the Evaluator/Round-NN-Discussion folder.

Can I evaluate generator outputs independently without human intervention?▼

Yes, you can evaluate generator outputs independently without human intervention. The autonomous evaluator verifies Generator results against Spec.md and leverages Codex for a second opinion to ensure strict evidence for each criterion.

Does TandemKit evaluator require strict evidence for each verification criterion?▼

Yes, TandemKit evaluator requires strict evidence for each verification criterion. It reports verdicts with traceable justification and stores all evaluation results and artifacts in the Evaluator/Round-NN-Discussion folder.

How do I start an autonomous evaluation cycle for a TandemKit mission?▼

To start an autonomous evaluation cycle for a TandemKit mission, invoke the Evaluator with your session command. For example, use /tandemkit:evaluator 005-AddDarkMode to begin coordinating planning, generation, and evaluation cycles.