genesis-evals

Automate Genesis self-eval suite scoring with parallel sub-agents.

61|9|Updated Apr 25, 2026
One-click install
npx skills add https://github.com/danielmeppiel/genesis --skill genesis-evals
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: genesis-evals
Source: https://github.com/danielmeppiel/genesis/tree/main/dev/skills/genesis-evals
Command: npx skills add https://github.com/danielmeppiel/genesis --skill genesis-evals

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyyaml, jsonschema, and includes scripts (resource) components.

What problem does it solve?

Automates maintainer-side evaluation of Genesis changes by running and scoring the self-eval suite, ensuring PR and catalogue changes are validated before shipping.

Core Features & Use Cases

  • Orchestrates parallel cold-spawn sub-agents to execute the genesis self-eval scenarios.
  • Applies deterministic scoring and convergence checks to guarantee stable, repeatable results.
  • Produces a run summary with a verifiable run-id to support PR verification and audit trails.

Quick Start

Install and invoke the maintainer eval workflow to validate a PR or catalogue update.

Frequently Asked Questions about genesis-evals

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate maintainer-side evaluation and scoring for pull request changes?▼

Automating maintainer-side evaluation requires running the self-eval suite to validate PR changes, applying deterministic scoring and convergence checks across parallel sub-agents to guarantee stable, repeatable results before shipping.

What is a cold-spawn sub-agent orchestration workflow for automated evaluation?▼

Cold-spawn sub-agent orchestration runs parallel scenarios independently, generating pre-spawn records and applying explicit model prompts to ensure isolated, deterministic evaluation without user-facing context leakage.

How do I validate catalogue or PR updates with deterministic convergence checks?▼

Validating PR updates involves running parallel sub-agents that apply deterministic scoring, reporting convergence within a maximum of three iteration loops to ensure stable results and produce an auditable run summary.

Does the eval suite require loading external skills context into the user-facing bundle?▼

The loaded-skills context remains explicitly outside the user-facing bundle to prevent context leakage, ensuring that evaluation prompts and pre-spawn records stay isolated during the scoring process.

Do I need pyyaml and jsonschema to run automated evaluation orchestration scripts?▼

Yes, the orchestration scripts depend on pyyaml and jsonschema to parse configuration and validate schemas during the automated evaluation and deterministic scoring workflow.

Why does automated PR evaluation limit convergence to a maximum of three iteration loops?▼

Limiting convergence to three iteration loops ensures repeatable, stable scoring results while bounding the computational overhead of parallel sub-agent execution during the evaluation cycle.