validate-candidate

Validate PR flight deployments against head SHA and Loki signals.

4|5|Updated Nov 5, 2025
One-click install
npx skills add https://github.com/cogni-dao/cogni --skill validate-candidate
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: validate-candidate
Source: https://github.com/cogni-dao/cogni/tree/main/.claude/skills/validate-candidate
Command: npx skills add https://github.com/cogni-dao/cogni --skill validate-candidate

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Close the deploy_verified loop for a PR flighted to candidate-a. Review the PR, confirm the candidate-a build matches the PR head SHA, enumerate impacted surfaces (API routes, UI pages, graphs), exercise each against the real deployed URL using captured authed Playwright state + agent-api-validation patterns, query Loki for observability signals from the agent's own requests, then post an approve/fail scorecard + matrix as a PR comment. Use this skill whenever the user asks to "validate the candidate-a deploy", "prove this PR on candidate-a", "close the deploy_verified loop", runs "/validate-candidate" (with or without a PR number), or asks to manually E2E-test a flighted PR. Explicitly don't use for pre-merge CI checks or local dev testing — this skill runs after candidate-flight has already succeeded.

Core Features & Use Cases

  • Orchestrates post-deploy validation by simulating the candidate flight against the deployed URL and aggregating observability signals.
  • Enumerates impacted surfaces (API routes, UI pages, graphs), and exercises them via Playwright and agent-api-validation patterns.
  • Generates and posts a PR scorecard matrix with clear pass/fail/notes.
  • Supports prompts like '/validate-candidate' or 'validate the candidate-a deploy' to trigger the validation.
  • Enforces hard rules such as zero artifacts on disk during runs and strict observability verification via Loki.

Quick Start

Invoke the skill on the target PR (e.g., /validate-candidate 1080) to run the end-to-end validation and post the resulting scorecard to the PR.

Frequently Asked Questions about validate-candidate

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate a PR flight deployment against live observability signals?▼

You can validate a PR flight deployment by automating end-to-end checks against the live candidate URL, querying Loki for observability data, and executing Playwright-driven tests to generate a pass/fail scorecard.

What is the best way to close the deploy_verified loop for a flighted PR?▼

Closing the deploy_verified loop involves confirming the candidate build matches the PR head SHA, exercising impacted API and UI surfaces, and posting an approve or fail scorecard matrix directly as a PR comment.

When should I run end-to-end PR validation on a candidate deployment?▼

Run end-to-end PR validation after a candidate-flight has already succeeded and the deployment is live, explicitly avoiding pre-merge CI checks or local development testing scenarios.

Do I need captured authentication state to run Playwright E2E checks on a candidate URL?▼

Yes, you need captured authentication state, authenticated gh CLI, Loki access, and a live deployed candidate URL per node to successfully execute Playwright checks and verify observability signals.

Does PR validation with observability write artifacts to disk during the run?▼

No, the PR validation process enforces zero-disk-artifact runs, ensuring the final scorecard and matrix are generated and posted without writing any files to the local disk.

How do I enumerate impacted surfaces like API routes and UI pages during PR validation?▼

Enumerating impacted surfaces involves analyzing the PR changes to identify affected API routes, UI pages, and graphs, then exercising them via Playwright and agent-api-validation patterns against the deployed URL.