sddl-eval-level-2

Runs provider-native behavioral probes evaluating sdd-lite triggers, routing, and session isolation.

Updated Apr 2, 2026
One-click install
npx skills add https://github.com/nico0695/ai-tools --skill sddl-eval-level-2-nico0695
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: sddl-eval-level-2
Source: https://github.com/nico0695/ai-tools/tree/main/sdd/sdd-lite-evals/skills/sddl-eval-level-2
Command: npx skills add https://github.com/nico0695/ai-tools --skill sddl-eval-level-2-nico0695

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve? Verifying that sdd-lite orchestration changes (prompts, wrappers, routing, handoffs) actually behave correctly in real CLI sessions is hard to do without contaminating the evaluation context. This Skill runs behavioral probes in fresh child sessions of the active CLI so regressions are caught with clean, unbiased evidence. ## Core Features & Use Cases - Isolated child-session probes: Evaluates triggers, wrappers, routing, worker bypass, resume, approvals, and main stage prompts in fresh sessions of the active provider CLI. - Cost preview before execution: Runs a dry-run preview showing probe names and child-session counts, requiring explicit confirmation before executing paid runs. - Structured analysis reports: Produces a normalized analysis YAML covering provider-specific prompt incompatibilities, route deviations, isolation failures, and recommendations, then attaches it to regenerate reports and history. - Use Case: After modifying an orchestrator prompt or routing rule, run a smoke-profile Level 2 evaluation against your active provider to confirm triggers fire correctly and worker bypass isolation still holds before shipping the change. ## Quick Start Run a Level 2 smoke evaluation for my workspace and case against the active provider, show me the cost preview first, then execute and attach the completed analysis.

Frequently Asked Questions about sddl-eval-level-2

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run a Level 2 sdd-lite evaluation?▼

Run the sddl_eval.py level2 command with your workspace, case, provider, and profile (smoke or full), first without --execute to preview probes and child-session counts. After confirming the preview, repeat the command with --execute to run the probes.

What does the sdd-lite Level 2 evaluation test?▼

It tests triggers, wrappers, routing, worker bypass, resume behavior, approvals, and main stage prompts in fresh child sessions of the active CLI. This verifies orchestration changes behave correctly without contaminating the evaluation context.

When should I run Level 2 evaluation instead of Level 1?▼

Run Level 2 after prompt, orchestrator, wrapper, handoff, routing, or canonical skill changes, and only when Level 1 is neither BLOCKED nor FAIL. Level 2 adds behavioral probing in real provider sessions beyond static checks.

Does the Level 2 evaluation control API costs?▼

No, there is no automatic cost cap and the CLI default model is used for child sessions. The skill requires a cost preview run first and waits for explicit user confirmation before executing paid probes.

What are the limitations of the Level 2 evaluation analysis?▼

The analysis must mark unobservable behaviors as not_observable and cannot claim unobserved file reads or expose hidden reasoning. It only reads the normalized run report and the event files needed to explain failures.