self-evaluation

Evaluates completed tasks and compares candidate strategies using rule-based self-rewarding and GRPO scoring.

3|2|Updated Feb 13, 2026
One-click install
npx skills add https://github.com/Yoodaddy0311/artibot --skill self-evaluation-yoodaddy0311
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: self-evaluation
Source: https://github.com/Yoodaddy0311/artibot/tree/main/plugins/artibot/skills/self-evaluation
Command: npx skills add https://github.com/Yoodaddy0311/artibot --skill self-evaluation-yoodaddy0311

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Autonomous agent workflows often complete tasks without any quality assessment, so regressions and weak strategies go unnoticed. This Skill provides deterministic, rule-based self-evaluation and group-relative comparison of solution strategies without requiring an external judge AI. ## Core Features & Use Cases - Self-Rewarding Evaluation: Scores completed tasks across four weighted dimensions (accuracy, completeness, efficiency, satisfaction) on a 1-5 scale with letter grades. - GRPO Candidate Comparison: Generates multiple candidate strategies or team compositions, scores them with deterministic rules (exit code, error count, speed, brevity, side effects), ranks them relatively, and updates strategy weights. - Improvement Loop: Compares scores against the last 50 evaluations, identifies weak dimensions, and generates actionable improvement suggestions when scores drop below 3.0. - Use Case: After finishing a build task, evaluate the result, compare five candidate approaches via GRPO, persist updated weights to grpo-history.json, and get a recommendation for the best team composition for the security domain next time. ## Quick Start Ask the agent to evaluate the just-completed task across all four quality dimensions and suggest improvements based on recent evaluation trends.

Frequently Asked Questions about self-evaluation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate task quality without an external judge AI?▼

Use rule-based self-rewarding evaluation that scores output across four weighted dimensions: accuracy (35%), completeness (25%), efficiency (20%), and satisfaction (20%). GRPO adds relative ranking by comparing multiple candidate solutions against deterministic rules like exit codes and error counts.

What is GRPO and how does it optimize agent strategies?▼

GRPO (Group Relative Policy Optimization) generates N candidate solutions for one problem, scores each with deterministic rules, ranks them relative to the group, and updates strategy weights so winning approaches are preferred next time. Weights persist to a local JSON history file.

How do I compare different agent team compositions?▼

Use team GRPO to simulate Solo, Squad, and Platoon configurations with leader, council, swarm, or pipeline patterns. Each composition is scored on success rate, efficiency, resource use, and completeness, then weights are stored per pattern, size, and domain.

When should self-evaluation not be used?▼

Do not run self-evaluation mid-task during active execution phases, since it interrupts ongoing work. It also requires completed task output to score, so it cannot run when there is no finished result or candidate set to compare.

Where are evaluation results and GRPO weights stored?▼

Evaluations persist to ~/.claude/artibot/evaluations.json with a maximum of 500 entries, and GRPO history persists to ~/.claude/artibot/grpo-history.json with a maximum of 300 rounds. Both use local storage with zero external dependencies.