skill-evaluator

Validate Claude Code skill metadata, structure, and content via deterministic rubric.

3|Updated Apr 1, 2026
One-click install
npx skills add https://github.com/anthril/official-claude-plugins --skill skill-evaluator-anthril
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: skill-evaluator
Source: https://github.com/anthril/official-claude-plugins/tree/main/plugins/skillops/skills/skill-evaluator
Command: npx skills add https://github.com/anthril/official-claude-plugins --skill skill-evaluator-anthril

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

A tool to automatically audit Claude Code skills for metadata quality, scope, structure, and content, surfacing actionable findings and consistent reports.

Core Features & Use Cases

  • Validate required frontmatter fields (name, description, argument-hint, allowed-tools, effort) and the skill file structure
  • Enumerate and analyze SKILL.md, reference.md, templates, and example documents to surface quality signals
  • Produce a deterministic Markdown findings report plus a JSON sidecar and a concise chat-ready summary for CI and reviews

Quick Start

Run the evaluator against a target skill directory to produce a Markdown findings report and a JSON sidecar.

Frequently Asked Questions about skill-evaluator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I audit Claude Code skills for metadata and structure quality?▼

You can audit Claude Code skills by validating frontmatter fields, checking required files like SKILL.md, and evaluating content against a deterministic rubric across 8 quality dimensions to generate actionable findings.

What is a deterministic rubric for skill evaluation?▼

A deterministic rubric for skill evaluation applies fixed criteria across 8 quality dimensions to validate metadata, structure, and content, ensuring consistent and repeatable quality audits for Claude Code skills.

How do I validate frontmatter fields in Claude Code skills?▼

Validating frontmatter fields in Claude Code skills involves checking for required metadata keys including name, description, argument-hint, allowed-tools, and effort, automatically identifying missing or invalid entries in the skill files.

Can I generate a markdown report and JSON sidecar for skill quality audits?▼

Yes, you can generate a markdown findings report and a JSON sidecar for skill quality audits, providing a prioritised fixes list and a concise chat-ready summary suitable for CI pipelines and code reviews.

Does the skill evaluation audit modify the source skill files?▼

No, the skill evaluation audit keeps outputs read-only to the source skill, ensuring the original skill files within plugins/*/skills directories remain unmodified during the quality validation process.

What is fast mode in skill quality audits?▼

Fast mode in skill quality audits is an optional setting that skips qualitative review to accelerate the validation process, focusing only on deterministic checks for metadata, structure, and required files.