Skills
.Work. You
Rest

build-evals

Official

Generate LLM eval tests for MCP tool collections.

Software Engineering#automation#testing#code generation#llm#evaluation#mcp
Authorumbraco
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill automates the creation of LLM evaluation tests for your MCP tool collections, ensuring robust and reliable AI agent behavior.

Core Features & Use Cases

  • Automated Test Generation: Creates eval setup and scenario test files based on .discover.json and existing tool definitions.
  • Workflow Testing: Designs and implements tests for CRUD, read-only, search, and hierarchical workflows.
  • Use Case: After defining your Umbraco API tools, use this skill to automatically generate comprehensive LLM evaluation tests, significantly speeding up your development and testing cycle.

Quick Start

Use the build-evals skill to generate LLM eval tests for all MCP tool collections.

Dependency Matrix

Required Modules

None required

Components

references

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: build-evals
Download link: https://github.com/umbraco/Umbraco-MCP-Base/archive/main.zip#build-evals

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.