start-evals

Generate 20 spreadsheet-ready evaluation test cases for AI features.

16|3|Updated Oct 23, 2025
One-click install
npx skills add https://github.com/breethomas/bette-think --skill start-evals
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: start-evals
Source: https://github.com/breethomas/bette-think/tree/main/plugins/bette-think/skills/start-evals
Command: npx skills add https://github.com/breethomas/bette-think --skill start-evals

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Reduce overengineering and uncertainty when validating AI features by providing a concise, repeatable evaluation starter that emphasizes error analysis over premature automation. The approach helps teams quickly surface failure modes with a small, high-value set of tests so they can iterate product and model improvements faster.

Core Features & Use Cases

  • 20-test starter kit: Generates 15 happy-path and 5 edge-case test cases suitable for spreadsheet-driven QA.
  • Pragmatic workflow: Includes a spreadsheet template, run-and-record guidance, and a Week 1 workflow to get results in 30–90 minutes.
  • Scale and next steps: Guidance to graduate from 20→50→200+ tests, options to build an LLM-as-judge, and optional project creation for tracking.
  • Use cases: Validating product recommendations, customer support assistants, summarization features, and retrieval-augmented generation systems.

Quick Start

Type /start-evals "AI product recommendations" to generate 20 spreadsheet-ready test cases, pass/fail criteria, and an actionable evaluation workflow.

Frequently Asked Questions about start-evals

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create test cases for AI feature evaluation?▼

AI evaluation test cases are structured inputs designed to validate specific AI features like recommendation engines or summarization tools. This approach generates 20 spreadsheet-ready tests, including 15 happy-path and 5 edge-case inputs, to surface failure modes with pass/fail criteria during initial QA.

What is the best way to start QA for an AI product recommendation system?▼

The best way to start QA for an AI product recommendation system is applying a focused 20-test starter kit formatted for spreadsheets. This method emphasizes error analysis over premature automation, providing a Week 1 workflow to surface failure modes and iterate model improvements within 30 to 90 minutes.

Can I use spreadsheet-driven QA for RAG pipeline validation?▼

Yes, spreadsheet-driven QA works for RAG pipeline validation by providing 20 structured test cases with pass/fail criteria. This approach fits early-stage retrieval-augmented generation systems, enabling rapid error analysis and product iteration without requiring complex automated testing infrastructure.

How do I scale AI evaluation tests from 20 to 200+ cases?▼

You scale AI evaluation tests from 20 to 200+ cases by following provided graduation guidance to incrementally expand test coverage. The workflow supports this scale-up by introducing options to build an LLM-as-judge for automated scoring and optional Linear project creation for tracking.

Do I need an automated testing framework to validate customer support assistants?▼

No, an automated testing framework is not required to initially validate customer support assistants. A pragmatic spreadsheet-driven workflow using 20 targeted test cases helps you quickly identify failure modes and perform error analysis before investing in premature automation or complex infrastructure.