kr-evaluate

What problem does it solve?

This Skill streamlines the review of engine test results, ensuring thorough categorization of findings and clear distinction between critical issues and potential improvements.

Core Features & Use Cases

• Categorize Findings: Assigns each test result to a specific category (e.g., CORE GAP, LLM QUALITY, EXTENSION OPPORTUNITY).
• Distinguish Gaps: Differentiates between fundamental flaws requiring immediate fixes (CORE GAP) and areas for future enhancement (EXTENSION OPPORTUNITY).
• Owner Spot-Check: Facilitates targeted review of Arabic content and LLM-generated outputs with domain experts.
• Aggregate Assessment: Provides a comprehensive summary of engine reliability, core gaps, lessons learned, and an overall verdict.
• Use Case: After running a batch of tests on a new language engine, use this Skill to systematically analyze the output, identify bugs, document insights, and determine if the engine is ready for the next stage of development.

Quick Start

Use the kr-evaluate skill to review the test output for the 'arabic-names' engine.