ground-truth-evaluation
OfficialValidate Oak's ground truths for precise search.
Authoroaknational
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Evaluate and validate ground truths used by Oak semantic search to ensure alignment with expected results and reliable benchmarks.
Core Features & Use Cases
- Establish a repeatable process to review, adjust, and validate LessonGroundTruth and query-relevance mappings.
- Use during benchmark runs, MRR diagnostics, and COMMIT-based assessments across multiple subjects and datasets.
- Provide governance for data-quality, versioning, and traceability of ground-truth definitions.
Quick Start
Review an Oak semantic-search ground-truth dataset and run COMMIT-based validation to identify gaps and update relevance mappings.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: ground-truth-evaluation Download link: https://github.com/oaknational/oak-open-curriculum-ecosystem/archive/main.zip#ground-truth-evaluation Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.