dspy-evaluation-suite
CommunityComprehensive DSPy evaluation suite
AuthorOmidZamani
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill provides a framework to measure DSPy program performance using built-in and custom metrics with parallel execution.
Core Features & Use Cases
- Built-in metrics such as answer_exact_match and SemanticF1
- Custom metrics with multi-factor scoring
- Production-grade evaluation workflow and reporting
Quick Start
Instantiate Evaluate with a devset and metric, then run evaluator(program) to obtain a score and results; optionally compare multiple programs and export reports.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: dspy-evaluation-suite Download link: https://github.com/OmidZamani/dspy-skills/archive/main.zip#dspy-evaluation-suite Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.