agentos-api-evals
CommunityManage AgentOS evaluations
Authorajshedivy
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill simplifies the process of running, managing, and analyzing evaluations for your AgentOS agents, streamlining performance benchmarking and quality assurance.
Core Features & Use Cases
- Run Evaluations: Execute accuracy, performance, agent-as-judge, and reliability evaluations.
- Manage Evals: List, filter, and retrieve details of past evaluation runs.
- Use Case: Benchmark your new customer support agent against a set of predefined questions to ensure its accuracy and response time meet your standards before deployment.
Quick Start
Use the agentos-api-evals skill to run an accuracy evaluation on 'my-agent' with the input 'What is 2+2?' and expect the output '4'.
Dependency Matrix
Required Modules
None requiredComponents
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: agentos-api-evals Download link: https://github.com/ajshedivy/agno-cookbook/archive/main.zip#agentos-api-evals Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.