Skills
.Work. You
Rest

agentv-chat-to-eval

Official

Turn chats into eval tests

Software Engineering#test generation#llm#evaluation#yaml#agentv#chat conversion
AuthorEntityProcess
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill automates the creation of structured evaluation files for the AgentV framework from unstructured chat conversations, saving significant manual effort in test case generation.

Core Features & Use Cases

  • Transcript Conversion: Accepts chat logs in Markdown or JSON formats.
  • Test Case Generation: Identifies key exchanges, derives evaluation criteria, and generates AgentV-compatible YAML test cases.
  • Use Case: You have a lengthy customer support chat log that demonstrates effective problem-solving. Use this Skill to automatically convert those successful interactions into a suite of regression tests for your AI agent.

Quick Start

Use the agentv-chat-to-eval skill to convert the following conversation into an AgentV eval file: User: What is the capital of France? Assistant: The capital of France is Paris.

Dependency Matrix

Required Modules

None required

Components

references

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: agentv-chat-to-eval
Download link: https://github.com/EntityProcess/agentv/archive/main.zip#agentv-chat-to-eval

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.