Skills
.Work. You
Rest

langsmith-dataset

Community

Manage LangSmith evaluation datasets.

Software Engineering#testing#llm#rag#evaluation#data management#dataset#langsmith
Authordhar174
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill streamlines the creation, management, and uploading of evaluation datasets to LangSmith, crucial for testing and validating AI models and systems.

Core Features & Use Cases

  • Dataset Management: Create, list, get, export, and delete datasets via the LangSmith CLI.
  • Example Management: Add, list, and delete individual examples within datasets.
  • Dataset Types: Supports various formats like final_response, single_step, trajectory, and rag for comprehensive testing.
  • Use Case: After running a batch of tests, you can use this Skill to export the traces, convert them into a structured dataset format, and upload it back to LangSmith for future regression testing or performance analysis.

Quick Start

Use the langsmith CLI to upload a local JSON file named 'evaluation_data.json' as a new dataset called 'My Test Dataset'.

Dependency Matrix

Required Modules

None required

Components

references

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: langsmith-dataset
Download link: https://github.com/dhar174/langgraph_system_generator/archive/main.zip#langsmith-dataset

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.