langfuse-dataset-setup

What problem does it solve?

This Skill streamlines the process of setting up new datasets within Langfuse, including defining evaluation dimensions, configuring scoring, and preparing judge prompts for LLM-based or human review.

Core Features & Use Cases

• Dataset Creation: Guides users through defining dataset purpose, evaluation dimensions, and method.
• Evaluation Configuration: Provides templates and guidance for setting up score types and judge prompts.
• Use Case: A product manager needs to set up a new dataset for evaluating chatbot responses for accuracy and helpfulness. This Skill helps them define the dataset, configure the scoring metrics, and generate the necessary prompts for an LLM judge.

Quick Start

Use the langfuse dataset setup skill to create a new dataset for evaluating response accuracy and helpfulness.