Skills
.Work. You
Rest

langfuse-annotation-manager

Community

Manage human annotations and scores.

Software Engineering#quality control#scoring#langfuse#annotation#data labeling#trace management
Authormberto10
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill streamlines the process of managing human annotations and scores on traces, enabling efficient quality control and data labeling workflows.

Core Features & Use Cases

  • Create, Update, Delete Scores: Add, modify, or remove scores (numeric, categorical, boolean) for traces.
  • Find Pending Traces: Identify traces that require human review or annotation.
  • Export Annotations: Export scores in JSON or CSV format for analysis.
  • Use Case: You need to gather human feedback on the quality of AI-generated responses. Use this Skill to find traces that haven't been reviewed, assign scores and comments, and then export all annotations for a weekly report.

Quick Start

Use the langfuse-annotation-manager skill to find traces needing review for the 'human_review' score in the last 7 days.

Dependency Matrix

Required Modules

None required

Components

scriptsreferences

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: langfuse-annotation-manager
Download link: https://github.com/mberto10/mberto-compound/archive/main.zip#langfuse-annotation-manager

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.