langfuse

Query Langfuse data via CLI and retrieve Langfuse documentation for LLM observability workflows.

1|Updated Jul 4, 2026
One-click install
npx skills add https://github.com/trungenglish/SHOPWISE --skill langfuse-trungenglish
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: langfuse
Source: https://github.com/trungenglish/SHOPWISE/tree/main/.agents/skills/langfuse
Command: npx skills add https://github.com/trungenglish/SHOPWISE --skill langfuse-trungenglish

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires langfuse-cli, and includes references (resource) components.

What problem does it solve? Working with Langfuse requires up-to-date knowledge of its fast-changing APIs, SDKs, and documentation. This Skill gives you programmatic access to Langfuse data (traces, prompts, datasets, scores, sessions) through the langfuse-cli and reliable methods to fetch current Langfuse documentation, so you never implement from outdated memory. ## Core Features & Use Cases - CLI-based API access: Query and modify any Langfuse resource (traces, observations, scores, datasets, prompts) using npx langfuse-cli with schema discovery and credential handling. - Documentation retrieval: Access Langfuse docs via llms.txt index, markdown page fetching, and a search API covering docs plus GitHub issues and discussions. - Use-case playbooks: Dedicated references for instrumenting applications, migrating prompts to Langfuse, capturing user feedback as scores, upgrading SDKs, calibrating LLM-as-a-Judge evaluators, running error analysis on traces, and setting up CI/CD experiment gates. - Use Case: You want to debug why your LLM app's outputs degraded. The Skill pulls recent traces via the CLI, guides you through a structured error analysis with annotation queues, and helps you set up an evaluator — all using current Langfuse APIs. ## Quick Start Ask the assistant to list your recent Langfuse traces or fetch the Langfuse documentation page for the feature you are implementing.

Frequently Asked Questions about langfuse

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I query Langfuse traces from the command line?▼

Use `npx langfuse-cli api traces list` after setting LANGFUSE_PUBLIC_KEY, LANGFUSE_SECRET_KEY, and LANGFUSE_BASE_URL environment variables. Run `npx langfuse-cli api __schema` to discover all available resources and actions.

How do I migrate hardcoded prompts to Langfuse prompt management?▼

Inventory all prompts in your codebase, convert variables to double-brace {{var}} syntax, then create them with `langfuse.create_prompt()` using the production label. Refactor code to fetch prompts with `langfuse.get_prompt()` and call `.compile()` for variable substitution.

Does Langfuse support capturing user feedback like thumbs up/down?▼

Yes, user feedback is stored as scores on traces. Use LangfuseWeb with the public key in the frontend for explicit feedback, or create scores server-side for implicit signals like retries and copies.

How do I upgrade the Langfuse Python SDK from v3 to v4?▼

Fetch the official migration guide first, then replace start_span/start_generation with start_observation, use propagate_attributes() for trace attributes, and move release/environment to environment variables. The SDK also requires Pydantic v2.

Why do Langfuse trace list queries time out on Langfuse Cloud?▼

Broad `traces list` queries can time out on Langfuse Cloud. Use the modern `observations list` endpoint instead, optionally filtering by trace ID, since it offers cursor pagination and better performance.

How do I validate an LLM-as-a-Judge evaluator against human labels?▼

Run the judge prompt as a Langfuse dataset experiment and compare outputs to each item's expectedOutput. Simple mode reports exact-match accuracy; advanced mode computes a confusion matrix with precision, recall, F1, TPR, and TNR.