analyze-mlflow-chat-session
CommunityDebug and analyze chat conversations.
Authorslysik
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill helps debug and analyze multi-turn chat conversations by examining MLflow traces, identifying where conversations went wrong, and reconstructing the interaction flow.
Core Features & Use Cases
- Session Reconstruction: Reconstructs chat conversations from MLflow traces, identifying user inputs and system outputs for each turn.
- Root Cause Analysis: Pinpoints the specific turn where a conversation deviated or an error occurred.
- Assessment Review: Analyzes quality judgments (assessments) attached to traces to identify problematic turns.
- Use Case: When a user reports an incorrect answer in a chatbot, this Skill can trace the conversation history, identify the faulty turn, and analyze the underlying cause, such as outdated retrieved information.
Quick Start
Analyze the MLflow chat session with session ID 'your_session_id' in experiment ID 'your_experiment_id'.
Dependency Matrix
Required Modules
None requiredComponents
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: analyze-mlflow-chat-session Download link: https://github.com/slysik/databricks-claude-coding/archive/main.zip#analyze-mlflow-chat-session Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.