saga-representation-analyzer

What problem does it solve?

This Skill addresses the challenge of understanding and improving the internal reasoning quality of AI models, particularly when direct access to model internals like logprobs is unavailable.

Core Features & Use Cases

• Analyze Reasoning Quality: Evaluates the "straightness" of thought trajectories, the consistency of semantic and reasoning distances, and the curvature of the model's internal representation space.
• Diagnose Bottlenecks: Identifies specific steps or types of issues (knowledge, reasoning, attention, context) hindering AI performance.
• Predict Performance: Estimates task accuracy based on analyzed representation metrics.
• Use Case: When an AI agent's performance dips, this Skill can be used to diagnose whether the issue lies in the model's internal "thinking" process, providing actionable insights for prompt engineering or model fine-tuning.

Quick Start

Use the saga-representation-analyzer skill to diagnose the reasoning quality for the last 10 failed tasks.