doing-a-simple-two-stage-fanout

What problem does it solve?

This Skill tackles the challenge of analyzing massive text, code, or data corpuses that exceed the context window of a single AI agent, ensuring thoroughness and accuracy.

Core Features & Use Cases

• Distributed Analysis: Divides large datasets into manageable segments for parallel processing by multiple 'Worker' agents.
• Quality Assurance: Employs 'Critic' agents to review Worker outputs, identifying gaps, inconsistencies, and cross-segment patterns.
• Synthesis: A 'Summarizer' agent consolidates all reviews into a comprehensive final report.
• Use Case: Analyzing a multi-gigabyte codebase for security vulnerabilities, where each Worker analyzes a subset of files, Critics ensure no vulnerabilities were missed across the entire project, and the Summarizer provides a consolidated report of all findings.

Quick Start

Use the doing-a-simple-two-stage-fanout skill to analyze the corpus located at /path/to/large/dataset.txt with a 'some effort' level of analysis.