worker-orchestration

What problem does it solve?

This Skill addresses the complexity of managing multiple background tasks by providing a robust system for scheduling, dependency management, and failure handling.

Core Features & Use Cases

• Concurrency Control: Limits the number of simultaneously running workers.
• Dependency Management: Ensures tasks run in the correct order.
• Failure Handling: Automatically disables workers after a set number of consecutive failures.
• Use Case: Coordinate a data ingestion pipeline where fetching data must complete before processing, and processing must complete before archiving, with automatic disabling of any step that repeatedly fails.

Quick Start

Use the worker-orchestration skill to start the orchestrator with a tick interval of 5 seconds and a maximum of 5 concurrent workers.