parallel-execution-patterns

What problem does it solve?

Coordinating parallel data collection across many AWS accounts and regions is complex, error-prone, and slow when done manually. This pattern provides a structured, reusable approach to collect and analyze data at scale with predictable behavior.

Core Features & Use Cases

• Pattern: parallel_collect enables scalable multi-account, multi-region data gathering.
• Rate limiter integration automatically throttles API calls to prevent throttling and errors.
• Callback-driven design allows composing custom collection logic per account and region.
• Progress tracking and resilience provides visibility and retries for large-scale audits and reporting.

Quick Start

Define a callback that receives a session, account_id, account_name, and region, then run it with parallel_collect(ctx, callback, service='your-service').