queue-worker

What problem does it solve?

This Skill provides a robust and scalable solution for handling background tasks, ensuring that time-consuming operations do not block the main application flow and are processed reliably.

Core Features & Use Cases

• Background Job Processing: Offload tasks like email sending, report generation, or AI inference to background workers.
• Queue Management: Utilizes Redis for reliable job queuing with priority scheduling and dead-letter queues for failed jobs.
• Worker Lifecycle: Manages worker startup, processing, and graceful shutdown.
• Concurrency Control: Prevents system overload by limiting the number of concurrent jobs.
• Idempotency: Ensures jobs can be retried safely without side effects.
• Use Case: When a user signs up, an email confirmation needs to be sent. Instead of sending it immediately, which could slow down the signup response, the task is added to a queue and processed by a background worker.

Quick Start

Use the queue-worker skill to add a new email sending job to the 'starter:jobs' queue with the payload {'to': 'user@example.com', 'subject': 'Welcome!'}.