celery-worker

What problem does it solve?

This Skill provides a production-ready setup for Celery workers, ensuring reliable background task processing, efficient queue management, and robust error handling for distributed systems.

Core Features & Use Cases

• Reliable Task Execution: Ensures tasks are processed even if workers crash, using task_acks_late and reject_on_worker_lost.
• Performance Optimization: Configures worker concurrency, prefetching, and time limits to prevent hung tasks.
• Queue Management: Enables routing tasks to specific queues for better workload separation and prioritization.
• Use Case: When building a web application that needs to send emails, process uploaded files, or perform long-running computations, this Skill helps configure the background job system to handle these tasks efficiently and reliably.

Quick Start

Configure your Celery application by importing the provided celery_app.py and defining your tasks in the tasks/ directory.