celery-tasks

What problem does it solve?

Coordinating Celery tasks across multiple queues and workers without a standard pattern leads to fragility, duplication, and hard-to-trace failures. This Skill provides templates, guidance, and anti-patterns to ensure reliable task orchestration in Django and Python apps.

Core Features & Use Cases

• Queue architecture guidance for fast, ETL, and periodic tasks across default, etl, and beat workers.
• Idempotent task patterns, robust retry/backoff, and timeouts to prevent duplicates and runaway tasks.
• Distributed locking, on_commit task queuing, and explicit error handling/recovery strategies for production-grade workflows.
• Practical examples for document processing, data synchronization, and analytics pipelines.

Quick Start

Configure your Django project to use the provided Celery task templates and apply transaction.on_commit to schedule dependent tasks.