What problem does it solve?
This Skill simplifies the setup and ongoing management of Bull queue workers, delivering reliable job lifecycle handling, error retries, progress reporting, and Redis connection management across OCR and knowledge processing tasks.
Core Features & Use Cases
- Queue setup and configuration: Centralized Bull queue definitions for knowledge, OCR, and document processing.
- Worker lifecycle & reliability: Concurrency controls, graceful shutdown, and robust retry policies.
- Progress reporting & observability: In-queue progress updates and event hooks for monitoring and metrics.
- Redis connection management: Standardized Redis config with sentinel support and reconnection strategies.
- Use cases: Orchestrate asynchronous document workflows such as OCR preprocessing and knowledge embedding pipelines.
Quick Start
Install dependencies, configure Redis, and start the queue system. Then run your worker script to begin processing jobs. Example:
- Development: npx ts-node src/workers/queueWorker.ts
- Production: node dist/workers/queueWorker.js