queue-worker

Manage Bull queue workers for OCR and knowledge processing tasks.

1|Updated Aug 8, 2025
One-click install
npx skills add https://github.com/Intellifill/IntelliFill --skill queue-worker
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: queue-worker
Source: https://github.com/Intellifill/IntelliFill/tree/main/.claude/skills/queue-worker
Command: npx skills add https://github.com/Intellifill/IntelliFill --skill queue-worker

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill simplifies the setup and ongoing management of Bull queue workers, delivering reliable job lifecycle handling, error retries, progress reporting, and Redis connection management across OCR and knowledge processing tasks.

Core Features & Use Cases

  • Queue setup and configuration: Centralized Bull queue definitions for knowledge, OCR, and document processing.
  • Worker lifecycle & reliability: Concurrency controls, graceful shutdown, and robust retry policies.
  • Progress reporting & observability: In-queue progress updates and event hooks for monitoring and metrics.
  • Redis connection management: Standardized Redis config with sentinel support and reconnection strategies.
  • Use cases: Orchestrate asynchronous document workflows such as OCR preprocessing and knowledge embedding pipelines.

Quick Start

Install dependencies, configure Redis, and start the queue system. Then run your worker script to begin processing jobs. Example:

  • Development: npx ts-node src/workers/queueWorker.ts
  • Production: node dist/workers/queueWorker.js

Frequently Asked Questions about queue-worker

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I set up Bull queue workers for asynchronous OCR task processing?

To set up Bull queue workers for asynchronous OCR task processing, configure Redis, initialize centralized Bull queue definitions, and run the worker script to manage the job lifecycle across document pipelines.

What is the best way to handle retries and progress reporting in Bull queues?

Handling retries and progress reporting in Bull queues involves configuring robust retry policies, utilizing in-queue progress updates, and leveraging lifecycle event hooks for monitoring and metrics.

Does this queue worker approach support Redis sentinel and reconnection strategies?

Yes, this queue worker approach supports Redis sentinel and reconnection strategies by providing standardized Redis configuration to maintain state handling and connection reliability across document processing pipelines.

How do I manage worker concurrency and graceful shutdown in Redis-based queues?

Managing worker concurrency and graceful shutdown in Redis-based queues requires utilizing dedicated worker lifecycle controls to ensure reliable processing and safe termination during knowledge embedding and OCR workflows.

When do I need asynchronous queue orchestration for document processing pipelines?

You need asynchronous queue orchestration for document processing pipelines when executing event-driven workflows like OCR preprocessing and knowledge embedding, ensuring scalable and reliable job execution across distributed workers.