drupal-batch-queue-cron

To process large datasets in Drupal without timing out, use the Batch API for multi-request operations or Queue Workers for asynchronous background processing during cron. This splits heavy work into chunks, preventing request timeouts and managing large datasets efficiently.

Drupal QueueWorker handles scheduled tasks by processing queue items asynchronously during cron runs with time-based execution limits. This ensures bounded operations, running periodic tasks for a set duration like 15 seconds before yielding control back to the system.

Yes, you can separate user-initiated tasks and cron tasks. Use the Drupal Batch API for multi-request operations triggered by users, and use the Queue API with QueueWorker plugins for background tasks processed during scheduled cron runs.

The best way to run periodic cleanup tasks in Drupal is by implementing hook_cron for bounded, scheduled tasks. For heavier cleanup, defer items to a Queue Worker to process asynchronously during cron without exceeding execution time limits.

Yes, the Drupal Queue API supports RequeueException handling to re-queue items that fail during background processing. It also utilizes the Lock API to ensure exclusive operations, preventing duplicate processing of scheduled tasks across concurrent cron runs.