Create PostgreSQL job queues with triggers and LISTEN/NOTIFY.
npx skills add https://github.com/pohlai88/AFENDA --skill graphile-worker
Please help me install this Agent Skill. Skill: graphile-worker Source: https://github.com/pohlai88/AFENDA/tree/main/.agents/skills/graphile-worker Command: npx skills add https://github.com/pohlai88/AFENDA --skill graphile-worker
This Skill addresses the need for efficient, high-performance job queuing directly within PostgreSQL, leveraging triggers and LISTEN/NOTIFY for near real-time job processing.
send_welcome_email job, which is picked up and processed within milliseconds.Use the graphile-worker skill to set up a basic job queue with TypeScript tasks.
High-intent search queries and answers about installing and using this skill.
You can create a PostgreSQL job queue by using database triggers to automatically queue tasks when events occur, ensuring jobs are created atomically with your data changes for transactional consistency.
LISTEN/NOTIFY enables low-latency job pickup by allowing PostgreSQL to push notifications to workers instantly, achieving millisecond job pickup without the overhead of continuous database polling.
Yes, you can implement recurring cron scheduling and batch processing directly within the worker to manage periodic tasks and process multiple jobs efficiently in PostgreSQL.
Key anti-patterns include using polling instead of LISTEN/NOTIFY for job pickup and storing large payloads in the queue, which degrades performance and should be avoided.
Transactional consistency is achieved by adding jobs from SQL within the same transaction as your data changes, ensuring jobs are only queued if the database transaction commits successfully.
Job deduplication prevents duplicate tasks by checking existing queue entries before adding new jobs, ensuring identical background jobs are not processed multiple times concurrently.
gil00pitaConstruct type-safe SQL queries in TypeScript with PostgreSQL, MySQL, and SQLite support.
cosmixOffload long-running tasks to Node.js Bull and Python Celery queues.
adelabdelgawadManage background tasks and scheduled jobs with APScheduler and Celery.
wpankImplement a PostgreSQL job queue with priority scheduling and SKIP LOCKED batch claiming.