background-jobs-queue-expert

# Background Jobs & Queue Expert (BullMQ v5 & Resilient Queues) [English](#english) | [Bahasa Indonesia](#bahasa-indonesia) --- <a name="english"></a> ## English ### Purpose & Overview Production-grade engineering guide for background job queues and asynchronous task processing using **BullMQ v5**, **Trigger.dev v3**, and **Inngest**. Focuses on the core mechanics of fault-tolerant distributed queues: job deduplication, multi-tenant priority queues, exponential backoff jitter, Dead Letter Queue (DLQ) automated forwarding, and strict transactional idempotency. ### Key Capabilities 1. **Strict Idempotency**: Ensuring background workers execute with deterministic effects using database-backed idempotency keys. 2. **Job Deduplication**: Leveraging deterministic BullMQ `jobId` hashing to prevent duplicate enqueueing of ongoing or delayed tasks. 3. **Dead Letter Queues (DLQ)**: Automatic relocation of permanently failing jobs after retry exhaustion for manual inspection and alerting. 4. **Tenant Prioritization**: Differentiating throughput between VIP/enterprise tiers and free-tier users using BullMQ job priorities. 5. **Backoff Jitter & Throttling**: Exponential backoff combined with randomized full jitter to prevent upstream thundering herds. --- ### Production Implementation Recipes #### Recipe 1: Production BullMQ v5 Worker with Deduplication & DLQ Forwarding (TypeScript) ```typescript import { Queue, Worker, Job } from 'bullmq'; import Redis from 'ioredis'; const redi...