What strategies do you use to keep the event loop healthy at scale? (offloading, chunking, job queues like BullMQ, worker threads)

For tasks that don't need to be completed before responding to the user (like sending emails, generating reports, or syncing data), the best strategy is to decouple the request from the work using a job queue. A job queue acts as a buffer. The API process quickly adds a job to Redis (the queue) and immediately returns a 202 Accepted response. A separate worker process then picks up the job and executes it.

This pattern is fundamental because it completely isolates the event loop of the API server from the heavy work. Even if the worker crashes, the API remains online. It also enables horizontal scaling: you can run dozens of worker containers without touching your API layer.

A common mistake is running both the HTTP server and the job processor in the same Node.js process. While this works for small projects, it leads to three problems at scale:

The solution is to create two separate entry points for your application: one that calls app.listen() to become an API server, and another that simply loads your modules to become a worker. This allows you to scale each component independently using a process manager like PM2.

If you cannot avoid a long-running synchronous task and cannot move it to a worker, the last resort is chunking. This involves breaking the task into smaller pieces and using setImmediate() to schedule the next piece, yielding control back to the event loop between chunks. This prevents any single operation from blocking for too long.

Finally, you cannot optimize what you cannot measure. Use Node.js's built-in perf_hooks.monitorEventLoopDelay() to track event loop lag as a metric[citation:7]. A healthy event loop should have p99 latency under 20ms[citation:5]. Tools like clinic.js can help profile and identify which functions are causing blockages[citation:2][citation:7].