distributed-systems

Scaling Celery to handle workflows and multiple queues

Celery is an asynchronous task queue to execute tasks concurrently. As the project grows, scaling celery is a tedious task. In this post, I discuss about how to design workflows with celery and how to scale it.