Distributed Python

Tutorials, strategies and recipes for fast, concurrent, distributed Python
#Celery #Dask #huey #rq #Dramatiq

September 14, 2018

Concurrency and Parallelism

Posted by Bjoern Stiel

Concurrency is often misunderstood and mistaken for parallelism. However, concurrency and parallelism are not the same thing. But why should you care? All you want is to make your Python application fast and responsive. Which you can achieve by distributing it across many CPUs. What difference does it make whether you call it concurrency or parallelism?

Read more...




August 21, 2018

Hack: 2 Ways to make Celery 4 run on Windows

Posted by Bjoern Stiel

Celery no longer officially supports Windows since Celery version 4.x. And while Celery 3 does support Windows, it is not compatible with Celery 4. So if you have to resort to Windows for some (one) of your Celery tasks, you are stuck with a legacy Celery version across your infrastructure. Which is certainly not an acceptable situation.

Read more...


July 10, 2018

Fetch Timeseries From Quandl With Celery and Falcon

Posted by Bjoern Stiel

Falcon is a bare-metal, minimalist Python library for building fast web APIs. Falcon shines with a clean design that embraces HTTP and the REST architectural style. In this blog post, you will learn you to integrate Falcon with Celery. I will show you how to structure your Falcon/Celery project so that is easily maintainable and reusable. And, you will learn...

Read more...


Get distributed Python tips straight to your inbox