Explore options for composing workflows using Python. In particular, we’ll explore beyond Celery’s asynchronous task processing functionality into its workflow (aka Canvas) system and how it can be used in conjunction with SQLAlchemy’s architecture to provide the building blocks for data stream processing.
SQLAlchemy is the Python SQL toolkit and Object Relational Mapper that gives application developers the full power and flexibility of SQL. Reporting and analysis systems rely on coherent and reliable data, often from disparate sources. To that end, a series of well established data warehousing practices have emerged to extract data and produce a consistent data store.
[youtube AhIoAMltzVw]
Video producer: http://pycon-au.org/