Quantopian integrates financial data from vendors around the globe. As the scope of its operations outgrew cron, the company turned to Apache Airflow, a distributed scheduler and task executor. James Meickle explains how in less than six months, Quantopian was able to rearchitect brittle crontabs into resilient, recoverable pipelines defined in code to which anyone could contribute.
Table of contents
- Title: How Quantopian rearchitected brittle crontabs into resilient pipelines with Apache Airflow
- Release date: September 2019
- Publisher(s): O'Reilly Media, Inc.
- ISBN: 0636920452669
You might also like
Building Data Pipelines with Python
This course shows you how to build data pipelines and automate workflows using Python 3. From …
51+ hours of video instruction. Overview The professional programmer’s Deitel® video guide to Python development with …
Amazon Web Services AWS LiveLessons 2nd Edition
More Than 17 Hours of Video Instruction More than 17 hours of video instruction on Amazon …
Python Crash Course, 2nd Edition
This is the second edition of the best selling Python book in the world. Python Crash …