Video description
Quantopian integrates financial data from vendors around the globe. As the scope of its operations outgrew cron, the company turned to Apache Airflow, a distributed scheduler and task executor. James Meickle explains how in less than six months, Quantopian was able to rearchitect brittle crontabs into resilient, recoverable pipelines defined in code to which anyone could contribute.
Product information
- Title: How Quantopian rearchitected brittle crontabs into resilient pipelines with Apache Airflow
- Author(s):
- Release date: September 2019
- Publisher(s): O'Reilly Media, Inc.
- ISBN: 0636920452669
You might also like
video
Introduction to Kubernetes
If your company is about to embrace containers and develop microservices-type applications, this course will get …
video
Apache Spark with Python - Big Data with PySpark and Spark
This course covers all the fundamentals of Apache Spark with Python and teaches you everything you …
video
Case Study: How Honeycomb used Serverless to Speed Up Its Servers
At Honeycomb, customers send lots of data and then compose complex, ad hoc queries. Most are …
book
Kubernetes: Up and Running
Legend has it that Google deploys over two billion application containers a week. How’s that possible? …
