Practical DataOps: Delivering Agile Data Science at Scale

© Harvinder Atwal 2020

H. AtwalPractical DataOpshttps://doi.org/10.1007/978-1-4842-5104-1_9

9. DataOps Technology

Harvinder Atwal¹ 

(1)

Isleworth, UK

 

Technology is deliberately left until the final chapter because while it is essential, it is less critical than people, culture, and processes. If tools were all it took to be successful, then Silicon Valley giants would not open-source their crown jewels such as Kubernetes, TensorFlow, Apache Kafka, and Apache Airflow.

Many organizations assume writing a check to a technology vendor or embracing the latest open-source software is an easy solution to their problems. Technology vendors and sponsors are happy to oblige and perpetuate the myth of silver bullets, and managers are willing to accept it because ...