Evolving Data Infrastructure

Tools and Best Practices for Advanced Analytics and AI

Evolving Data Infrastructure

Get the free ebook

How are companies using or exploring AI, big data, and the cloud for advanced analytics and automation? In an O’Reilly survey conducted in October 2018, more than 3,200 companies throughout the world—located primarily in North America, Europe, and Asia—revealed their choices of tools, technologies, and practices for pursuing sophisticated cloud-based data solutions.

In this report, data science experts Ben Lorica and Paco Nathan break down the results of the survey to reveal how companies are using, building, or evaluating data infrastructure in the cloud. One group of respondents has had a cloud-based data infrastructure for years, while a second group is still exploring the possibilities. Early adopters currently building a cloud-based data infrastructure represent the largest of these three groups.

This report reveals:

  • Foundational data technologies (ETL, data prep, data governance, etc.) that respondents consider most critical for success in machine learning and AI
  • High demand for data scientists and engineers to fill skills gaps
  • How companies use more than one cloud provider to build data infrastructure
  • Streaming and data processing technologies these companies use most
  • The mix of open source and managed services respondents use for business intelligence
  • How many companies are using serverless technologies for data science and machine learning

Please tell us who we’re sharing this with and we’ll email you the ebook.

All fields are required.

Please read our Privacy Policy.
Ben Lorica

Ben Lorica

Ben Lorica is the Chief Data Scientist and Director of Content Strategy for Data at O'Reilly Media, Inc.. He has applied Business Intelligence, Data Mining, Machine Learning and Statistical Analysis in a variety of settings including Direct Marketing, Consumer and Market Research, Targeted Advertising, Text Mining, and Financial Engineering. His background includes stints with an investment management company, internet startups, and financial services.

Paco Nathan

Paco Nathan

Known as a "player/coach", with core expertise in data science, natural language processing, machine learning, cloud computing; 35+ years tech industry experience, ranging from Bell Labs to early-stage start-ups. Co-chair Rev. Advisor for Amplify Partners, Deep Learning Analytics, Recognai, Data Spartan, Primer. Recent roles: Director, Learning Group @ O'Reilly Media; Director, Community Evangelism @ Apache Spark. Cited in 2015 as one of the Top 30 People in Big Data and Analytics<a/> by Innovation Enterprise.