Chapter 1. AI Meets the Data Stack
In many organizations, the process for pulling insights from enterprise data remains a struggle, requiring users to wrestle with a patchwork of tools. These tools include BI dashboards, SQL editors, data warehouses, ETL pipelines, and governance systems, with each piece coming with its own interface, quirks, and learning curve. Most business folks lack the technical chops to use these tools on their own, so they lean on analysts or engineers to get the job done. For example, a marketing manager who needs a simple conversion trend might still wait several days for a data engineer to adjust a pipeline. Even with modern BI systems, it’s common for insights to lag just enough that they’re less actionable.
The numbers paint a stark picture of just how fragmented today’s data landscape remains. Enterprise analytics teams are now working across an average of 400 data sources. At the upper end, nearly one in five enterprises juggles more than 1,000 data sources. And these figures come from organizations with at least 1,000 or more employees, making these numbers even more striking—these aren’t small companies struggling with limited resources, but established enterprises with significant IT investments.
A 2024 industry survey adds operational texture to the picture. It revealed that more than 70% of data teams rely on five to seven different tools just to get through their daily workflows. About 10% are juggling more than ten. The result is mounting ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access