Introduction
Data-driven tools are all around us—they filter our email, they recommend professional connections, they track our music preferences, and they advise us when to tote umbrellas. The more ubiquitous these tools become, the more data we as a culture produce, and the more data there is to parse, store, and analyze for insight. During a keynote talk at Strata + Hadoop World 2015 in New York, Dr. Timothy Howes, chief technology officer at ClearStory Data, said that we can expect to see a 4,300% increase in annual data generated by 2020. But this striking observation isn’t necessarily new.
What is new are the enhancements to data-processing frameworks and tools—enhancements to increase speed, efficiency, and intelligence (in the case of machine learning) to pace the growing volume and variety of data that is generated. And companies are increasingly eager to highlight data preparation and business insight capabilities in their products and services.
What is also new is the rapidly growing user base for big data. According to Forbes, 2014 saw a 123.60% increase in demand for information technology project managers with big data expertise, and an 89.8% increase for computer systems analysts. In addition, we anticipate we’ll see more data analysis tools that non-programmers can use. And businesses will maintain their sharp focus on using data to generate insights, inform decisions, and kickstart innovation. Big data analytics is not the domain of a handful of trailblazing ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access