Chapter 4
Complexities of Data
In This Chapter
Meeting the challenges of big data
Making your data semantically retrievable
Distinguishing between business intelligence and data analytics
Using visualizations to guide the cleaning of data
Your Google search log, tweets, Facebook status updates, and bank statements tell a story about your life. Your geographical locations logged by your cellphone carrier, your most frequent places visited, and your online purchases can define your habits, your preferences, and your personality.
This avalanche of data, being generated at every moment, is referred to as big data, and it’s the main driver of many predictive analytics models. Capturing all different types of data together in one place and applying analytics to it is a highly complex task. However, you might be surprised that only about 1 percent of that data is used for analysis that results in real, valuable results. This 1 percent of big data is actually smart data — the nucleus that makes sense out of big data. Only this 1 percent will make it into the elevator pitch that justifies ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access