Chapter 35. Breaking Down Complex Data Preparation Challenges
Previous chapters have discussed techniques for determining the changes required to prepare a data set for analysis, albeit at a relatively simple level. What about those situations where the path isn’t straightforward; how do you approach the problem then? Complex challenges can include building solutions requiring multiple steps, inputting data sources using multiple join conditions, or having to complete many reshaping steps throughout the data prep process. This chapter will cover this exact scenario by taking on one of the most complicated challenges Preppin’ Data has covered to date: 2020: Week 3. The aim of this challenge, created by Jonathan Allenby (my fellow Dr. Prepper), is to turn the National Basketball Association (NBA) game results into the detailed standings you commonly see on websites or in newspapers.
The Challenge
This challenge involves taking the results and building the full conference league tables, including rankings, wins, and losses; recent performance; and even winning streaks (Figure 35-1). This really is a tough challenge with many facets; hence, it’s a great example to use to show you how to break down complex problems into smaller, more manageable pieces.
Figure 35-1. Challenge post for Preppin’ Data 2020: Week 3
As covered in Chapter 3, developing an understanding of the input and ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month, and much more.
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
