Going Pro in Data Science

Chapter 3. What to Look for in a Data Scientist

A Realistic Skill Set

What’s commonly expected from a data scientist is a combination of subject matter expertise, mathematics, and computer science. This is a tall order and it makes sense that there would be a shortage of people who fit the description. The more knowledge you have, the better. However, I’ve found that the skill set you need to be effective, in practice, tends to be more specific and much more attainable (Figure 3-1). This approach changes both what you look for from data science and what you look for in a data scientist.

A background in computer science helps with understanding software engineering, but writing working data products requires specific techniques for writing solid data science code. Subject matter expertise is needed to pose interesting questions and interpret results, but this is often done in collaboration between the data scientist and subject matter experts (SMEs). In practice, it is much more important for data scientists to be skilled at engaging SMEs in agile experimentation. A background in mathematics and statistics is necessary to understand the details of most machine learning algorithms, but to be effective at applying those algorithms requires a more specific understanding of how to evaluate hypotheses.

Figure 3-1. A more pragmatic view of the required data science skills

Realistic ...