Modern Scala Projects

Step 4 – purging the dataset of rows containing question mark characters

Before we go any further, let's eyeball the raw dataset again. If you looked closely, you will notice that the dataset contains a ? character in some places. Actually, this character starts appearing in some rows in the seventh column, starting on the 25^th row. The 25^th row, with the ? character, is displayed in the following diagram. That them is a problem, which needs a solution.

Sometimes, a visual inspection of the dataset can reveal the presence of extraneous characters.

The following is a snapshot of the Wisconsin Breast Cancer Data Set with the ? character in the 25^th row and the sixth column:

Dataset showing ? characters

 

Obviously, it is not just row 25^{th ...}