Feature Engineering Made Easy

Feature improvement – cleaning datasets

In this topic, we take the results of our understanding of the data and use them in order to clean the dataset. Much of this book will flow in such a way, using results from previous sections to be able to work on current sections. In feature improvement, our understanding will allow us to begin our first manipulations of datasets. We will be using mathematical transformations to enhance the given data, but not remove or insert any new attributes (this is for the next chapters).

We will explore several topics in this section, including:

• Structuring unstructured data
• Data imputing—inserting data where there was not a data before (missing data)
• Normalization of data:
  • Standardization (known as z-score ...