© Timothy Masters 2018
Timothy MastersData Mining Algorithms in C++https://doi.org/10.1007/978-1-4842-3315-3_1

1. Information and Entropy

Timothy Masters1 
(1)
Ithaca, New York, USA
 

Much of the material in this chapter is extracted from my prior book, Assessing and Improving Prediction and Classification. My apologies to those readers who may feel cheated by this. However, this material is critical to the current text, and I felt that it would be unfair to force readers to buy my prior book in order to procure required background.

The essence of data mining is the discovery of relationships among variables that we have measured. Throughout this book we will explore many ways to find, present, and capitalize on such relationships. In this chapter, ...

Get Data Mining Algorithms in C++: Data Patterns and Algorithms for Modern Applications now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.