Chapter 24

Information Based Learning

José C. Príncipe*, Badong Chen and Luis G. Sanchez Giraldo*,    *Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL, USA,    Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, P.R. China

Keywords

Information theory; Entropy; Divergence; Mutual information; Machine learning; Information theoretic learning

Traditional methods in machine learning and adaptive signal processing mainly exploit second order signal statistics (covariance, image distance, correlation functions, etc.). The emphasis on second order statistics as the choice of optimality ...

Get Academic Press Library in Signal Processing now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.