Chapter 24

Information Based Learning

José C. Príncipe*, Badong Chen and Luis G. Sanchez Giraldo*,    *Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL, USA,    Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, P.R. China

Keywords

Information theory; Entropy; Divergence; Mutual information; Machine learning; Information theoretic learning

Traditional methods in machine learning and adaptive signal processing mainly exploit second order signal statistics (covariance, image distance, correlation functions, etc.). The emphasis on second order statistics as the choice of optimality ...

Get Academic Press Library in Signal Processing now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.