Chapter 9

Sparsity-Aware Learning

Concepts and Theoretical Foundations


This chapter presents the main concepts and theoretical foundations related to sparsity-aware learning techniques. The concept of sparse modeling is introduced together with the LASSO and the 0 and 1 norm minimizing tasks. Conditions for uniqueness of the obtained solutions as well as for the equivalence of the 0 and 1 norm minimization are stated. The RIP condition and related bounds are discussed. Compressed sensing and the notion of stable embeddings are reviewed. The concept of sub-Nyquist sampling is presented and finally a case study concerning image de-nosing is reported.


Sparse modeling


Basis pursuit

0 and 1 norms


Mutual coherence ...

Get Machine Learning now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.