book

Handbook of Image and Video Processing, 2nd Edition

Name: Handbook of Image and Video Processing, 2nd Edition
Author: Alan C. Bovik
ISBN: 9780080533612

by Alan C. Bovik

July 2010

Intermediate to advanced

1384 pages

74h 23m

English

Academic Press

Read now

Unlock full access

Cover image
Title page
Table of Contents
Copyright
Preface
Editor
Contributors
SECTION I: Introduction
Introduction
Chapter 1.1: Introduction to Digital Image and Video Processing
Types of ImagesScale of ImagesDimension of ImagesDigitization of ImagesSampled ImagesQuantized ImagesColor ImagesSize of Image DataDigital VideoSampled VideoVideo TransmissionObjectives of this HandbookOrganization of the HandbookAcknowledgment

SECTION II: Basic Image Processing Techniques
Introduction to Basic Image Processing Techniques
Chapter 2.1: Basic Gray-Level Image Processing
1 Introduction2 Notation3 Image Histogram4 Linear Point Operations on Images5 Nonlinear Point Operations on Images6 Arithmetic Operations Between Images7 Geometric Image Operations
Chapter 2.2: Basic Binary Image Processing
1 Introduction2 Image Thresholding3 Region Labeling4 Binary Image Morphology5 Binary Image Representation and Compression
Chapter 2.3: Basic Tools for Image Fourier Analysis
1 Introduction2 Discrete-Space Sinusoids3 Discrete-Space Fourier Transform4 Two-Dimensional Discrete Fourier Transform5 Understanding Image Frequencies and the Discrete Fourier Transform6 Related Topics in this Handbook
Chapter 2.4: Image Processing Education
1 Introduction2 IP-LAB: A Tool for Teaching Image-Processing Programming in Java Using ImageJ3 Java-based Educational Software for Image and Two-Dimensional Signal Processing4 SIVA — The Signal, Image, and Video Audio-Visualization Gallery5 VcDemo — The Image and Video Compression Learning Tool6 Conclusions
SECTION III: Image and Video Processing
Introduction to Image and Video Processing
Chapter 3.1: Basic Linear Filtering with Application to Image Enhancement
1 Introduction2 Impulse Response, Linear Convolution, and Frequency Response3 Linear Image Enhancement4 Discussion
Chapter 3.2: Nonlinear Filtering for Image Analysis and Enhancement
1 Introduction2 Weighted Median Smoothers and Filters3 Image Noise Cleaning4 Image Zooming5 Image Sharpening6 Edge Detection7 ConclusionAcknowledgment
Chapter 3.3: Morphological Filtering for Image Enhancement and Feature Detection
1 Introduction2 Morphologic Image Operators3 Morphologic Filters for Image Enhancement4 Morphologic Operators for Template Matching5 Morphologic Operators for Feature Detection6 Optimal Design of Morphologic Filters for Enhancement7 ConclusionsAcknowledgment
Chapter 3.4: Wavelet Denoising for Image Enhancement
1 Introduction2 Wavelet Shrinkage Denoising3 Image Enhancement via Wavelet Shrinkage4 Examples5 Image Denoising Using Natural Scene Statistics6 Summary
Chapter 3.5: Basic Methods for Image Restoration and Identification
1 Introduction2 Blur Models3 Image Restoration Algorithms4 Blur Identification AlgorithmsExpectation step:Maximization step:
Chapter 3.6: Regularization in Image Restoration and Reconstruction
1 Introduction2 Direct Regularization Methods3 Iterative Regularization Methods4 Regularization Parameter Choice5 Summary
Chapter 3.7: Multichannel Image Recovery
1 Introduction2 Imaging Model3 Multichannel Image Estimation Approaches4 Explicit Multichannel Recovery Approaches5 Implicit Approach to Multichannel Image RecoveryAcknowledgments
Chapter 3.8: Multi-Frame Image Restoration
1 Introduction2 Mathematic Models3 The Multi-Frame Restoration Problem4 Nuisance Parameters and Blind Restoration5 ApplicationsAcknowledgments
Chapter 3.9: Iterative Image Restoration
1 Introduction2 Iterative Recovery Algorithms3 Spatially Invariant Degradation4 Matrix-Vector Formulation5 Use of Constraints6 Additional Considerations7 Discussion
Chapter 3.10: Motion Detection and Estimation
1 Introduction2 Notation and Preliminaries3 Motion Detection4 Motion Estimation5 Practical Motion Estimation Algorithms6 Perspectives7 Acknowledgments
Chapter 3.11: Video Enhancement and Restoration
1 Introduction2 Spatio-Temporal Noise Filtering3 Blotch Detection and Removal4 Vinegar Syndrome Removal5 Intensity Flicker Correction6 Kinescope Moiré Removal7 Concluding Remarks
Chapter 3.12: Local and Global Stereo Methods
1 Introduction2 Background of Computational Stereo Vision3 A Taxonomy of Stereo Correspondence Algorithms4 ConclusionAcknowledgment
Chapter 3.13: Image Sequence Stabilization, Mosaicking, and Superresolution
1 Introduction2 Biologic Motivation: Insect Navigation3 Global Motion Models4 Algorithm5 Two-Dimensional Stabilization6 Mosaicking7 Motion Superresolution8 Three-Dimensional Stabilization9 Summary
SECTION IV: Image and Video Analysis
Introduction to Image and Video Analysis
Chapter 4.1: Computational Models of Early Human Vision
1 Introduction2 The Front End3 Early Filtering and Parallel Pathways4 The Primary Visual Cortex and Fundamental Properties of Vision5 Concluding Remarks
Chapter 4.2: Multiscale Image Decompositions and Wavelets
1 Overview2 Pyramid Representations3 Wavelet Representations4 Other Multiscale Decompositions5 ConclusionAcknowledgment
Chapter 4.3: Random Field Models
1 Introduction2 Random Fields — Overview3 Multiscale Random Fields4 A Nonlinear/Non-Gaussian Model: the Gaussian MixtureAcknowledgment
Chapter 4.4: AM-FM Image Models: Fundamental Techniques and Emerging Trends
1 Introduction2 Fundamentals of AM-FM Image Modeling3 Practical Techniques for AM-FM Image Modeling4 Emerging Trends in AM-FM Image Modeling5 ConclusionAcknowledgment
Chapter 4.5: Image Noise Models
1 Summary2 Preliminaries3 Elements of Estimation Theory4 Types of Noise and Where They Might Occur5 CCD Imaging6 Speckle7 Conclusions
Chapter 4.6: Color and Multispectral Image Representation and Display
1 Introduction2 Preliminary Notes on Display of Images3 Notation and Prerequisite Knowledge4 Analog Images as Physical Functions5 Colorimetry6 Sampling of Color Signals and Sensors7 Color I/O Device Calibration8 Summary and Future OutlookAcknowledgment
Chapter 4.7: Statistical Modeling of Photographic Images
1 Introduction2 The Gaussian Model3 Wavelet Marginal Models4 Wavelet Joint Models5 Discussion
Chapter 4.8: Statistical Methods for Image Segmentation
1 Introduction2 Image Segmentation: The Mathematic Problem3 Image Statistics for Segmentation4 Statistical Image Segmentation4.2 Aerial Image Segmentation5 Discussion
Chapter 4.9: Multiband Techniques for Texture Classification and Segmentation
1 Introduction2 Gabor Functions3 Microfeature Representation4 The Texture Model5 Experimental Results6 Image Segmentation Using Texture7 Image Retrieval Using Texture8 Texture Motifs9 SummaryAcknowledgments
Chapter 4.10: Video Segmentation
1 Introduction2 Scene Change Detection3 Spatio-Temporal Change Detection4 Motion Segmentation5 Simultaneous Motion Estimation and Segmentation6 Semantic Video Object Segmentation7 ExamplesAcknowledgments
Chapter 4.11: 2D and 3D Motion Tracking in Digital Video
1 Introduction2 Rigid Object Tracking3 Articulated Object TrackingAcknowledgment
Chapter 4.12: Adaptive and Neural Methods for Image Segmentation
1 Introduction2 Artificial Neural Networks3 Perceptual Grouping and Edge-based Segmentation4 Adaptive Multichannel Modeling for Texture-based Segmentation5 An Optimization Framework6 Image Segmentation via Adaptive Clustering7 Oscillation-based Segmentation8 Integrated Segmentation and Recognition9 Concluding RemarksAcknowledgments
Chapter 4.13: Gradient and Laplacian Edge Detection
1 Introduction2 Gradient-based Methods3 Laplacian-based Methods4 Canny’s Method5 Approaches for Color and Multispectral Images6 Summary
Chapter 4.14: Diffusion Partial Differential Equations for Edge Detection
1 Introduction and Motivation2 Background on Diffusion3 Anisotropic Diffusion Techniques4 Application of Anisotropic Diffusion to Edge Detection5 Using Vector Diffusion and Parametric Active Contours to Locate Edges6 Conclusions
Chapter 4.15: Shape Smoothing and PDEs
1 Principles for Shape Smoothing2 Algorithm 1: Dynamic Shape3 Algorithm 2: Iterated Weighted Median Filter4 Algorithm 3: Heat Equation on Curves5 Algorithm 4: Renormalized Heat Equation on Curves6 Algorithm 5: Iterated Affine Erosion7 Bibliographic NotesAcknowledgments
Chapter 4.16: PDEs for Morphological Scale Spaces and Eikonal Applications
1 Introduction2 Multidimensional Morphologic Systems and Slope Transforms3 Partial Differential Equations for Morphologic Scale Spaces4 Curve Evolution, Level Sets, and Morphologic Flows5 Distance Transforms6 Eikonal Partial Differential Equation and Distance Propagation7 Applications of Eikonal Partial Differential Equation8 ConclusionsAcknowledgments
Chapter 4.17: Geometric Active Contours for Image Segmentation
1 Introduction2 Mathematic Notations and Problem Formulation3 From Edge Detectors to Geometric Evolutions4 Calculus of Variations for Geometric Measures5 Gradient Descent in Level Set Formulation6 Efficient Numeric Schemes7 Examples8 Additional Comments on Related Developments9 SummaryAcknowledgments
Chapter 4.18: Software for Image and Video Processing
1 Introduction2 Algorithm Development Environments3 Compiled Libraries4 Source Code5 Specialized Processing and Visualization Environments6 Other Software7 ConclusionAcknowledgements
SECTION V: Image Compression
Introduction to Image Compression
Chapter 5.1: Lossless Coding
1 Introduction2 Basics of Lossless Image Coding3 Lossless Symbol Coding4 Lossless Coding Standards5 Other Developments in Lossless Coding
Chapter 5.2: Block Truncation Coding (BTC)
1 Introduction and Historic Overview2 Basics of BTC3 Moment Preserving Quantization4 Variations and Applications of BTC5 ConclusionsAcknowledgments
Chapter 5.3: Fundamentals of Vector Quantization
1 Introduction2 Theory of Vector Quantization3 Design of Vector Quantizers4 Vector Quantization Implementations5 Structured Vector Quantization6 Mean-Removed Vector Quantization7 Multistage Vector Quantization8 Trellis-Coded Vector Quantization9 Closing Remarks
Chapter 5.4: Wavelet Image Compression
1 What Are Wavelets: Why Are They Good for Image Coding?2 The Compression Problem3 The Transform Coding Paradigm4 Subband Coding: The Early Days5 New and More Efficient Class of Wavelet Coders6 Adaptive Wavelet Transforms: Wavelet Packets7 JPEG2000 and Recent Developments8 Conclusion
Chapter 5.5: Lossy Image Compression: JPEG and JPEG2000 Standards
1 Introduction2 Lossy JPEG Codec Structure3 Discrete Cosine Transform4 Quantization5 Coefficient-to-Symbol Mapping and Coding6 Image Data Format and Components7 Alternative Modes of Operation8 JPEG Part 39 The JPEG2000 Standard10 The JPEG2000 Part 1: Coding Architecture11 JPEG2000 Performance and Extensions12 Additional Information
Chapter 5.6: The JPEG Lossless Image Compression Standards
1 Introduction2 The Original JPEG Lossless Standards3 JPEG-LS Lossless Compression Standard4 JPEG2000 and the Integration of Lossless and Lossy Compression5 Discussion6 Additional Information
Chapter 5.7: Multispectral Image Coding
1 Introduction2 Lossy Compression3 Lossless Compression4 Conclusion
Chapter 5.8: Recovery Methods for Postprocessing of Compressed Images
1 Introduction2 Basic Theory of Projections onto Convex Sets3 Projections onto Convex Sets-Based Image Recovery from Compressed Data4 Maximum A Posteriori Estimation for Postprocessing of Compressed Images5 Conclusions
SECTION VI: Video Compression
Introduction to Video Compression
Chapter 6.1: Basic Concepts and Techniques of Video Coding and the H.261 Standard
1 Introduction2 Introduction to Video Compression3 Video Compression Application Requirements4 Digital Video Signals and Formats5 Video Compression Techniques6 Video Encoding Standards and H.2617 Closing Remarks
Chapter 6.2: Interframe Subband/Wavelet Scalable Video Coding
1 Introduction2 Motion Estimation3 MC Temporal Filtering4 Overlapped Block Motion Compensation5 Scalable Motion Vector Coding6 The EZBC Coder7 Comparing Scalable Coders—Cross-Check Method8 Multiple Adaptations9 Some Visual Results10 Other Improvements and Related Coders11 Conclusions
Chapter 6.3: Digital Video Transcoding
1 Introduction2 Video Transcoding for Bit Rate Reduction3 Heterogeneous Video Transcoding4 Bit Rate Control in Video Transcoding5 Error-Resilient Video Transcoding6 Concluding Remarks
Chapter 6.4: MPEG-1 and MPEG-2 Video Standards
1 MPEG-1 Video Coding Standard2 MPEG-2 Video Coding Standard
Chapter 6.5: MPEG-4, H.264/AVC, and MPEG-7: New Standards for the Digital Video Industry
1 Introduction2 Terminology3 MPEG-4: Technical Description4 MPEG-7: Technical Description5 Conclusions
Chapter 6.6: Embedded Video Codecs
1 Introduction2 Block-based Video Coding3 Embedded Video Codec Design Requirements and Constraints4 Embedded Video Codec Design Flow5 Summary
SECTION VII: Image and Video Acquisition
Introduction to Image and Video Acquisition
Chapter 7.1: Image Scanning, Sampling, and Interpolation
1 Image Capture2 Fourier Analysis of Image Capture3 Sampling Rate Conversion4 Image Interpolation5 Conclusion
Chapter 7.2: Video Sampling and Interpolation
1 Introduction2 Spatiotemporal Sampling Structures3 Sampling and Reconstruction of Continuous Time-Varying Imagery4 Sampling Structure Conversion5 ConclusionFurther Information
SECTION VIII: Image and Video Rendering and Assessment
Introduction to Image and Video Rendering and Assessment
Chapter 8.1: Image Quantization, Halftoning, and Printing
1 Introduction and Printing Technologies2 Scalar Quantization3 Halftoning4 Color Quantization5 Halftone Watermarking and Embedding6 Conclusion
Chapter 8.2: Perceptual Criteria for Image Quality Evaluation
1 Introduction2 Fundamentals of Human Perception and Image Quality3 Visual Models for Image Quality and Compression4 Conclusions
Chapter 8.3: Structural Approaches to Image Quality Assessment
1 Introduction2 The Structural Similarity Index3 Image-Quality Assessment Using a Structural Similarity Index4 Validating Image-Quality Measures5 Concluding Remarks
Chapter 8.4: Information Theoretic Approaches to Image Quality Assessment
1 Introduction2 Mathematic Preliminaries3 Information Fidelity for Quality Assessment of Natural Images4 Implementation Issues5 Results6 Conclusions and Future Work
SECTION IX: Image and Video Storage, Retrieval, and Communication
Introduction to Image and Video Storage, Retrieval, and Communication
Chapter 9.1: Image and Video Indexing and Retrieval
1 Introduction2 Image and Video Features3 From Low-Level Features to High-Level Semantics4 Retrieval Techniques5 Video Access and Browsing6 The MPEG-7 Standard7 Conclusion
Chapter 9.2: A Unified Framework for Video Summarization, Browsing, and Retrieval
1 Introduction2 Terminology3 Video Analysis4 Video Representation5 Video Browsing and Retrieval6 Proposed Framework7 Conclusions and Promising Research DirectionsAcknowledgment
Chapter 9.3: Video Communication Networks
1 Introduction2 Video Compression Standards3 Video Communication Networks4 Internet Protocol Networks5 Summary
Chapter 9.4: Joint Source-Channel Coding for Video Communications
1 Introduction2 On Joint Source-Channel Coding3 Video Compression and Transmission4 Channel Coding5 Joint Source-Channel Coding6 Discussion
Chapter 9.5: Watermarking Techniques for Image Authentication and Copyright Protection
1 Introduction2 Applications of Watermarking Techniques3 Classification of Watermarking Algorithms4 Watermark Embedding, Detection, and Decoding5 Copyright Protection Watermarking6 Image Content Integrity and Authentication WatermarkingAcknowledgment
Chapter 9.6: Visual Cryptography: The Combinatorial and Halftoning Frameworks
1 Introduction2 Visual Secret Sharing3 Visual Steganography4 Other Work and Conclusions
SECTION X: Applications of Image Processing
Introduction to Applications of Image Processing
Chapter 10.1: Synthetic Aperture Radar Algorithms
1 Synthetic Aperture Radar Overview2 Image Formation Algorithms3 Image Enhancement4 Image Exploitation5 Chapter SummaryAcknowledgment
Chapter 10.2: Computed Tomography
1 Introduction2 Background3 2D Image Reconstruction4 Extending 2D Methods into 3D5 3D Image Reconstruction6 Iterative Reconstruction Methods7 Summary
Chapter 10.3: Cardiac Image Processing
1 Introduction2 Coronary Artery Analysis3 Analysis of Cardiac Mechanics and Shape4 Myocardial Blood Flow (Perfusion)5 Electrocardiography6 Summary and View of the FutureAcknowledgments
Chapter 10.4: Computer-Aided Detection and Diagnosis in Mammography
1 Introduction2 Computer-Aided Detection of Mammographic Abnormalities3 Computer-Aided Diagnosis of Mammographic Abnormalities4 Commercial Computer-Aided Detection Systems5 Recent Advances and Future Directions in Breast Cancer Computer-Aided Detection/Computer-Aided DiagnosisAcknowledgments
Chapter 10.5: Fingerprint Classification and Matching
1 Introduction2 Emerging Applications3 Fingerprint as a Biometric4 History of Fingerprints5 System Architecture6 Fingerprint Sensing7 Fingerprint Representation8 Feature Extraction9 Fingerprint Enhancement10 Fingerprint Classification11 Fingerprint Matching12 Summary and Future Prospects
Chapter 10.6: Face Recognition from Still Images and Videos
1 Introduction2 Framework of Probabilistic Identity Characterization3 Instances of Probabilistic Identity Characterization4 ConclusionsAcknowledgment
Chapter 10.7: How Iris Recognition Works
1 Introduction2 Finding an Iris in an Image3 Iris Feature Encoding by Two-Dimensional Wavelet Demodulation4 The Test of Statistical Independence: Combinatorics of Phase Sequences5 Recognizing Irises Regardless of Size, Position, and Orientation6 Uniqueness of Failing the Test of Statistical Independence7 Decision Environment for Iris Recognition8 Speed Performance Summary9 Appendix: Two-Dimensional Focus Assessment at the Video Frame Rate
Chapter 10.8: Exploiting Visual Information in Automatic Speech Processing
1 Introduction2 Analysis of Visual Signals3 Audiovisual Information Fusion4 Audiovisual Automatic Speech Recognition5 Audiovisual Speech Synthesis6 Audiovisual Speaker Recognition7 Summary and Discussion
Chapter 10.9: Confocal Microscopy
1 Introduction2 Image Formation in Confocal Microscopy3 Confocal Fluorescence Microscopy4 Further Considerations5 Types of Confocal Microscopes6 Limitations of Confocal Microscopy7 Biologic Applications of Confocal Microscopy8 Conclusion
Chapter 10.10: Computer-Assisted Microscopy
1 Introduction2 Computer-Assisted Microscopy Systems3 Software for Hardware Control4 Image Processing and Analysis Software5 The Advanced Digital Imaging Research Computerized Microscopy System6 Applications in Clinical Cytogenetics7 ConclusionsAcknowledgments
Chapter 10.11: Statistical Models of Targets and Clutter for Use in Bayesian Object Recognition
1 Introduction2 Statistical Models3 Bayesian Framework4 Pose Location Estimation and Performance5 Target Recognition and Performance6 Discussion7 Acknowledgment
Index

Content preview from Handbook of Image and Video Processing, 2nd Edition

4.12

Adaptive and Neural Methods for Image Segmentation

Joydeep Ghosh, The University of Texas at Austin

1 Introduction

2 Artificial Neural Networks

3 Perceptual Grouping and Edge-based Segmentation

4 Adaptive Multichannel Modeling for Texture-based Segmentation

5 An Optimization Framework

6 Image Segmentation via Adaptive Clustering

7 Oscillation-Based Segmentation

8 Integrated Segmentation and Recognition

9 Concluding Remarks

Acknowledgments

References

1 Introduction

The tremendous amount of research in image processing and analysis over the past three decades has been influenced not only by physiologic or psychophysic discoveries and psychologic observations about perception by living beings, but also by advances in signal processing, ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Multimedia Image and Video Processing, 2nd Edition

Publisher Resources

ISBN: 9780121197926

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Handbook of Image and Video Processing, 2nd Edition

by Alan C. Bovik

Adaptive and Neural Methods for Image Segmentation

1 Introduction

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.