book

OpenCV with Python Blueprints

by Michael Beyeler, Michael Beyeler (USD)

October 2015

Intermediate to advanced

230 pages

5h 10m

English

Packt Publishing

Read now

Unlock full access

Support files, eBooks, discount offers, and moreWhy subscribe?Free access for Packt account holders
What this book covers

Downloading the example code
ErrataPiracyQuestions
Planning the app
Implementing dodging and burning in OpenCVPencil sketch transformation
Color manipulation via curve shiftingImplementing a curve filter by using lookup tablesDesigning the warming/cooling effect
Using a bilateral filter for edge-aware smoothingDetecting and emphasizing prominent edgesCombining colors and outlines to produce a cartoon
Running the appThe GUI base classThe GUI constructorHandling video streamsA basic GUI layoutA custom filter layout
Planning the app
Accessing the Kinect 3D sensorRunning the appThe Kinect GUI
Finding the most prominent depth of the image center regionApplying morphological closing to smoothen the segmentation maskFinding connected components in a segmentation mask
Determining the contour of the segmented hand regionFinding the convex hull of a contour areaFinding the convexity defects of a convex hull
Distinguishing between different causes of convexity defectsClassifying hand gestures based on the number of extended fingers
Tasks performed by the app
Running the appThe FeatureMatching GUI
Feature detectionDetecting features in an image with SURF
Matching features across images with FLANNThe ratio test for outlier removalVisualizing feature matchesHomography estimationWarping the image
Early outlier detection and rejection
Planning the app
The pinhole camera modelEstimating the intrinsic camera parametersThe camera calibration GUIInitializing the algorithmCollecting image and object pointsFinding the camera matrix
The main function routineThe SceneReconstruction3D class
Point matching using rich feature descriptorsPoint matching using optic flowFinding the camera matricesImage rectification
Planning the app
The main function routineThe Saliency classThe MultiObjectTracker class
Fourier analysisNatural scene statisticsGenerating a Saliency map with the spectral residual approachDetecting proto-objects in a scene
Automatically tracking all players on a soccer fieldExtracting bounding boxes for proto-objectsSetting up the necessary bookkeeping for mean-shift trackingTracking objects with the mean-shift algorithm
Planning the app
The training procedureThe testing procedureA classifier base class
Parsing the dataset
Common preprocessingGrayscale featuresColor spacesSpeeded Up Robust FeaturesHistogram of Oriented Gradients
Using SVMs for Multi-class classificationTraining the SVMTesting the SVMConfusion matrixAccuracyPrecisionRecall
Planning the app
Haar-based cascade classifiersPre-trained cascade classifiersUsing a pre-trained cascade classifierThe FaceDetector classDetecting faces in grayscale imagesPreprocessing detected faces
Assembling a training setRunning the screen captureThe GUI constructorThe GUI layoutProcessing the current frameAdding a training sample to the training setDumping the complete training set to a fileFeature extractionPreprocessing the datasetPrincipal component analysisMulti-layer perceptronsThe perceptronDeep architecturesAn MLP for facial expression recognitionTraining the MLPTesting the MLPRunning the script
Summary

Content preview from OpenCV with Python Blueprints

Chapter 1. Fun with Filters

The goal of this chapter is to develop a number of image processing filters and apply them to the video stream of a webcam in real time. These filters will rely on various OpenCV functions to manipulate matrices through splitting, merging, arithmetic operations, and applying lookup tables for complex functions.

The three effects are as follows:

Black-and-white pencil sketch: To create this effect, we will make use of two image blending techniques, known as dodging and burning
Warming/cooling filters: To create these effects, we will implement our own curve filters using a lookup table
Cartoonizer: To create this effect, we will combine a bilateral filter, a median filter, and adaptive thresholding