book

OpenCV with Python Blueprints

by Michael Beyeler, Michael Beyeler (USD)

October 2015

Intermediate to advanced

230 pages

5h 10m

English

Packt Publishing

Read now

Unlock full access

Support files, eBooks, discount offers, and moreWhy subscribe?Free access for Packt account holders
What this book covers

Downloading the example code
ErrataPiracyQuestions
Planning the app
Implementing dodging and burning in OpenCVPencil sketch transformation
Color manipulation via curve shiftingImplementing a curve filter by using lookup tablesDesigning the warming/cooling effect
Using a bilateral filter for edge-aware smoothingDetecting and emphasizing prominent edgesCombining colors and outlines to produce a cartoon
Running the appThe GUI base classThe GUI constructorHandling video streamsA basic GUI layoutA custom filter layout
Planning the app
Accessing the Kinect 3D sensorRunning the appThe Kinect GUI
Finding the most prominent depth of the image center regionApplying morphological closing to smoothen the segmentation maskFinding connected components in a segmentation mask
Determining the contour of the segmented hand regionFinding the convex hull of a contour areaFinding the convexity defects of a convex hull
Distinguishing between different causes of convexity defectsClassifying hand gestures based on the number of extended fingers
Tasks performed by the app
Running the appThe FeatureMatching GUI
Feature detectionDetecting features in an image with SURF
Matching features across images with FLANNThe ratio test for outlier removalVisualizing feature matchesHomography estimationWarping the image
Early outlier detection and rejection
Planning the app
The pinhole camera modelEstimating the intrinsic camera parametersThe camera calibration GUIInitializing the algorithmCollecting image and object pointsFinding the camera matrix
The main function routineThe SceneReconstruction3D class
Point matching using rich feature descriptorsPoint matching using optic flowFinding the camera matricesImage rectification
Planning the app
The main function routineThe Saliency classThe MultiObjectTracker class
Fourier analysisNatural scene statisticsGenerating a Saliency map with the spectral residual approachDetecting proto-objects in a scene
Automatically tracking all players on a soccer fieldExtracting bounding boxes for proto-objectsSetting up the necessary bookkeeping for mean-shift trackingTracking objects with the mean-shift algorithm
Planning the app
The training procedureThe testing procedureA classifier base class
Parsing the dataset
Common preprocessingGrayscale featuresColor spacesSpeeded Up Robust FeaturesHistogram of Oriented Gradients
Using SVMs for Multi-class classificationTraining the SVMTesting the SVMConfusion matrixAccuracyPrecisionRecall
Planning the app
Haar-based cascade classifiersPre-trained cascade classifiersUsing a pre-trained cascade classifierThe FaceDetector classDetecting faces in grayscale imagesPreprocessing detected faces
Assembling a training setRunning the screen captureThe GUI constructorThe GUI layoutProcessing the current frameAdding a training sample to the training setDumping the complete training set to a fileFeature extractionPreprocessing the datasetPrincipal component analysisMulti-layer perceptronsThe perceptronDeep architecturesAn MLP for facial expression recognitionTraining the MLPTesting the MLPRunning the script
Summary

Content preview from OpenCV with Python Blueprints

Putting it all together

In order to run our app, we will need to execute the main function routine (in chapter7.py) that loads the pre-trained cascade classifier and the pre-trained multi-layer perceptron, and applies them to each frame of the webcam live stream.

However, this time, instead of collecting more training samples, we will select the radio button that says Test. This will trigger an EVT_RADIOBUTTON event, which binds to FaceLayout._on_testing, disabling all training-related buttons in the GUI and switching the app to the testing mode. In this mode, the pre-trained MLP classifier is applied to every frame of the live stream, trying to predict the current facial expression.

As promised earlier, we now return to FaceLayout._process_frame ...