book

Python Deep Learning

by Valentino Zocca, Gianmario Spacagna, Daniel Slater, Peter Roelants

April 2017

Intermediate to advanced

406 pages

10h 15m

English

Packt Publishing

Read now

Unlock full access

eBooks, discount offers, and moreWhy subscribe?
What this book covers

Downloading the example codeDownloading the color images of this book
PiracyQuestions
What is machine learning?
Supervised learningUnsupervised learningReinforcement learningSteps Involved in machine learning systemsBrief description of popular techniques/algorithmsLinear regressionDecision treesK-meansNaïve BayesSupport vector machinesThe cross-entropy methodNeural networksDeep learningApplications in real lifeA popular open source package
Why neural networks?
Neurons and layersDifferent types of activation functionThe back-propagation algorithmLinear regressionLogistic regressionBack-propagationApplications in industrySignal processingMedicalAutonomous car drivingBusinessPattern recognitionSpeech productionCode example of a neural network for the function xor
What is deep learning?Fundamental conceptsFeature learningDeep learning algorithms
Speech recognitionObject recognition and classification
TheanoTensorFlowKerasSample deep neural net code using Keras
AutoencodersNetwork designRegularization techniques for autoencodersDenoising autoencodersContractive autoencodersSparse autoencodersSummary of autoencoders
Hopfield networks and Boltzmann machinesBoltzmann machineRestricted Boltzmann machineImplementation in TensorFlowDeep belief networks
Similarities between artificial and biological models
Stride and padding in convolutional layers
Recurrent neural networksRNN — how to implement and trainBackpropagation through timeVanishing and exploding gradientsLong short term memory
Word-based modelsN-gramsNeural language modelsCharacter-based modelPreprocessing and reading dataLSTM networkTrainingSamplingExample training
Speech recognition pipelineSpeech as input dataPreprocessingAcoustic modelDeep belief networksRecurrent neural networksCTCAttention-based modelsDecodingEnd-to-end models
Early game playing AI
A supervised learning approach to games
Q-function
Experience replayEpsilon greedy
Atari Breakout random benchmarkPreprocessing the screenCreating a deep convolutional networkConvergence issues in Q-learningPolicy gradients versus Q-learning
Baseline for variance reductionGeneralized advantage estimator
What is anomaly and outlier detection?
Data modelingDetection modeling
Getting started with H2O
MNIST digit anomaly recognitionElectrocardiogram pulse detection
What is a data product?
Weights initializationParallel SGD using HOGWILD!Adaptive learningRate annealingMomentumNesterov's accelerationNewton's methodAdagradAdadeltaDistributed learning via Map/ReduceSparkling Water
Labeled DataUnlabeled DataSummary of validation
A/B TestingA summary of testing
POJO model exportAnomaly score APIsA summary of deployment

Content preview from Python Deep Learning

Intuition and justification

We have already mentioned in Chapter 3, Deep Learning Fundamentals, the paper published in 2012 by Alex Krizhevsky, Ilya Sutskever, and Geoffrey Hinton titled: ImageNet Classification with Deep Convolutional Neural Networks. Though the genesis of convolutional may be traced back to the '80s, that was one of the first papers that highlighted the deep importance of convolutional networks in image processing and recognition, and currently almost no deep neural network used for image recognition can work without some convolutional layer.

An important problem that we have seen when working with classical feed-forward networks is that they may overfit, especially when working with medium to large images. This is often due ...