book

Hands-On Image Generation with TensorFlow

by Soon Yau Cheong

December 2020

Intermediate to advanced

306 pages

6h 59m

English

Packt Publishing

Read now

Unlock full access

Why subscribe?ContributorsAbout the authorAbout the reviewersPackt is searching for authors like you
Who this book is forHow to use this bookWhat this book coversTo get the most out of this bookDownload the example code filesDownload the color imagesConventions usedGet in touchReviews
Technical requirements Understanding probabilitiesProbability distributionPrediction confidenceThe joint probability of pixelsGenerating faces with a probabilistic modelMean facesConditional probabilityProbabilistic generative modelsParametric modelingBuilding a PixelCNN model from scratchAutoregressive modelsPixelRNNBuilding a PixelCNN model with TensorFlow 2Summary
Technical requirementsLearning latent variables with autoencodersEncoderDecoderBuilding an autoencoderGenerating images from latent variablesVariational autoencodersGaussian distributionSampling latent variablesLoss functionGenerating faces with VAEsNetwork architectureFacial reconstructionGenerating new facesSampling trickControlling face attributesLatent space arithmeticFinding attribute vectorsFace editingSummary
Technical requirementsUnderstanding the fundamentals of GANsThe architecture of a GANValue functionsGAN training stepsBuilding a Deep Convolutional GAN (DCGAN)Architecture guidelinesBuilding a DCGAN for Fashion-MNISTTraining our DCGANChallenges in training GANsUninformative loss and metricsInstabilityVanishing gradientMode collapseBuilding a Wasserstein GANUnderstanding Wasserstein lossImplementing the 1-Lipschitz constraintRestructuring training stepsImplementing gradient penalty (WGAN-GP)Tweaking WGAN-GP for CelebASummary
Technical requirementsConditional GANsImplementing a conditional DCGANVariants of cGANImage translation with pix2pixDiscarding random noiseU-Net as a generatorLoss functionsImplementing a PatchGAN discriminatorTraining pix2pixUnpaired image translation with CycleGANUnpaired datasetCycle consistency lossBuilding CycleGAN modelsAnalysis of CycleGANDiversifying translation with BicyleGANUnderstanding architectureImplementing BicycleGANSummary
Technical requirementsNeural style transferExtracting features with VGGReconstructing contentReconstructing styles with the Gram matrixPerforming neural style transferImproving style transferFaster style transfer with a feed-forward networkA different style featureControlling styles with a normalization layerArbitrary style transfer in real timeImplementing adaptive instance normalizationStyle transfer network architectureArbitrary style transfer trainingIntroduction to style-based GANsMultimodal Unsupervised Image-to-Image Translation (MUNIT)Summary
Technical requirementsIntroduction to iGANUnderstanding manifoldImage editingSegmentation map-to-image translation with GauGANIntroduction to pix2pixHDSpatial Adaptive Normalization (SPADE)Implementing GauGANSummary

Technical requirementsProGAN overviewPixel normalizationIncreasing image variation with minibatch statisticsEqualized learning rateBuilding a ProGANBuilding the generator blocksBuilding the discriminator blocksProgressively growing the networkLoss functionGrowing painsImplementing StyleGANStyle-based generatorImplementing the mapping networkAdding noiseImplementing AdaINBuilding the generator blockTraining StyleGANSummary
Technical requirementsSpectral normalizationUnderstanding spectral normImplementing spectral normalizationSelf-attention modulesSelf-attention for computer visionImplementing a self-attention moduleBuilding a SAGANBuilding a SAGAN generatorConditional batch normalizationBuilding the discriminatorTraining the SAGANImplementing BigGANScaling GANsSkipping latent vectorsShared class embeddingOrthogonal regularizationSummary
Technical requirementsVideo synthesis overviewUnderstanding face video synthesisDeepFake overviewImplementing face image processingExtracting image from videoDetecting and localizing a faceDetecting facial landmarksAligning a faceFace warpingBuilding a DeepFake modelBuilding the encoderBuilding the decoderTraining the autoencodersSwapping facesImproving DeepFakes with GANsSummary
Reviewing GANsOptimizer and activation functionsAdversarial lossAuxiliary lossNormalizationRegularization Putting your skills into practiceDon't trust everything you readHow big is your GPU?Build your model using existing models Understand the model's limitationsImage processingImage inpaintingImage compressionImage super-resolutionText to imageVideo retargetingPose transferMotion transferNeural renderingSummary
Leave a review - let other readers know what you think

Overview

Hands-On Image Generation with TensorFlow is a comprehensive guide to mastering various image generation techniques using deep learning and TensorFlow 2.x. Through practical examples and step-by-step explanations, you will learn how to create and customize generative models to produce vivid, realistic, and artistic images and videos for diverse applications.

What this Book will help me do

Learn to implement and train image generation models like VAEs, DCGANs, StyleGANs, and more using TensorFlow 2.x.
Develop the ability to edit, enhance, and morph facial images using latent space exploration and deepfake techniques.
Master style transfer methods to turn photographs into artistic images resembling famous painter styles.
Explore image-to-image translation utilizing advanced generative models and GAN techniques.
Understand and apply state-of-the-art attention generative models for creating high-quality photorealistic media.

Author(s)

Soon Yau Cheong is a seasoned deep learning practitioner with extensive experience in computer vision and image synthesis technologies. Having worked on a variety of cutting-edge projects in academia and industry, Soon excels at explaining technical concepts with clarity and enthusiasm. His dedication to empowering others to understand and harness advanced technologies shines in his writing and teaching.

Who is it for?

Engineers, researchers, and practitioners in the field of artificial intelligence and computer vision who aim to gain proficiency in generative techniques will benefit most from this book. If you have foundational knowledge of Python programming and TensorFlow and are looking to expand your skills into creating state-of-the-art image and video generative models, this guide is tailored for you.