book

AI and Machine Learning for Coders

by Laurence Moroney

October 2020

Intermediate to advanced

392 pages

9h 36m

English

O'Reilly Media, Inc.

Audiobook available

Read now

Unlock full access

Who Should Read This BookWhy I Wrote This BookNavigating This BookTechnology You Need to UnderstandOnline ResourcesConventions Used in This BookUsing Code ExamplesO’Reilly Online LearningHow to Contact UsAcknowledgments
What Is Machine Learning?Limitations of Traditional ProgrammingFrom Programming to LearningWhat Is TensorFlow?Using TensorFlowInstalling TensorFlow in PythonUsing TensorFlow in PyCharmUsing TensorFlow in Google ColabGetting Started with Machine LearningSeeing What the Network LearnedSummary
Recognizing Clothing ItemsThe Data: Fashion MNISTNeurons for VisionDesigning the Neural NetworkThe Complete CodeTraining the Neural NetworkExploring the Model OutputTraining for Longer—Discovering OverfittingStopping TrainingSummary
ConvolutionsPoolingImplementing Convolutional Neural NetworksExploring the Convolutional NetworkBuilding a CNN to Distinguish Between Horses and HumansThe Horses or Humans DatasetThe Keras ImageDataGeneratorCNN Architecture for Horses or HumansAdding Validation to the Horses or Humans DatasetTesting Horse or Human ImagesImage AugmentationTransfer LearningMulticlass ClassificationDropout RegularizationSummary
Getting Started with TFDSUsing TFDS with Keras ModelsLoading Specific VersionsUsing Mapping Functions for AugmentationUsing TensorFlow AddonsUsing Custom SplitsUnderstanding TFRecordThe ETL Process for Managing Data in TensorFlowOptimizing the Load PhaseParallelizing ETL to Improve Training PerformanceSummary
Encoding Language into NumbersGetting Started with TokenizationTurning Sentences into SequencesRemoving Stopwords and Cleaning TextWorking with Real Data SourcesGetting Text from TensorFlow DatasetsGetting Text from CSV FilesGetting Text from JSON FilesSummary
Establishing Meaning from WordsA Simple Example: Positives and NegativesGoing a Little Deeper: VectorsEmbeddings in TensorFlowBuilding a Sarcasm Detector Using EmbeddingsReducing Overfitting in Language ModelsUsing the Model to Classify a SentenceVisualizing the EmbeddingsUsing Pretrained Embeddings from TensorFlow HubSummary
The Basis of RecurrenceExtending Recurrence for LanguageCreating a Text Classifier with RNNsStacking LSTMsUsing Pretrained Embeddings with RNNsSummary

Turning Sequences into Input SequencesCreating the ModelGenerating TextPredicting the Next WordCompounding Predictions to Generate TextExtending the DatasetChanging the Model ArchitectureImproving the DataCharacter-Based EncodingSummary
Common Attributes of Time SeriesTrendSeasonalityAutocorrelationNoiseTechniques for Predicting Time SeriesNaive Prediction to Create a BaselineMeasuring Prediction AccuracyLess Naive: Using Moving Average for PredictionImproving the Moving Average AnalysisSummary
Creating a Windowed DatasetCreating a Windowed Version of the Time Series DatasetCreating and Training a DNN to Fit the Sequence DataEvaluating the Results of the DNNExploring the Overall PredictionTuning the Learning RateExploring Hyperparameter Tuning with Keras TunerSummary
Convolutions for Sequence DataCoding ConvolutionsExperimenting with the Conv1D HyperparametersUsing NASA Weather DataReading GISS Data in PythonUsing RNNs for Sequence ModelingExploring a Larger DatasetUsing Other Recurrent MethodsUsing DropoutUsing Bidirectional RNNsSummary
What Is TensorFlow Lite?Walkthrough: Creating and Converting a Model to TensorFlow LiteStep 1. Save the ModelStep 2. Convert and Save the ModelStep 3. Load the TFLite Model and Allocate TensorsStep 4. Perform the PredictionWalkthrough: Transfer Learning an Image Classifier and Converting to TensorFlow LiteStep 1. Build and Save the ModelStep 2. Convert the Model to TensorFlow LiteStep 3. Optimize the ModelSummary
What Is Android Studio?Creating Your First TensorFlow Lite Android AppStep 1. Create a New Android ProjectStep 2. Edit Your Layout FileStep 3. Add the TensorFlow Lite DependenciesStep 4. Add Your TensorFlow Lite ModelStep 5. Write the Activity Code to Use TensorFlow Lite for InferenceMoving Beyond “Hello World”—Processing ImagesTensorFlow Lite Sample AppsSummary
Creating Your First TensorFlow Lite App with XcodeStep 1. Create a Basic iOS AppStep 2. Add TensorFlow Lite to Your ProjectStep 3. Create the User InterfaceStep 4. Add and Initialize the Model Inference ClassStep 5. Perform the InferenceStep 6. Add the Model to Your AppStep 7. Add the UI LogicMoving Beyond “Hello World”—Processing ImagesTensorFlow Lite Sample AppsSummary
What Is TensorFlow.js?Installing and Using the Brackets IDEBuilding Your First TensorFlow.js ModelCreating an Iris ClassifierSummary
JavaScript Considerations for TensorFlow DevelopersBuilding a CNN in JavaScriptUsing Callbacks for VisualizationTraining with the MNIST DatasetRunning Inference on Images in TensorFlow.jsSummary
Converting Python-Based Models to JavaScriptUsing the Converted ModelsUsing Preconverted JavaScript ModelsUsing the Toxicity Text ClassifierUsing MobileNet for Image Classification in the BrowserUsing PoseNetSummary
Transfer Learning from MobileNetStep 1. Download MobileNet and Identify the Layers to UseStep 2. Create Your Own Model Architecture with the Outputs from MobileNet as Its InputStep 3. Gather and Format the DataStep 4. Train the ModelStep 5. Run Inference with the ModelTransfer Learning from TensorFlow HubUsing Models from TensorFlow.orgSummary
What Is TensorFlow Serving?Installing TensorFlow ServingInstalling Using DockerInstalling Directly on LinuxBuilding and Serving a ModelExploring Server ConfigurationSummary
Fairness in ProgrammingFairness in Machine LearningTools for FairnessThe What-If ToolFacetsFederated LearningStep 1. Identify Available Devices for TrainingStep 2. Identify Suitable Available Devices for TrainingStep 3. Deploy a Trainable Model to Your Training SetStep 4. Return the Results of the Training to the ServerStep 5. Deploy the New Master Model to the ClientsSecure Aggregation with Federated LearningFederated Learning with TensorFlow FederatedGoogle’s AI PrinciplesSummary

Content preview from AI and Machine Learning for Coders

Chapter 18. Transfer Learning in JavaScript

In Chapter 17 you explored two methods for getting models into JavaScript: converting a Python-based model and using a preexisting model provided by the TensorFlow team. Aside from training from scratch, there’s one more option: transfer learning, where a model that was previously trained for one scenario has some of its layers reused for another. For example, a convolutional neural network for computer vision might have learned several layers of filters. If it was trained on a large dataset to recognize many classes, it may have very general filters that can be used for other scenarios.

To do transfer learning with TensorFlow.js, there are a number of options, depending on how the preexisting model is distributed. The possibilities fall into three main categories:

If the model has a model.json file, created by using the TensorFlow.js converter to convert it into a layers-based model, you can explore the layers, choose one of them, and have that become the input to a new model that you train.
If the model has been converted to a graph-based model, like those commonly found on TensorFlow Hub, you can connect feature vectors from it to another model to take advantage of its learned features.
If the model has been wrapped in a JavaScript file for easy distribution, this file will give you some handy shortcuts for prediction or transfer learning by accessing embeddings or other feature vectors.

In this chapter, you’ll explore all ...