book

Applied Machine Learning and AI for Engineers

by Jeff Prosise

November 2022

Intermediate to advanced

425 pages

11h 25m

English

O'Reilly Media, Inc.

Book available

Read now

Unlock full access

Who Should Read This BookWhy I Wrote This BookRunning the Book’s Code SamplesNavigating This BookConventions Used in This BookUsing Code ExamplesO’Reilly Online LearningHow to Contact UsAcknowledgments
What Is Machine Learning?Machine Learning Versus Artificial IntelligenceSupervised Versus Unsupervised LearningUnsupervised Learning with k-Means ClusteringApplying k-Means Clustering to Customer DataSegmenting Customers Using More Than Two DimensionsSupervised Learningk-Nearest NeighborsUsing k-Nearest Neighbors to Classify FlowersSummary
Linear RegressionDecision TreesRandom ForestsGradient-Boosting MachinesSupport Vector MachinesAccuracy Measures for Regression ModelsUsing Regression to Predict Taxi FaresSummary
Logistic RegressionAccuracy Measures for Classification ModelsCategorical DataBinary ClassificationClassifying Passengers Who Sailed on the TitanicDetecting Credit Card FraudMulticlass ClassificationBuilding a Digit Recognition ModelSummary
Preparing Text for ClassificationSentiment AnalysisNaive BayesSpam FilteringRecommender SystemsCosine SimilarityBuilding a Movie Recommendation SystemSummary
How Support Vector Machines WorkKernelsKernel TricksHyperparameter TuningData NormalizationPipeliningUsing SVMs for Facial RecognitionSummary
Understanding Principal Component AnalysisFiltering NoiseAnonymizing DataVisualizing High-Dimensional DataAnomaly DetectionUsing PCA to Detect Credit Card FraudUsing PCA to Predict Bearing FailureMultivariate Anomaly DetectionSummary
Consuming a Python Model from a Python ClientVersioning Pickle FilesConsuming a Python Model from a C# ClientContainerizing a Machine Learning ModelUsing ONNX to Bridge the Language GapBuilding ML Models in C# with ML.NETSentiment Analysis with ML.NETSaving and Loading ML.NET ModelsAdding Machine Learning Capabilities to ExcelSummary

Understanding Neural NetworksTraining Neural NetworksSummary
Building Neural Networks with Keras and TensorFlowSizing a Neural NetworkUsing a Neural Network to Predict Taxi FaresBinary Classification with Neural NetworksMaking PredictionsTraining a Neural Network to Detect Credit Card FraudMulticlass Classification with Neural NetworksTraining a Neural Network to Recognize FacesDropoutSaving and Loading ModelsKeras CallbacksSummary
Understanding CNNsUsing Keras and TensorFlow to Build CNNsTraining a CNN to Recognize Arctic WildlifePretrained CNNsUsing ResNet50V2 to Classify ImagesTransfer LearningUsing Transfer Learning to Identify Arctic WildlifeData AugmentationImage Augmentation with ImageDataGeneratorImage Augmentation with Augmentation LayersApplying Image Augmentation to Arctic WildlifeGlobal PoolingAudio Classification with CNNsSummary
Face DetectionFace Detection with Viola-JonesUsing the OpenCV Implementation of Viola-JonesFace Detection with Convolutional Neural NetworksExtracting Faces from PhotosFacial RecognitionApplying Transfer Learning to Facial RecognitionBoosting Transfer Learning with Task-Specific WeightsArcFacePutting It All Together: Detecting and Recognizing Faces in PhotosHandling Unknown Faces: Closed-Set Versus Open-Set ClassificationSummary
R-CNNsMask R-CNNYOLOYOLOv3 and KerasCustom Object DetectionTraining a Custom Object Detection Model with the Custom Vision ServiceUsing the Exported ModelSummary
Text PreparationWord EmbeddingsText ClassificationAutomating Text VectorizationUsing TextVectorization in a Sentiment Analysis ModelFactoring Word Order into PredictionsRecurrent Neural Networks (RNNs)Using Pretrained Models to Classify TextNeural Machine TranslationLSTM Encoder-DecodersTransformer Encoder-DecodersBuilding a Transformer-Based NMT ModelUsing Pretrained Models to Translate TextBidirectional Encoder Representations from Transformers (BERT)Building a BERT-Based Question Answering SystemFine-Tuning BERT to Perform Sentiment AnalysisSummary
Introducing Azure Cognitive ServicesKeys and EndpointsCalling Azure Cognitive Services APIsAzure Cognitive Services ContainersThe Computer Vision ServiceThe Language ServiceThe Translator ServiceThe Speech ServicePutting It All Together: Contoso TravelSummary

Content preview from Applied Machine Learning and AI for Engineers

Chapter 2. Regression Models

You learned in Chapter 1 that supervised learning models come in two varieties: regression models and classification models. You also learned that regression models predict numeric outcomes, such as the price that a home will sell for or the number of visitors a website will attract. Regression modeling is a vital and sometimes underappreciated aspect of machine learning. Retailers use it to forecast demand. Banks use it to screen loan applications, factoring in variables such as credit scores, debt-to-income ratios, and loan-to-value ratios. Insurance companies use it to set premiums. Whenever you need numerical predictions, regression modeling is the right tool for the job.

When building a regression model, the first and most important decision you make is what learning algorithm to use. Chapter 1 presented a simple three-class classification model that used the k-nearest neighbors learning algorithm to identify a species of iris given the flower’s sepal and petal measurements. k-nearest neighbors can be used for regression too, but it’s one of many you can choose from for making numerical predictions. Other learning algorithms frequently produce more accurate models.

This chapter introduces common regression algorithms, many of which can be used for classification also, and guides you through the process of building a regression model that predicts taxi fares using data published by the New York City Taxi and Limousine Commission. It also describes ...