book

AI and Machine Learning for On-Device Development

by Laurence Moroney

August 2021

Intermediate to advanced

326 pages

8h 31m

English

O'Reilly Media, Inc.

Audiobook available

Read now

Unlock full access

Who Should Read This Book?Why I Wrote This BookNavigating This BookTechnology You Need to UnderstandConventions Used in This BookUsing Code ExamplesO’Reilly Online LearningHow to Contact UsAcknowledgements
What Is Artificial Intelligence?What Is Machine Learning?Moving from Traditional Programming to Machine LearningHow Can a Machine Learn?Comparing Machine Learning with Traditional ProgrammingBuilding and Using Models on MobileSummary
Using Neurons for VisionYour First Classifier: Recognizing Clothing ItemsThe Data: Fashion MNISTA Model Architecture to Parse Fashion MNISTCoding the Fashion MNIST ModelTransfer Learning for Computer VisionSummary
Building a Face Detection App on AndroidStep 1: Create the App with Android StudioStep 2: Add and Configure ML KitStep 3: Define the User InterfaceStep 4: Add the Images as AssetsStep 5: Load the UI with a Default PictureStep 6: Call the Face DetectorStep 7: Add the Bounding RectanglesBuilding a Face Detector App for iOSStep 1: Create the Project in XcodeStep 2: Using CocoaPods and PodfilesStep 3: Create the User InterfaceStep 4: Add the Application LogicSummary
Image Labeling and ClassificationStep 1: Create the App and Configure ML KitStep 2: Create the User InterfaceStep 3: Add the Images as AssetsStep 4: Load an Image to the ImageViewStep 5: Write the Button Handler CodeNext StepsObject DetectionStep 1: Create the App and Import ML KitStep 2: Create the Activity Layout XMLStep 3: Load an Image into the ImageViewStep 4: Set Up the Object Detector OptionsStep 5: Handling the Button InteractionStep 6: Draw the Bounding BoxesStep 7: Label the ObjectsDetecting and Tracking Objects in VideoExploring the LayoutThe GraphicOverlay ClassCapturing the CameraThe ObjectAnalyzer ClassThe ObjectGraphic ClassPutting It All TogetherSummary
Entity ExtractionStart Creating the AppCreate the Layout for the ActivityWrite the Entity Extraction CodePutting It All TogetherHandwriting and Other RecognitionStart the AppCreating a Drawing SurfaceParsing the Ink with ML KitSmart Reply to ConversationsStart the AppMock a ConversationGenerating a Smart ReplySummary
Image Labeling and ClassificationStep 1: Create the App in XcodeStep 2: Create the PodfileStep 3: Set Up the StoryboardStep 4: Edit the View Controller Code to Use ML KitObject Detection in iOS with ML KitStep 1: Get StartedStep 2: Create Your UI on the StoryboardStep 3: Create a Subview for AnnotationStep 4: Perform the Object DetectionStep 5: Handle the CallbackCombining Object Detection with Image ClassificationObject Detection and Tracking in VideoSummary
Entity ExtractionStep 1: Create the App and Add the ML Kit PodsStep 2: Create the Storyboard with Actions and OutletsStep 3: Allow Your View Controller to be Used for Text EntryStep 4: Initialize the ModelStep 5: Extract Entities from TextHandwriting RecognitionStep 1: Create the App and Add the ML Kit PodsStep 2: Create the Storyboard, Actions, and OutletsStep 3: Strokes, Points, and InkStep 4: Capture User InputStep 5: Initialize the ModelStep 6: Do the Ink RecognitionSmart Reply to ConversationsStep 1: Create an App and Integrate ML KitStep 2: Create Storyboard, Outlets, and ActionsStep 3: Create a Simulated ConversationStep 4: Get Smart ReplySummary
What Is TensorFlow Lite?Getting Started with TensorFlow LiteSave the ModelConvert the ModelTesting the Model with a Standalone InterpreterCreate an Android App to Host TFLiteImport the TFLite FileWrite Kotlin Code to Interface with the ModelGoing Beyond the BasicsCreate an iOS App to Host TFLiteStep 1: Create a Basic iOS AppStep 2: Add TensorFlow Lite to Your ProjectStep 3: Create the User InterfaceStep 4: Add and Initialize the Model Inference ClassStep 5: Perform the InferenceStep 6: Add the Model to Your AppStep 7: Add the UI LogicMoving Beyond “Hello World”: Processing ImagesExploring Model OptimizationQuantizationUsing Representative DataSummary
Creating a Model with TensorFlow Lite Model MakerCreating a Model with Cloud AutoMLUsing AutoML Vision EdgeCreating a Model with TensorFlow and Transfer LearningCreating Language ModelsCreate a Language Model with Model MakerSummary

Bridging Models to AndroidBuilding an Image Classification App from a Model Maker OutputUsing a Model Maker Output with ML KitUsing Language ModelsCreating an Android App for Language ClassificationSummary
Bridging Models to iOSA Custom Model Image ClassifierStep 1: Create the App and Add the TensorFlow Lite PodStep 2: Create the UI and Image AssetsStep 3: Load and Navigate Through the Image AssetsStep 4: Load the ModelStep 5: Convert an Image to an Input TensorStep 6: Get Inference for the TensorUse a Custom Model in ML KitBuilding an App for Natural Language Processing in SwiftStep 1: Load the VocabStep 2: Convert the Sentence to a SequenceStep 3: Extend Array to Handle Unsafe DataStep 4: Copy the Array to a Data BufferStep 5: Run Inference on the Data and Process the ResultsSummary
Why Use Firebase Custom Model Hosting?Create Multiple Model VersionsUsing Firebase Model HostingStep 1: Create a Firebase ProjectStep 2: Use Custom Model HostingStep 3: Create a Basic Android AppStep 4: Add Firebase to the AppStep 5: Get the Model from Firebase Model HostingStep 6: Use Remote ConfigurationStep 7: Read Remote Configuration in Your AppNext StepsSummary
A Core ML Image Classifier Built Using Create MLMaking a Core ML App That Uses a Create ML ModelAdd the MLModel FileRun the InferenceUsing Create ML to Build a Text ClassifierUse the Model in an AppSummary
Installing TensorFlow ServingInstalling Using DockerInstalling Directly on LinuxBuilding and Serving a ModelAccessing a Server Model from AndroidAccessing a Server Model from iOSSummary
Ethics, Fairness, and Privacy with Responsible AIResponsibly Defining Your ProblemAvoiding Bias in Your DataBuilding and Training Your ModelEvaluating Your ModelGoogle’s AI PrinciplesSummary

Content preview from AI and Machine Learning for On-Device Development

Index

Symbols

?? output tensor array, Step 5: Perform the Inference

A

accuracy parameter, Coding the Fashion MNIST Model
activation parameter, Coding the Fashion MNIST Model
activity_main.xml file, Step 3: Define the User Interface
adam optimizer, Coding the Fashion MNIST Model
addConversationItem() method, Mock a Conversation
addRectangle function, Step 5: Handle the Callback
AI (artificial intelligence)
- Google’s principles, Google’s AI Principles-Google’s AI Principles
- introduction, What Is Artificial Intelligence?-What Is Artificial Intelligence?
- neural networks, Implementing machine learning in code-Implementing machine learning in code, Using Neurons for Vision-Coding the Fashion MNIST Model, Creating Custom Models, Creating a Model with TensorFlow and Transfer Learning
- responsible, Ethics, Fairness, and Privacy for Mobile Apps-Google’s AI Principles
AI and Machine Learning for Coders (O’Reilly), Building and Using Models on Mobile, Introduction to Computer Vision
analyze function, overriding, The ObjectAnalyzer Class
analyzer, object detection, Capturing the Camera
Android
- accessing server model from, Accessing a Server Model from Android-Accessing a Server Model from Android
- computer vision apps, Computer Vision Apps with ML Kit on Android-Putting It All Together
  - image labeling and classification, Image Labeling and Classification-Next Steps, Going Beyond the Basics-Going Beyond the Basics, Building an Image Classification App from a Model Maker Output-Building an Image Classification App from ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Start your free trial

AI for Healthcare with Keras and Tensorflow 2.0: Design, Develop, and Deploy Machine Learning Models Using Healthcare Data

Anshik

Machine Learning with Core ML

Joshua Newnham

Practical Simulations for Machine Learning

Paris Buttfield-Addison, Mars Buttfield-Addison, Tim Nugent, Jon Manning

Automated Deep Learning Using Neural Network Intelligence: Develop and Design PyTorch and TensorFlow Models Using Python

Ivan Gridin

Publisher Resources

ISBN: 9781098101732Errata Page Supplemental Content

Index

Symbols

A

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,and much more.

You might also like

AI for Healthcare with Keras and Tensorflow 2.0: Design, Develop, and Deploy Machine Learning Models Using Healthcare Data

Machine Learning with Core ML

Practical Simulations for Machine Learning

Automated Deep Learning Using Neural Network Intelligence: Develop and Design PyTorch and TensorFlow Models Using Python

Publisher Resources

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.