book

TensorFlow 2 Reinforcement Learning Cookbook

Name: TensorFlow 2 Reinforcement Learning Cookbook
Author: Palanisamy
ISBN: 9781838982546

by Palanisamy

January 2021

Intermediate to advanced

472 pages

8h 24m

English

Packt Publishing

Read now

Unlock full access

TensorFlow 2 Reinforcement Learning Cookbook
Why subscribe?ContributorsAbout the authorAbout the reviewerPackt is searching for authors like you
Preface
Who this book is forWhat this book coversTo get the most out of this bookDownload the example code filesDownload the color imagesConventions usedGet in touchReviews
Chapter 1: Developing Building Blocks for Deep Reinforcement Learning Using Tensorflow 2.x
Technical requirementsBuilding an environment and reward mechanism for training RL agentsGetting readyHow to do it…How it works…Implementing neural network-based RL policies for discrete action spaces and decision-making problemsGetting readyHow to do it…How it works…Implementing neural network-based RL policies for continuous action spaces and continuous-control problemsGetting readyHow to do it…How it works…Working with OpenAI Gym for RL training environmentsGetting readyHow to do it…How it works…See alsoBuilding a neural agentGetting readyHow to do it…How it works…Building a neural evolutionary agentGetting readyHow to do it…How it works…See also
Chapter 2: Implementing Value-Based, Policy-Based, and Actor-Critic Deep RL Algorithms
Technical requirementsBuilding stochastic environments for training RL agentsGetting readyHow to do it…How it works…Building value-based reinforcement learning agent algorithmsGetting readyHow to do it…How it works…Implementing temporal difference learningGetting readyHow to do it…How it works…Building Monte Carlo prediction and control algorithms for RLGetting readyHow to do it…How it works…Implementing the SARSA algorithm and an RL agentGetting readyHow to do it…How it works…Building a Q-learning agentGetting readyHow to do it…How it works…Implementing policy gradientsGetting readyHow to do it…How it works…Implementing actor-critic RL algorithmsGetting readyHow to do it…How it works…
Chapter 3: Implementing Advanced RL Algorithms
Technical requirementsImplementing the Deep Q-Learning algorithm, DQN, and Double-DQN agentGetting readyHow to do it…How it works…Implementing the Dueling DQN agentGetting readyHow to do it…How it works…Implementing the Dueling Double DQN algorithm and DDDQN agentGetting readyHow to do it…How it works…Implementing the Deep Recurrent Q-Learning algorithm and DRQN agentGetting readyHow to do it…How it works…Implementing the Asynchronous Advantage Actor-Critic algorithm and A3C agentGetting readyHow to do it…How it works…Implementing the Proximal Policy Optimization algorithm and PPO agentGetting readyHow to do it…How it works…Implementing the Deep Deterministic Policy Gradient algorithm and DDPG agentGetting readyHow to do it…How it works…
Chapter 4: Reinforcement Learning in the Real World – Building Cryptocurrency Trading Agents
Technical requirementsBuilding a Bitcoin trading RL platform using real market dataGetting readyHow to do it…How it works…Building an Ethereum trading RL platform using price charts Getting readyHow to do it…How it works…Building an advanced cryptocurrency trading platform for RL agentsGetting readyHow to do it…How it works…Training a cryptocurrency trading bot using RLGetting readyHow to do it…How it works…
Chapter 5: Reinforcement Learning in the Real World – Building Stock/Share Trading Agents
Technical requirementsBuilding a stock market trading RL platform using real stock exchange dataGetting readyHow to do it…How it works…Building a stock market trading RL platform using price chartsGetting readyHow to do it…How it works…Building an advanced stock trading RL platform to train agents to mimic professional tradersGetting readyHow to do it…How it works…
Chapter 6: Reinforcement Learning in the Real World – Building Intelligent Agents to Complete Your To-Dos
Technical requirementsBuilding learning environments for real-world RLGetting readyHow to do it…How it works…Building an RL Agent to complete tasks on the web – Call to ActionGetting readyHow to do it…How it works…Building a visual auto-login botGetting readyHow to do it…How it works…Training an RL Agent to automate flight booking for your travelGetting readyHow to do it…How it works…Training an RL Agent to manage your emailsGetting readyHow to do it…How it works…Training an RL Agent to automate your social media account managementGetting readyHow to do it…How it works…
Chapter 7: Deploying Deep RL Agents to the Cloud
Technical requirementsImplementing the RL agent’s runtime componentsGetting readyHow to do it…How it works…Building RL environment simulators as a serviceGetting readyHow to do it…How it works…Training RL agents using a remote simulator serviceGetting readyHow to do it…How it works…Testing/evaluating RL agentsGetting readyHow to do it…How it works…Packaging RL agents for deployment – a trading botGetting readyHow to do it…How it works…Deploying RL agents to the cloud – a trading Bot-as-a-ServiceGetting readyHow to do it…How it works…
Chapter 8: Distributed Training for Accelerated Development of Deep RL Agents
Technical requirementsDistributed deep learning models using TensorFlow 2.x – Multi-GPU trainingGetting readyHow to do it...How it works...Scaling up and out – Multi-machine, multi-GPU trainingGetting readyHow to do it...How it works...Training Deep RL agents at scale – Multi-GPU PPO agentGetting readyHow to do it...How it works...Building blocks for distributed Deep Reinforcement Learning for accelerated trainingGetting readyHow to do it...How it works...Large-scale Deep RL agent training using Ray, Tune, and RLLibGetting readyHow to do it...How it works...

Chapter 9: Deploying Deep RL Agents on Multiple Platforms
Technical requirementsPackaging Deep RL agents for mobile and IoT devices using TensorFlow LiteGetting readyHow to do it...How it works...Deploying RL agents on mobile devicesGetting readyHow to do it...How it works...Packaging Deep RL agents for the web and Node.js using TensorFlow.jsGetting readyHow to do it...How it works...Deploying a Deep RL agent as a serviceGetting readyHow to do it...How it works...Packaging Deep RL agents for cross-platform deploymentGetting readyHow to do it...How it works...
Other Books You May Enjoy
Leave a review - let other readers know what you think

Content preview from TensorFlow 2 Reinforcement Learning Cookbook

Chapter 8: Distributed Training for Accelerated Development of Deep RL Agents

Training Deep RL agents to solve a task takes enormous wall-clock time due to the high sample complexity. For real-world applications, iterating over agent training and testing cycles at a faster pace plays a crucial role in the market readiness of a Deep RL application. The recipes in this chapter provide instructions on how to speed up Deep RL agent development using the distributed training of deep neural network models by leveraging TensorFlow 2.x’s capabilities. Strategies for utilizing multiple CPUs and GPUs both on a single machine and across a cluster of machines are discussed. Multiple recipes for training distributed Deep Reinforcement Learning (Deep RL

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Publisher Resources

ISBN: 9781838982546

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

TensorFlow 2 Reinforcement Learning Cookbook

by Palanisamy

Chapter 8: Distributed Training for Accelerated Development of Deep RL Agents

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.