Hands-On Q-Learning with Python

Control processes

An MDP is itself a type of problem called a control process. Broadly speaking, a control process is designed to optimize a value or a set of values within a set of limitations. The following diagram shows a model for a generalized control process:

A real-world example of such an optimization process might be maximizing a company's profit by knowing its gross sales and variable expenses. We might want to keep expenses as low as possible without affecting the sales, and keep the sales as high as possible on a scale that we can manage without incurring too many new expenses.

An MDP models a set of states, a set of actions that ...