Reinforcement Learning Algorithms with Python

The role of the expert in imitation learning

The terms expert, teacher, and supervisor refer to the same concept when speaking of imitation learning algorithms. They express a figure from which the new agent (the learner) can learn.

Fundamentally, the expert can be of any form, from a real human expert to an expert system. The first case is more obvious and adopted. What you are doing is teaching an algorithm to perform a task that a human is already able to do. The advantages are evident and it can be employed in a vast number of tasks.

The second case may not be so common. One of the valid motivations behind choosing a new algorithm trained with IL can be attributed to a slow expert system that, due to technical limitations, cannot be improved. ...