April 2018
Intermediate to advanced
334 pages
10h 18m
English
TD(1) incorporates the concept of eligibility trace. Let's go through the pseudo code of the approach and then we will discuss it in detail:
Episode T For all s, At the start of the episode : e(s) = 0 andAfter
: (at step t)
For all s,
![]()
Each Episode T starts with the following initialization: