Hands-On Meta Learning with Python

The Reptile algorithm

Reptile is a simple yet effective algorithm. Reptile can be implemented in both serial and batch versions. In the serial version, we sample only one task from the task distribution while, in the batch version, we sample a batch of tasks and try to find the optimal parameter. We'll see how the serial version of Reptile works. The sequence of steps involved in Reptile is as follows:

1. Let's say we have a distribution over tasks , and we randomly initialize the model parameter .
2. Now we sample a task T from the task distribution: ...