The training steps for the Controller is as follows:
- For each episode, do the following:
- Generate m child network architectures
- Train child networks on given task and obtain m validation accuracies
In Zoph et al., the training procedure is done with several copies of the Controller. Each Controller is parameterized by , which itself is stored in a distributed manner among multiple servers, which we call ...