Hands-On Meta Learning with Python

Chapter 8: Gradient Agreement as an Optimization Objective

1. When the gradients of all tasks are in the same direction, then it is called gradient agreement, and when the gradient of some tasks differ greatly from others, then it is called gradient disagreement. 
2. The update equation in gradient agreement can be expressed as   .
3. Weights are proportional to the inner product of the gradients of a task and the average of gradients of all of the tasks in the sampled batch of tasks. 

4. The weights are calculated as follows:

   

5. The normalization factor ...