Now, we'll see how inequality minimization TAML works step by step:
- Let's say we have a model parameterized by a parameter and we've a distribution over tasks . First, we randomly initialize the model parameter .
- We sample a batch of tasks from a distribution of tasks—that is, . Say, we've sampled three tasks, then .
- Inner loop: For ...