7.1 The transformer7.1.1 An introduction to the transformers library and attention visualization7.1.2 Self-attention7.1.3 Residual connections, encoder-decoder attention, and positional encoding7.1.4 Application of pretrained encoder-decoder to translation7.2 The Generative Pretrained Transformer7.2.1 Architecture overview7.2.2 Transformers pipelines introduction and application to text generation7.2.3 Application to chatbotsSummary