Skip to Main Content
Getting Started with Google BERT
book

Getting Started with Google BERT

by Sudharsan Ravichandiran
January 2021
Beginner to intermediate content levelBeginner to intermediate
352 pages
10h 17m
English
Packt Publishing
Content preview from Getting Started with Google BERT
Assessments

The following are the answers to the questions given at the end of each chapter.

Chapter 1, A Primer on Transformers

  1. The steps involved in the self-attention mechanism are given here: 
  • First, we compute the dot product between the query matrix and the key matrix  and get the similarity scores.
  • Next, we divide  by the square root of the dimension of the key vector 
  • Then, we apply the softmax function to normalize the scores and ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Clean Code Fundamentals

Clean Code Fundamentals

Robert C. Martin

Publisher Resources

ISBN: 9781838821593Supplemental Content