Skip to Main Content
Getting Started with Google BERT
book

Getting Started with Google BERT

by Sudharsan Ravichandiran
January 2021
Beginner to intermediate content levelBeginner to intermediate
352 pages
10h 17m
English
Packt Publishing
Content preview from Getting Started with Google BERT
Working with VideoBERT, BART, and More

Congratulations! We have made it to the final chapter. We have come a long way. We started off with understanding transformers, then we learned about BERT and several different variants of BERT in detail, from ALBERT to SentenceBERT. In this chapter, we will learn about two interesting models named VideoBERT and BART. We will also explore two popular BERT libraries known as ktrain and bert-as-service. We will start off the chapter by learning how VideoBERT works. We will look at how the VideoBERT model is pre-trained to learn the representation of language and video in a joint manner. Then, we will look into some of the applications of VideoBERT. 

Moving on, we will learn what BART is and how it differs ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Clean Code Fundamentals

Clean Code Fundamentals

Robert C. Martin

Publisher Resources

ISBN: 9781838821593Supplemental Content