Skip to Content
Transfer Learning for Natural Language Processing
book

Transfer Learning for Natural Language Processing

by Paul Azunre
August 2021
Intermediate to advanced
272 pages
7h 54m
English
Manning Publications
Audiobook available

Overview

Build custom NLP models in record time by adapting pre-trained machine learning models to solve specialized problems.

In Transfer Learning for Natural Language Processing you will learn:
  • Fine tuning pretrained models with new domain data
  • Picking the right model to reduce resource usage
  • Transfer learning for neural network architectures
  • Generating text with generative pretrained transformers
  • Cross-lingual transfer learning with BERT
  • Foundations for exploring NLP academic literature

Training deep learning NLP models from scratch is costly, time-consuming, and requires massive amounts of data. In Transfer Learning for Natural Language Processing, DARPA researcher Paul Azunre reveals cutting-edge transfer learning techniques that apply customizable pretrained models to your own NLP architectures. You’ll learn how to use transfer learning to deliver state-of-the-art results for language comprehension, even when working with limited label data. Best of all, you’ll save on training time and computational costs.

About the Technology
Build custom NLP models in record time, even with limited datasets! Transfer learning is a machine learning technique for adapting pretrained machine learning models to solve specialized problems. This powerful approach has revolutionized natural language processing, driving improvements in machine translation, business analytics, and natural language generation.

About the Book
Transfer Learning for Natural Language Processing teaches you to create powerful NLP solutions quickly by building on existing pretrained models. This instantly useful book provides crystal-clear explanations of the concepts you need to grok transfer learning along with hands-on examples so you can practice your new skills immediately. As you go, you’ll apply state-of-the-art transfer learning methods to create a spam email classifier, a fact checker, and more real-world applications.

What's Inside
  • Fine tuning pretrained models with new domain data
  • Picking the right model to reduce resource use
  • Transfer learning for neural network architectures
  • Generating text with pretrained transformers


About the Reader
For machine learning engineers and data scientists with some experience in NLP.

About the Author
Paul Azunre holds a PhD in Computer Science from MIT and has served as a Principal Investigator on several DARPA research programs.

Quotes
For anyone looking to dive deep into recent breakthroughs in NLP & transfer learning, this book is for you!
- Matthew Sarmiento, Plume Design

Does an excellent job of introducing the techniques and concepts to NLP practitioners.
- Marc-Anthony Taylor, Blackshark.ai

Keep this book handy if you want to be good at applied and real-world NLP.
- Sayak Paul, PyImageSearch

Good fundamentals of transfer learning for NLP applications. Sets you up for success!
- Vamsi Sistla, Data Science & ML Consultant

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

Hands-on Question Answering Systems with BERT: Applications in Neural Networks and Natural Language Processing

Hands-on Question Answering Systems with BERT: Applications in Neural Networks and Natural Language Processing

Navin Sabharwal, Amit Agrawal
Hands-On Transfer Learning with Python

Hands-On Transfer Learning with Python

Dipanjan Sarkar, Raghav Bali, Tamoghna Ghosh

Publisher Resources

ISBN: 9781617297267Publisher SupportPublisher Website