© Poornachandra Sarang 2021
P. SarangArtificial Neural Networks with TensorFlow 2https://doi.org/10.1007/978-1-4842-6150-7_9

9. Natural Language Understanding

Poornachandra Sarang1  
Mumbai, India


In the last chapter, you used the seq2seq model along with the Attention to perform a language translation. In this chapter, I will show you a more sophisticated technique for Natural Language Processing. You will learn to use the latest innovation in natural language modeling called Transformer. The Transformer model eliminates the need for LSTMs and produces far better results than the seq2seq model that uses LSTMs. So, let us understand what a Transformer model is.


In the last chapter, you saw the importance of Attention while ...

Get Artificial Neural Networks with TensorFlow 2: ANN Architecture Machine Learning Projects now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.