January 2018
Beginner to intermediate
284 pages
8h 35m
English
Language modeling is one of the fundamental problems in natural language understanding (NLU). The core idea of a language model is to model important distributional properties of the words in a given language. Once such a model is learnt, it can be applied to a sequence of new words to generate the most likely next word token given the learned distributional representation. More formally, a language model computes a joint probability over a sequence of words as follows:
Estimating this probability is computationally expensive, hence a number of estimation techniques exist, which make certain assumptions about the time range ...
Read now
Unlock full access