Skip to Main Content
The Language of Deception
book

The Language of Deception

by Justin Hutchens, Stuart McClure
December 2023
Intermediate to advanced content levelIntermediate to advanced
400 pages
8h 58m
English
Wiley
Content preview from The Language of Deception

Chapter 4A History of Language Modeling

Natural language processing (NLP) is the science of creating artificial systems that attempt to simulate or duplicate the use of language in the same ways that humans interact with one another, in a way that is seemingly natural. Nearly all NLP systems to date could be sorted into one of two categories: rule-based NLP and statistical NLP. In a way, this is somewhat of an arbitrary distinction, since technically, statistical systems are still rule based; they are just not based on any rules that were explicitly written and/or defined by the system designer. So, it would probably be more accurate to say that, when we refer to rule-based systems, we are referring to language systems that operate using rules that have been explicitly defined in the system's code, whereas when we speak of statistical systems, we are referring to systems that operate using rules that have been algorithmically defined by the system itself, based on statistical analysis routines, which were themselves defined in the code. So, in truth, the only fundamental difference between rule-based and statistical language systems is that in the former, the creator explicitly defines how the machine will interact, and in the latter, the creator only defines how the machine will learn to interact.

For rule-based models the creator gives the system the rules of interaction, and in statistical models the creator gives the system a framework to create its own rules of interaction. ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

The Language of Deception

The Language of Deception

Justin Hutchens

Publisher Resources

ISBN: 9781394222544Purchase Link