Skip to Main Content
Natural Language Processing in Action
book

Natural Language Processing in Action

by Cole Howard, Hobson Lane, Hannes Hapke
April 2019
Intermediate to advanced content levelIntermediate to advanced
544 pages
17h 29m
English
Manning Publications
Content preview from Natural Language Processing in Action

Appendix D. Machine learning tools and techniques

Much of natural language processing involves machine learning. So it pays to understand some of the basic tools and techniques of machine learning. Some have been covered in earlier chapters, some haven’t, but all warrant at least a few words here.

D.1 Data selection and avoiding bias

Data selection and feature engineering are frought with the hazards of bias (in human terms). Once you’ve baked your own biases into your algorithm, by choosing a particular set of features, the model will fit to those biases and produce biased results. If you’re lucky enough to discover this bias before going to production, it can require a significant amount of effort to undo the bias. Your entire pipeline must ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Natural Language Processing with PyTorch

Natural Language Processing with PyTorch

Delip Rao, Brian McMahan

Publisher Resources

ISBN: 9781617294631Supplemental ContentPublisher SupportPublisher WebsiteSupplemental ContentOtherPurchase Link