Applied Natural Language Processing with Python: Implementing Machine Learning and Deep Learning Algorithms for Natural Language Processing

© Taweh Beysolow II 2018

Taweh Beysolow IIApplied Natural Language Processing with Python https://doi.org/10.1007/978-1-4842-3733-5_3

3. Working with Raw Text

Taweh Beysolow II¹ 

(1)

San Francisco, California, USA

 

Those who approach NLP with the intention of applying deep learning are most likely immediately confronted with a simple question: How does a machine learning algorithm learn to interpret text data? Similar to the situations in which a feature set may have a categorical feature, we must perform some preprocessing. While the preprocessing we perform in NLP often is more involved than simply converting a categorical feature using label encoding, the principle is the same. We need to find a way to represent individual observations of texts ...