Deep Learning with PyTorch

Vectorization

There are two popular approaches to mapping the generated tokens to vectors of numbers, called one-hot encoding and word embedding. Let's understand how tokens can be converted to these vector representations by writing a simple Python program. We will also discuss the various pros and cons of each method.