We proceed with the recipe as follows:
- Clone NMT from GitHub:
git clone https://github.com/tensorflow/nmt/
- Download a training dataset. In this case, we will use the training set for translating from Vietnamese to English. Other datasets are available at https://nlp.stanford.edu/projects/nmt/ for additional languages, such as German and Czech:
nmt/scripts/download_iwslt15.sh /tmp/nmt_data
- Considering https://github.com/tensorflow/nmt/, we are going to define the first embedding layer. The embedding layer takes an input, the vocabulary size V, and the desired size of the output embedding space. The vocabulary size is such that only the most frequent words in V are considered for embedding, while all the others are mapped ...
