# Errata for Generative Deep Learning

The errata list is a list of errors and their corrections that were found after the product was released. If the error was corrected in a later version or reprint the date of the correction will be displayed in the column titled "Date Corrected".

The following errata were submitted by our customers and approved as valid errors by the author or editor.

Color Key: Serious Technical Mistake Minor Technical Mistake Language or formatting error Typo Question Note Update

Version Location Description Submitted By Date Submitted Date Corrected
Safari Books Online
Chapter 9
Positional Encoding paragraph

The cosine part of the positional embedding doesn't match the "Attention is all you need" paper. I believe it should be 10000^(2i) instead of 10000^(2i+1)

Note from the Author or Editor:
Yes this is correct. in the latex change the line: \\ PE_{pos,2i+1} & = & \cos(\frac{pos}{10000^{(2i+1)/d_{model}}}) to \\ PE_{pos,2i+1} & = & \cos(\frac{pos}{10000^{(2i)/d_{model}}})

Christopher Akiki  Jul 04, 2019
Safari Books Online
Ch.1