Generative Deep Learning

Errata for Generative Deep Learning

Submit your own errata for this product.

The errata list is a list of errors and their corrections that were found after the product was released. If the error was corrected in a later version or reprint the date of the correction will be displayed in the column titled "Date Corrected".

The following errata were submitted by our customers and approved as valid errors by the author or editor.

Color Key: Serious Technical Mistake Minor Technical Mistake Language or formatting error Typo Question Note Update

Version Location Description Submitted By Date Submitted Date Corrected
Safari Books Online
Chapter 9
Positional Encoding paragraph

The cosine part of the positional embedding doesn't match the "Attention is all you need" paper. I believe it should be 10000^(2i) instead of 10000^(2i+1)

Note from the Author or Editor:
Yes this is correct. in the latex change the line: \\ PE_{pos,2i+1} & = & \cos(\frac{pos}{10000^{(2i+1)/d_{model}}}) to \\ PE_{pos,2i+1} & = & \cos(\frac{pos}{10000^{(2i)/d_{model}}})

Christopher Akiki  Jul 04, 2019 
Safari Books Online
Setting Up Your Environment

The command for creating the virtual environment with anaconda is not conda install ( params... ) it is conda create( params... )

Note from the Author or Editor:
Change the word 'install' to 'create'

Sukhraj Sekhon  Jun 17, 2019  Jun 26, 2019