Advanced Applied Deep Learning: Convolutional Neural Networks and Object Detection

© Umberto Michelucci 2019

U. MichelucciAdvanced Applied Deep Learning https://doi.org/10.1007/978-1-4842-4976-5_5

5. Cost Functions and Style Transfer

Umberto Michelucci¹ 

(1)

TOELT LLC, Dübendorf, Switzerland

 

In this chapter we will look in more depth at the role of the cost function in neural network models. In particular, we will discuss the MSE (mean square error) and the cross-entropy and discuss their origin and their interpretation. We will look at why we can use them to solve problems and how the MSE can be interpreted in a statistical sense, as well as how cross-entropy is related to information theory. Then, to give you an example of a much more advanced use of special loss functions, we will learn how to do neural style transfer, where ...