10SOURCES OF RANDOMNESS
What are the common sources of randomness when training deep neural networks that can cause non-reproducible behavior during training and inference?
When training or using machine learning models such as deep neural networks, several sources of randomness can lead to different results every time we train or run these models, even though we use the same overall settings. Some of these effects are accidental and some are intended. The following sections categorize and discuss these various sources of randomness.
Optional hands-on examples for most of these categories are provided in the supplementary/q10-random-sources subfolder ...
Get Machine Learning Q and AI now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
