The optimization verification test
Andrew Ng (see references on GitHub: https://github.com/PacktPublishing/Hands-On-Machine-Learning-for-Algorithmic-Trading) emphasizes the distinction between performance shortcomings due to a problem with the learning algorithm or the optimization algorithm. Complex models like neural networks assume non-linear relationships and the search process of the optimization algorithm may end up in a local rather than a global optimum.
If, for example, a model fails to correctly translate a phrase, the test compares the scores for the correct prediction and the solution discovered by the search algorithm. If the learning algorithm scores the correct solution higher, the search algorithm requires improvements. Otherwise, ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access