Building Intelligent Systems: A Guide to Machine Learning Engineering

©  Geoff Hulten 2018

Geoff HultenBuilding Intelligent Systemshttps://doi.org/10.1007/978-1-4842-3432-7_19

19. Evaluating Intelligence

Geoff Hulten¹ 

(1)

Lynnwood, Washington, USA

 

Evaluation is creation, at least when it comes to building intelligence for Intelligent Systems. That’s because intelligence creation generally involves an iterative search for effective intelligence: produce a new candidate intelligence, compare it to the previous candidate, and choose the better of the two. To do this, you need to be able to look at a pair of intelligences and answer questions like these:

• Which one of these should I use in my Intelligent System?

• Which will do a better job of achieving the system’s goals?

• Which will cause less trouble for me and my users?