©  Geoff Hulten 2018
Geoff HultenBuilding Intelligent Systemshttps://doi.org/10.1007/978-1-4842-3432-7_19

19. Evaluating Intelligence

Geoff Hulten1 
(1)
Lynnwood, Washington, USA
 
Evaluation is creation, at least when it comes to building intelligence for Intelligent Systems. That’s because intelligence creation generally involves an iterative search for effective intelligence: produce a new candidate intelligence, compare it to the previous candidate, and choose the better of the two. To do this, you need to be able to look at a pair of intelligences and answer questions like these:
  • Which one of these should I use in my Intelligent System?

  • Which will do a better job of achieving the system’s goals?

  • Which will cause less trouble for me and my users?

Get Building Intelligent Systems: A Guide to Machine Learning Engineering now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.