7 How accurate is your assistant?
This chapter covers
- Collecting test data for your assistant
- Assessing the accuracy of your assistant
- Selecting the best accuracy metric(s) to use for your assistant
AI assistants make predictions based on the way they are trained. How can you tell whether this training is working well? You shouldn’t release an assistant into the wild if you don’t know how well it works. You need to be able to tell whether you are making the assistant smarter or dumber when you change the way you train it.
Fictitious Inc. wants to assess what the conversational AI assistant’s accuracy will be when it goes into production. The best way to test an assistant’s accuracy is to see how well it predicts intents in production, which ...
Get Conversational AI now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
