10 Going multimodal

This chapter covers

  • Extending voice applications beyond voice
  • Balancing spoken requests with screens
  • Choosing when to use other modes
  • Adding display interactions to Assistant applications

Something key to voice applications that we’ve left until now is that there are three ways of interacting with them: voice only, voice first, and voice added. Voice only is what it sounds like: voice and nothing else. Voice first uses voice as the primary interaction method, but it has other input or output. Voice added adds voice to an existing experience to enhance, but not supplant, what the user can do. In figure 10.1, you can see that voice will take a larger or smaller role in the user interaction.

Figure 10.1 The difference ...

Get Voice Applications for Alexa and Google Assistant now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.