Keywords are akin to commands typed in a CLI, in our case, a word or short phrase that encapsulates a specific action; some examples include (all are HoloLens system commands):
- Select is used to select the currently focused object
- Go back to return to the previous screen
- Hide to hide the currently focused object
For each utterance, there is no need for conversing or dialog with the user; the intent is obvious, but what is notable is that they are contextually dependent and multimodal, which means that they are dependent on other forms of input to interpret a user's intent correctly; for example, Select will select the item the user is currently gazing at, where gaze is the other input providing context. Multimodal interfaces ...