Real-time lip syncing

Before we get into the details of speech, phonemes, and animation, we will construct a simple example of how our previous work with developing audio visualizations can be easily applied to character lip syncing. Follow the instructions here to create a new project and set up the scene:

  1. Open Unity and create a new project called GameAudio_Vocals. After the empty project initializes, select Assets - Import Package - Custom Package from the menu and use the file dialog to find the Chapter_9_Assets folder in the book's downloaded source code. Select the in the folder and click on Open to import the assets.
  2. Locate the in the Project folder and double-click to open it. Connect a microphone if you need to and press play to ...

Get Game Audio Development with Unity 5.X now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.