Chapter 11

Natural-feature Tracking and Visual Search with junaio


  • How to use natural-feature tracking and visual search if you’re a non-developer
  • How to use natural-feature tracking and visual search if you’re a developer
  • How to overlay videos
  • Image requirements for natural-feature tracking

Natural-feature tracking is a very powerful tool that enables you to recognize almost any existing product (for example, books, DVDs, games, or even photos) without having to apply any special markers to the image. In contrast, a marker or a QR code would need to be applied to the packaging when the book cover is created, so you can’t apply AR after the fact.

Why is this useful? If you want to create a solution that enables users to play tracks from the latest chart-topping album, the record label isn’t likely to allow you to place a special marker or QR code on the CD sleeve. The marketing would have to be prepared in advance and could add some cost to the printing and design of the cover.

With natural-feature tracking, however, users can use their phones to recognize the CD cover even if the CD is already selling in the shops. Once recognized, a music video of one of the tracks could play on the users’ smartphones without requiring them to search or type anything to find it. If they like what they hear and see, they might be more willing to purchase the album.

Because the information is stored on a server, you could update the recognition action after a couple of ...

Get Professional Augmented Reality Browsers for Smartphones: Programming for junaio, Layar, and Wikitude now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.