Skip to Main Content
AI for Good
book

AI for Good

by Juan M. Lavista Ferres, William B. Weeks, Brad Smith
April 2024
Intermediate to advanced content levelIntermediate to advanced
432 pages
9h 44m
English
Wiley
Audiobook available
Content preview from AI for Good

Chapter 6Wildlife Bioacoustics Detection

—Zhongqi Miao

Executive Summary

Automatically detecting sound events with artificial intelligence has become increasingly popular in the field of bioacoustics, particularly for wildlife monitoring and conservation. Conventional methods predominantly use supervised learning techniques, which depend on substantial amounts of manually annotated bioacoustics data. However, manual annotation in bioacoustics is tremendously resource-intensive, both in terms of human labor and financial resources; further, manual annotation requires considerable domain expertise. This requirement for domain expertise consequently undermines the validity of crowdsourcing annotation methods, such as Amazon Mechanical Turk. Additionally, the supervised learning framework restricts application scope to predefined categories within closed settings.

To address these challenges, we developed an approach that leverages a multi-modal contrastive learning technique called Contrastive Language-Audio Pre-training (CLAP). CLAP allows for flexible class definition during inference by using descriptive text prompts and can perform Zero-Shot Transfer on previously unencountered datasets. Here, we found that without specific fine-tuning or additional training, an out-of-the-box CLAP model could effectively generalize across nine bioacoustics benchmarks, covering a wide variety of sounds that were unfamiliar to the model. We showed that CLAP achieved comparable, if not superior, ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

AI for Good

AI for Good

Juan M. Lavista Ferres, William B. Weeks
AI for Social Good

AI for Social Good

Rahul Dodhia
Generative AI

Generative AI

Martin Musiol
AI at the Edge

AI at the Edge

Daniel Situnayake, Jenny Plunkett

Publisher Resources

ISBN: 9781394235872Purchase Link