Generative AI in the Real World: Pete Warden on Running AI on Small Systems

How to Make AI Useful on Consumer Devices

By Ben Lorica
February 22, 2024

Generative AI in the Real World: Pete Warden on Running AI on Small Systems
Generative AI in the Real World

00:00 / 9:12

Pete Warden, founder of Useful Sensors and co-author of TinyML, discusses use cases for artificial intelligence that we rarely think about: how can you run AI on very small systems? How can you put AI on consumer devices in ways that are actually useful and not just buzzword-compliant? AI doesn’t have to rely on massive GPU farms. Pete talks about what happens when you exchange one set of requirements (extreme power, heat, and expense) for another (minimal size, cost, and heat).

Check out other episodes of this podcast or the full-length version on the O’Reilly Learning Platform.

Learn faster. Dig deeper. See farther.

Join the O'Reilly online learning platform. Get a free trial today and find answers on the fly, or master something new and useful.

Learn more

About the Generative AI in the Real World podcast: In 2023, ChatGPT put AI on everyone’s agenda. In 2024, the challenge will be turning those agendas into reality. In Generative AI in the Real World, Ben Lorica interviews leaders who are building with AI. Learn from their experience to help put AI to work in your enterprise.


0:00: Introduction. What is Useful Sensors? What are the challenges and use cases of sensor-driven AI?

4:11: We often think that AI requires massive computational resources. What is deployable today on hardware that’s constrained on size, cost, and power?

7:15: What are the biggest opportunities for using AI on consumer devices?

Post topics: AI & ML, Artificial Intelligence, Generative AI in the Real World podcast
Post tags: Commentary, Podcast

Get the O’Reilly Radar Trends to Watch newsletter