Generative AI in the Real World: Pete Warden on Running AI on Small Systems
How to Make AI Useful on Consumer Devices
Pete Warden, founder of Useful Sensors and co-author of TinyML, discusses use cases for artificial intelligence that we rarely think about: how can you run AI on very small systems? How can you put AI on consumer devices in ways that are actually useful and not just buzzword-compliant? AI doesn’t have to rely on massive GPU farms. Pete talks about what happens when you exchange one set of requirements (extreme power, heat, and expense) for another (minimal size, cost, and heat).
Check out other episodes of this podcast or the full-length version on the O’Reilly Learning Platform.
Learn faster. Dig deeper. See farther.
About the Generative AI in the Real World podcast: In 2023, ChatGPT put AI on everyone’s agenda. In 2024, the challenge will be turning those agendas into reality. In Generative AI in the Real World, Ben Lorica interviews leaders who are building with AI. Learn from their experience to help put AI to work in your enterprise.
Timestamps
0:00: Introduction. What is Useful Sensors? What are the challenges and use cases of sensor-driven AI?
4:11: We often think that AI requires massive computational resources. What is deployable today on hardware that’s constrained on size, cost, and power?
7:15: What are the biggest opportunities for using AI on consumer devices?