March 2024
36m
English
audiobook
Generative AI in the Real World: Competing in a Generative World with Justin Norman
by Ben Lorica, Justin Norman
Overview
Justin Norman, author of Product Management for AI and co-founder of Vera, a startup focused on security for generative AI, talks with Ben Lorica about how product management has changed since Generative AI came on the scene. He discusses the issues retrieval-augmented generation (RAG) raises for product management; how reliability has become part of a product’s value; how companies that have lagged in their adoption of AI can use generative AI as a way to catch up; and the ability of open source AI in helping smaller companies compete with more established companies.
About the Generative AI in the Real World podcast: In 2023, ChatGPT put AI on everyone’s agenda. In 2024, the challenge will be turning those agendas into reality. In Generative AI in the Real World, Ben Lorica interviews leaders who are building with AI. Learn from their experience to help put AI to work in your enterprise.
Points of Interest
- 0:00: You wrote Product Management for AI back in 2020 and 2021. How have things changed for product managers since then?
- 3:04: Do companies that lead with operations and infrastructure for traditional AI maintain an advantage with Generative AI? Or does Generative AI allow companies that are just starting to catch up?
- 5:09: Can new companies use open source to compete with established companies? Can open source help capture value as well as larger proprietary models?
- 6:08: What do product managers struggle with when implementing RAG? What's the relationship between fine-tuning and RAG?
- 10:58: RAG gives you value out of the box, but the key to success is how the data is organized.
- 13:57: Are VCs underinvesting in certain parts of the pipeline? There is lots of investment in AI, but not as much investment in startups working on necessary technologies like ETL and data engineering.
- 16:31: Why is reliability important for generative AI? How is generative AI different from other applications that we’re familiar with, and what implications does this have for product management?
- 21:03: Are enterprises realizing that efficiency is important for succeeding with generative AI?
- 23:44: We’re familiar with dashboards for monitoring and managing traditional software products. What would you imagine a dashboard for generative AI models to be? What do you need to be monitoring?
- 28:49: Very few developers working in machine learning have also done frontend development or worked on user experience (UX). However, understanding user interaction can help you to improve your model.
- 30:44: You're working with the father of digital forensics, Hany Farid. Should we be worried about DeepFakes?
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Listen now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.