June 2026
19h 35m
English
on-demand course
Speech Language Models Architecture, Training, and Applications for Modern Voice AI
with Vinit Kumar Singh
Closed Captioning available in English
Overview
In this 19-hour course, explore Speech Language Models (SpeechLMs) and their architecture, training, and applications in modern Voice AI. Gain practical experience in building, deploying, and scaling autonomous voice agents while mastering advanced speech processing, prompting, and multi-agent orchestration techniques.
What I will be able to do after this course
- Master core components of SpeechLMs, including tokenization, vocoders, and cross-modal representations.
- Implement advanced prompting strategies like CoT, ReAct, and ToT for improved reasoning and task-solving.
- Design RAG pipelines and memory architectures for long-term knowledge retention and autonomous retrieval.
- Build, test, and deploy scalable multi-agent systems with robust safety, evaluation, and observability features.
- Apply production-ready best practices for latency optimization, monitoring, and secure agentic workflows.
Course Instructor(s)
Vinit Kumar Singh is an AI Consultant and Educator specializing in Voice AI, SpeechLMs, and Agentic AI with 18+ years of experience. Certified from IIT Bombay, Stanford ML & DL, he has deployed real-world AI solutions for Sony India, Assert AI, and tvam Technologies. A top 3% Udemy creator, he trains learners globally in NLP, LLMs, and autonomous AI systems.
Who is it for?
This course is ideal for AI engineers, software developers, and data scientists transitioning from traditional ML to autonomous agent design. Researchers and product managers exploring multi-agent systems, observability, and production-ready Voice AI will also benefit. Motivated professionals aiming to deploy secure, scalable agentic workflows with LLMs will find this course especially valuable.
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Watch now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.