October 2026
296 pages
7h 34m
English
Overview
"A goldmine of technical advice, with actionable project ideas and learning resources.”
—C. Scott Anderson, Garmin International
Running AI applications on local hardware unlocks architecturally guaranteed privacy, eliminates costly subscriptions and API fees, and gives you the power to tune your models to your exact needs. In Build Applications with Local AI Models on a Mac, author Keiji Kamigusa guides you step-by-step as you build a voice-enabled chatbot that will run on any recent Mac—from a basic Mac mini to a top-of-the-line Mac Studio. As you set up your custom hardware and software stack, you’ll experience a powerful paradigm shift that turns you from a passive consumer into an AI architect.
The book draws you in immediately with a hands-on project that connects three local technologies: audio capture, speech transcription, and language model inference. You’ll start by building the foundation of your chatbot, including command-line navigation and directory management, setting up Homebrew as your package manager, and downloading your first local large language model. Then, you’ll quickly review the features that make local AI on the Mac special, such as Apple Silicon’s unified memory architecture. You’ll also meet a Mac-optimized software suite that includes the Apple-optimized MLX Whisper speech recognition model that offers 100% offline privacy and an integrated voice AI pipeline that runs natively on M-series chips.
As you go, you’ll explore universal concepts that apply to all AI applications—such as temperature configuration, context windows, and system prompts—and learn how they map to the specific needs of your local Mac environment. The book then guides you through expanding your assistant with Retrieval-Augmented Generation (RAG) and autonomous agents. You will store documents locally in ChromaDB to ground your AI’s responses and prevent hallucinations. You’ll also learn how to use the Python-based Streamlit framework to customize your chatbot’s behavior without writing complex callbacks or HTML.
In later chapters, you’ll discover how self-hosting models on your Mac provide absolute control over your workflows while keeping your infrastructure completely private. You’ll explore the Unsloth-to-Ollama pipeline to fine-tune frontier models on your custom data and how to manage stateless LLMs by implementing explicit history tracking. Reviewer Arun Sivakumar of Expedia Group noted, “The context window and token consumption are valuable details that many LLM users ignore, and concepts like how to fine tune models are highly relevant for day-to-day usage.”
Spanning 18 chapters, this book provides a complete local AI roadmap. As reviewer C. Scott Anderson of Garmin International points out, this book gives you exactly what you need to see how “the benefits of open-source models can eclipse the economic realities of proprietary models.”
About the Technology
About the Book
What's Inside
About the Reader
Perfect for professionals and hobbyists who want to build secure, private, and free AI applications on macOS. No prior programming or AI experience required.
About the Author
Keiji Kamigusa is an authority in AI and machine learning with over 16 years of industry experience. A former CTO of a text mining company, he has created more than 50 courses and taught 59,000+ students. He holds three patents in text analytics and is the founder of AIGYM Inc., specializing in AI-driven corporate training.
Quotes
A must-read for anyone who wants absolute control over their AI stack.
- Suman Debnath, Crusoe
A straightforward guide to setting up and getting the most from local AI on your computer.
- Paul Sagor, MUFG
A great overview for anyone getting started with their first prompt, as well as for the seasoned AI coder who wants to tweak the latest open-weight model.
- Adam Shannon, Moov Financial
Great introduction to AI application development with on-device models using Python.
- Elinam R. Hini, Brave Software
—C. Scott Anderson, Garmin International
Running AI applications on local hardware unlocks architecturally guaranteed privacy, eliminates costly subscriptions and API fees, and gives you the power to tune your models to your exact needs. In Build Applications with Local AI Models on a Mac, author Keiji Kamigusa guides you step-by-step as you build a voice-enabled chatbot that will run on any recent Mac—from a basic Mac mini to a top-of-the-line Mac Studio. As you set up your custom hardware and software stack, you’ll experience a powerful paradigm shift that turns you from a passive consumer into an AI architect.
The book draws you in immediately with a hands-on project that connects three local technologies: audio capture, speech transcription, and language model inference. You’ll start by building the foundation of your chatbot, including command-line navigation and directory management, setting up Homebrew as your package manager, and downloading your first local large language model. Then, you’ll quickly review the features that make local AI on the Mac special, such as Apple Silicon’s unified memory architecture. You’ll also meet a Mac-optimized software suite that includes the Apple-optimized MLX Whisper speech recognition model that offers 100% offline privacy and an integrated voice AI pipeline that runs natively on M-series chips.
As you go, you’ll explore universal concepts that apply to all AI applications—such as temperature configuration, context windows, and system prompts—and learn how they map to the specific needs of your local Mac environment. The book then guides you through expanding your assistant with Retrieval-Augmented Generation (RAG) and autonomous agents. You will store documents locally in ChromaDB to ground your AI’s responses and prevent hallucinations. You’ll also learn how to use the Python-based Streamlit framework to customize your chatbot’s behavior without writing complex callbacks or HTML.
In later chapters, you’ll discover how self-hosting models on your Mac provide absolute control over your workflows while keeping your infrastructure completely private. You’ll explore the Unsloth-to-Ollama pipeline to fine-tune frontier models on your custom data and how to manage stateless LLMs by implementing explicit history tracking. Reviewer Arun Sivakumar of Expedia Group noted, “The context window and token consumption are valuable details that many LLM users ignore, and concepts like how to fine tune models are highly relevant for day-to-day usage.”
Spanning 18 chapters, this book provides a complete local AI roadmap. As reviewer C. Scott Anderson of Garmin International points out, this book gives you exactly what you need to see how “the benefits of open-source models can eclipse the economic realities of proprietary models.”
About the Technology
About the Book
What's Inside
- Building a fully offline, voice-enabled assistant
- Completing data privacy with no cloud API fees
- Maximizing Apple Silicon hardware
- Custom Modelfiles, RAG, and local AI agent integration
About the Reader
Perfect for professionals and hobbyists who want to build secure, private, and free AI applications on macOS. No prior programming or AI experience required.
About the Author
Keiji Kamigusa is an authority in AI and machine learning with over 16 years of industry experience. A former CTO of a text mining company, he has created more than 50 courses and taught 59,000+ students. He holds three patents in text analytics and is the founder of AIGYM Inc., specializing in AI-driven corporate training.
Quotes
A must-read for anyone who wants absolute control over their AI stack.
- Suman Debnath, Crusoe
A straightforward guide to setting up and getting the most from local AI on your computer.
- Paul Sagor, MUFG
A great overview for anyone getting started with their first prompt, as well as for the seasoned AI coder who wants to tweak the latest open-weight model.
- Adam Shannon, Moov Financial
Great introduction to AI application development with on-device models using Python.
- Elinam R. Hini, Brave Software
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.