Apply cutting-edge machine learning techniques—from crowdsourced relevance and knowledge graph learning, to Large Language Models (LLMs)—to enhance the accuracy and relevance of your search results.
Delivering effective search is one of the biggest challenges you can face as an engineer. AI-Powered Search is an in-depth guide to building intelligent search systems you can be proud of. It covers the critical tools you need to automate ongoing relevance improvements within your search applications.
Semantic search using dense vector embeddings from foundation models
Retrieval augmented generation (RAG)
Question answering and summarization combining search and LLMs
Fine-tuning transformer-based LLMs
Personalized search based on user signals and vector embeddings
Collecting user behavioral signals and building signals boosting models
Semantic knowledge graphs for domain-specific learning
Semantic query parsing, query-sense disambiguation, and query intent classification
Implementing machine-learned ranking models (Learning to Rank)
Building click models to automate machine-learned ranking
Generative search, hybrid search, multimodal search, and the search frontier
AI-Powered Search will help you build the kind of highly intelligent search applications demanded by modern users. Whether you’re enhancing your existing search engine or building from scratch, you’ll learn how to deliver an AI-powered service that can continuously learn from every content update, user interaction, and the hidden semantic relationships in your content. You’ll learn both how to enhance your AI systems with search and how to integrate large language models (LLMs) and other foundation models to massively accelerate the capabilities of your search technology.
About the Technology Modern search is more than keyword matching. Much, much more. Search that learns from user interactions, interprets intent, and takes advantage of AI tools like large language models (LLMs) can deliver highly targeted and relevant results. This book shows you how to up your search game using state-of-the-art AI algorithms, techniques, and tools.
About the Book AI-Powered Search teaches you to create a search that understands natural language and improves automatically the more it is used. As you work through dozens of interesting and relevant examples, you’ll learn powerful AI-based techniques like semantic search on embeddings, question answering powered by LLMs, real-time personalization, and Retrieval Augmented Generation (RAG).
What's Inside
Sparse lexical and embedding-based semantic search
Question answering, RAG, and summarization using LLMs
Personalized search and signals boosting models
Learning to Rank, multimodal, and hybrid search
About the Reader For software developers and data scientists familiar with the basics of search engine technology.
About the Author Trey Grainger is the Founder of Searchkernel and former Chief Algorithms Officer and SVP of Engineering at Lucidworks. Doug Turnbull is a Principal Engineer at Reddit and former Staff Relevance Engineer at Spotify. Max Irwin is the Founder of Max.io and former Managing Consultant at OpenSource Connections.
Quotes Belongs on the shelf of every search practitioner! - Khalifeh AlJadda, Google
A treasure map! Now you have decades of semantic search knowledge at your fingertips. - Mark Moyou, NVIDIA
Modern and comprehensive! Everything you need to build world-class search experiences. - Kelvin Tan, SearchStax
Kick starts your ability to implement AI search with easy to understand examples. - David Meza, NASA
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month, and much more.