Retrieval-Augmented Generation in Production with Haystack

About the Author

Skanda Vivek is a senior data scientist at Intuit, working on leveraging and developing generative AI models in production for empowering customers. Prior to that he was a senior data scientist at the Risk Intelligence team at OnSolve, where he developed advanced AI algorithms for rapidly detecting critical emergencies through big data. Before that, he was an assistant professor, and a post-doctoral fellow at Georgia Tech. He received his PhD in physics from Emory University. His work has been published in multiple scientific journals as well as broadcasted widely by outlets such as BBC and Forbes. He is passionate about sharing knowledge, and his blog on applying state-of-the-art AI, including LLMs in real-world scenarios, has 30K+ monthly views.

Acknowledgments

I would like to express my heartfelt gratitude to Sriniketh Jayasendil for his invaluable code contributions and the stimulating conversations that significantly advanced this work. My appreciation extends to the Haystack team—Malte, Andrey, Isabelle, Julian, Maria, Massi, and Tuana—for their specific feedback on Haystack and the insightful discussions they had with me. I am deeply thankful to the O’Reilly team, particularly Gary O’Brien, for guiding this initiative. Finally, I am grateful for the unwavering support of my wife, Chao; my mother, Anjana; and my children, Akash and Arush, whose encouragement and love made this journey possible.