Scaling Enterprise Solutions with Large Language Models : Comprehensive End-to-End Generative AI Solutions for Production-Grade Enterprise Solutions

© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2025

A. GangulyScaling Enterprise Solutions with Large Language Models https://doi.org/10.1007/979-8-8688-1154-8_9

9. Data Pipelines in Generative AI

Arindam Ganguly¹  

(1)

Howrah, West Bengal, India

 

Data is a fundamental block of all applications. Data is to a molecule as an application is to an object. Data pipelines are necessary to engineer data coming from various sources in various formats, as data powers the intelligence in an intelligent application. This chapter discusses data. Covering all the aspects of data is difficult to do in one chapter. In fact, it is difficult to do in a single book. This chapter attempts to cover some of the aspects of data engineering ...