3A Study on Big Data Engineering Using Cloud Data Warehouse

Manjunath T. N.1*, Pushpa S. K.1, Ravindra S. Hegadi2 and Ananya Hathwar K. S.1

1 Department of ISE, BMS Institute of Technology and Management, Bengaluru, Karnataka, India

2 Department of CS, Central University of Karnataka, Kalaburagi, Karnataka, India

Abstract

In the current smart, Internet of Things world, millions of devices are connected around us for effective communication. A huge volume of data is getting generated, varying from gigabytes to brontobytes with a variety of data formats, storing all the acquired data in an on-premise Data warehouse has limitations due to storage capacity and homogeneous data formats compatibility. The internet revolution has brought us an entirely new communication and cloud model. We now have fast wireless connectivity for data transfer, messaging and web surfing, and we also perform extract, transform and Load (ETL) activities to the cloud data warehouse based on the client’s requirements. The internet revolution has been the core inspiration for many new business ideas and models. The rise in online retailing business is strictly dependent on internet connectivity. Even consumers find online shopping convenient and time friendly. Internet communication is a must for urban life. Mobile internet helps us keep things handy and organized. We now can transfer or share a heavy size file from a portable handy device in a couple of minutes. A lot of businesses use internet for e-commerce, ...

Get Data Engineering and Data Science now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.