SQL Server Big Data Clusters: Data Virtualization, Data Lake, and AI Platform

© Benjamin Weissman and Enrico van de Laar 2020

B. Weissman, E. van de LaarSQL Server Big Data Clusters https://doi.org/10.1007/978-1-4842-5985-6_2

2. Big Data Cluster Architecture

Benjamin Weissman¹  and Enrico van de Laar²

(1)

Nurnberg, Germany

(2)

Drachten, The Netherlands

 

SQL Server Big Data Clusters are made up from a variety of technologies all working together to create a centralized, distributed data environment. In this chapter, we are going to look at the various technologies that make up Big Data Clusters through two different views.

First, we are evaluating the more-or-less physical architecture of Big Data Clusters. We are going to explore the use of containers, the Linux operating system, Spark, and the HDFS storage subsystem that make ...