CHAPTER 4

Big Data Infrastructure—A Technical Architecture Overview

Four elements composed of processing capability, storage capacity, data transport bandwidth, and visualization capability provided by systems and analytical software techniques constitute the basic infrastructure of Big Data from our perspective. We will address each of these components in this chapter.

First, we view data processing as having two basic paradigms: batch and stream processing. Batch processing has high-latency, whereas stream processing analyzes small amounts of data as they arrive. It has low-latency and, depending on the arrival rate, volume can mount up very quickly. If you try to process a terabyte or more of data all at once, you will not be able to do it ...

Get Obtaining Value from Big Data for Service Delivery now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.