CHAPTER 1

Big Data Infrastructure—A Technical Architecture Overview

Four elements compose a technical infrastructure: processing capability, storage capacity, data transport capability, and visualization capability. These are provided by a combination of hardware systems and analytical software techniques, which constitute the basic infrastructure of big data from our perspective. We will address each of these components in this chapter.

First, we view data processing as having two basic paradigms: batch and stream processing. Batch processing has high latency, whereas stream processing analyzes small amounts of data as they arrive. It has low latency, and depending on the arrival rate, volume can mount up very quickly. If you try to process ...

Get Obtaining Value from Big Data for Service Systems, Volume II, 2nd Edition now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.