Unlocking the Value of Real-Time Analytics

Chapter 4. Real-Time Analytics Database Solutions

We’ve identified the need for real-time insights and understand the challenges of storing and continuously updating data. Next, let’s look at some solutions for overcoming some of these obstacles. In this chapter, we will focus on shifts in the area of data storage as well as some of the software and methodologies used to overcome delays in existing database architecture. We’ll see how some companies combine these technologies to provide near-real-time stacks and incredible improvements in data storage resources.

Indexes

As mentioned earlier, indexes are a method for sorting data. By ordering data within a column, the computer no longer needs to search through everything to find the values it needs. It simply traverses the column until the value is found and returns all rows with that value. Once done, it no longer needs to continue, as the values are sorted and cannot appear later in the table. Let’s look at an example.

Figure 4-1 shows a table with information about hardware purchases at an imaginary electronics store.

Figure 4-1. Example customer order data

We should have no problem if we query this table looking for information based on Order Number. The server will scan the table until it hits the Order Number in question and then returns the data in the row. It doesn’t need to search any further since the Order Number ...