How Qlik Sense handles large volumes of data

The usual Qlik in-memory approach does a really good job of handling usual datasets (millions of records). Obtaining the answer in a sub-second upon user selection is a regular experience.

Qlik Indexing Engine (QIX) is Qlik's patented in-memory data-indexing technology. This approach loads and keeps the user dataset (databases, files, and data lakes extracts) in server memory. It does this using a compression algorithm that can compress data down to 10% of original data. Let's understand how this works; while the data is being loaded by your script or data manager internally, Qlik engine creates some tables to accommodate your data. First, Qlik creates a symbol table for each field with two fi ...

Get Hands-On Business Intelligence with Qlik Sense now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.