Elasticsearch 7 Quick Start Guide

Data sparsity

In previous versions of Elasticsearch, the sparsity of documents was to be avoided because of Lucene's structure. This structure identifies documents internally with document IDs, which are then used for communication between the internal APIs of Lucene. Lucene retrieves values of the norm from the document ID, generated by a search query, by reading the byte at the index of the document ID.

Lucene is a full-featured text search engine that is written in Java, and Elasticsearch is built on top of Lucene.

This is, at the same time, both very efficient and time-intensive, because Lucene can quickly access the norm values and the documents that have no value and use one byte of storage for each. This means, though, that if an index ...