Compression methodologies
In previous part of the book, we did touch this aspect of compression in brief. Since this is an important aspect for Data Lake, this is revisited in a bit more detail here.
While storing data, to optimize storage (reduce space) and to utilize network bandwidth, often compression methodologies are employed. Data lake deals with massive amount of data and data compression is quite significant. This aspect definitely makes the Data Lake more scalable and brings in lot of flexibility.
In many scenarios existing in an enterprise, the data commonly ingested into Data Lake are in different text formats (CSV, TSV, XML, JSON and so on). These are human readable but occupies huge amount of storage space. In Data Lake, however ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access