Row format and column format
It is one of the most important factors when selecting a file format that indicates if a row or column-based format is something that is best suited to our objectives. The column-based storage file format gives better performance when we perform analytic queries that require only a subset of columns to be analysed over large datasets. In columnar formats, data is stored sequentially by column from left to right, top to bottom. If data is grouped by column, then it makes it more efficient to easily focus computation on specified columns of data. Accessing relevant columns of data will save significant amounts of compute costs because unwanted columns are ignored. Column-based storage is also well-suited for sparse ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access