Sampling
In this recipe, you will learn how to sample data in Hive.
Getting ready
Sampling in Hive is a way to write queries on a small chunk of data instead of the entire table. This is required when you have a large dataset and you want to work on a small piece of that dataset. Sampling queries are most efficient when they are performed on bucketed column. Sampling is required when you just need to run queries on a smaller set of data instead of accuracy of the result set of the entire data. That is, it is mostly required for testing purposes. Sampling is most efficient when it is used for auditing purposes. In auditing, sampling can be used to pick a random set of rows or data with respect to the entire data that is huge in number.
Another use ...
Get Apache Hive Cookbook now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
