Book Description
Leverage your knowledge of SQL to easily write distributed data processing applications on Hadoop using Apache Hive
- Learn something new in an Instant! A short, fast, focused guide delivering immediate results
- Learn to use SQL to write Hadoop jobs
- Add support for data to Hive in your own file formats
- Understand how the Hive query processor works to optimize common queries
In Detail
Hadoop provides a robust framework for building distributed applications, but working directly with Hadoop requires writing a lot of code. Adding structure to data and using a higher-level language such as SQL makes working with Hadoop both easier and faster.
"Instant Apache Hive Essentials How-to" contains a series of practical recipes that introduce the power and flexibility of Hive. Starting with your first query, this book will provide step-by-step instructions and behind-the-scenes explanations for how to effectively write MapReduce jobs with SQL.
This book looks at how Hive transforms SQL statements into MapReduce jobs and demonstrates how you can extend Hive to support your own use cases. Its recipes will teach you how to leverage the scale of Hadoop while retaining the benefits of using a structured query language.You will learn how Hive translates a query into MapReduce jobs and explore how to structure your queries for better performance. You will extend Hive to understand your own file formats, simplifying the loading of data into the warehouse. You will finally add your own custom functions to Hive to support whatever use cases you may have.
"Instant Apache Hive Essentials How-to" is a quick introduction for adding Hive to your data toolkit. It is packed with high-level instructions for making Hive work as well as drawing connections to the underlying Hadoop framework to explain how things happen.
Table of Contents
-
Instant Apache Hive Essentials How-to
- Instant Apache Hive Essentials How-to
- Credits
- About the Author
- About the Reviewer
- www.PacktPub.com
- Preface
-
1. Instant Apache Hive Essentials How-to
- Tables and queries (Simple)
- Understanding complex data types (Simple)
- Using Hive non-interactively (Simple)
- Join optimizations (Medium)
- Setting the file format (Simple)
- Writing a custom SerDe (Intermediate)
- Using static partitions (Intermediate)
- Using dynamic partitions (Intermediate)
- Using functions (Simple)
- Adding custom logic with streaming (Intermediate)
- Simple user-defined functions (Intermediate)
- Advanced user-defined functions (Advanced)
- User-defined table-generating functions (Advanced)
- User-defined aggregation functions (Advanced)