May 2017
Beginner to intermediate
596 pages
15h 2m
English
Content preview from Data Lake for Enterprises
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
Start your free trial
Apache Pig
Apache Pig is a platform developed by Yahoo for data access and processing, which works on top of HDFS dealing with large datasets. Pig has two components, namely these:
- A high-level data flow language, called Pig Latin, which has a SQL-like command structure
- Pig runtime, where the Pig Latin language gets executed
A Pig job abstracts the MapReduce complexity, fires the MapReduce job in the background and executes it in a sequential manner. Apart from MapReduce, Pig’s Hadoop job can be executed with Apache Tez and Apache Spark. Pig gives Hadoop Ecosystem a data flow capability abstracting ETL-like functionality away from the user. It allows us to extract a large dataset from HDFS, then allows it to do necessary functions (such ...