Chapter 8
Advanced Oozie Features
WHAT’S IN THIS CHAPTER?
- Building custom Oozie actions
- Building a dynamic Workflow
- Using the Oozie Java API
- Using uber jars with Oozie
- Building dynamic data pipelines
WROX.COM CODE DOWNLOADS FOR THIS CHAPTER
The wrox.com code downloads for this chapter are found at www.wrox.com/remtitle.cgi?isbn=1118611934 on the Download Code tab. The code is in the Chapter 8 download. All downloads for this chapter are provided as a single Eclipse project containing all of the example’s code.
By now, you should be familiar with the main components of Oozie and the way they interoperate. You have also learned how to design, build, and deploy Oozie applications, and how to use the Oozie console to view the execution of those applications.
In this chapter, you learn about a number of advanced Oozie topics that, once you understand them, will enable you to extend Oozie functionality and integrate Oozie with other enterprise applications. In this chapter, you learn about the following:
- How to build custom Oozie actions
- How to build Oozie applications dynamically
- How to invoke and control Oozie jobs programmatically through the Java API
- How use uber files with Oozie
At the end of the chapter, you will see a custom design for a fully automated data processing pipeline based on Oozie.
Let’s start by implementing some custom Oozie Workflow actions.
BUILDING CUSTOM OOZIE WORKFLOW ACTIONS
Out of the box, Oozie offers a minimal number of control and action nodes (described ...
Get Professional Hadoop Solutions now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
