May 2017
Beginner to intermediate
596 pages
15h 2m
English
Content preview from Data Lake for Enterprises
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
Start your free trial
Configuring HDFS as destination
Sqoop’s natural destinations are HDFS and RDBMS for import and export respectively. However, Sqoop 2 also supports few more connectors to the list, namely Kafka and Kite.
Kite is a high-level data layer for Hadoop. It is an API and a set of tools that speed up development. You configure how Kite stores your data in Hadoop, instead of building and maintaining that infrastructure yourself.
- http://kitesdk.org/docs/current/
With respect to Sqoop 1, both the source and destination are provided as part of the command line parameters, as would be evident in the examples covered in this chapter.