book

Apache Sqoop Cookbook

by Kathleen Ting, Jarek Jarcec Cecho

July 2013

Intermediate to advanced

94 pages

1h 52m

English

O'Reilly Media, Inc.

Read now

Unlock full access

Sqoop 2Conventions Used in This BookUsing Code ExamplesSafari® Books OnlineHow to Contact UsAcknowledgmentsJarcec ThanksKathleen Thanks
Downloading and Installing SqoopProblemSolutionDiscussionInstalling JDBC DriversProblemSolutionDiscussionInstalling Specialized ConnectorsProblemSolutionDiscussionStarting SqoopProblemSolutionDiscussionGetting Help with SqoopProblemSolutionDiscussion
Transferring an Entire TableProblemSolutionDiscussionSpecifying a Target DirectoryProblemSolutionDiscussionImporting Only a Subset of DataProblemSolutionDiscussionProtecting Your PasswordProblemSolutionDiscussionUsing a File Format Other Than CSVProblemSolutionDiscussionCompressing Imported DataProblemSolutionDiscussionSpeeding Up TransfersProblemSolutionDiscussionSee AlsoOverriding Type MappingProblemSolutionDiscussionControlling ParallelismProblemSolutionDiscussionEncoding NULL ValuesProblemSolutionDiscussionSee AlsoImporting All Your TablesProblemSolutionDiscussion
Importing Only New DataProblemSolutionDiscussionIncrementally Importing Mutable DataProblemSolutionDiscussionPreserving the Last Imported ValueProblemSolutionDiscussionStoring Passwords in the MetastoreProblemSolutionDiscussionOverriding the Arguments to a Saved JobProblemSolutionDiscussionSharing the Metastore Between Sqoop ClientsProblemSolutionDiscussion
Importing Data from Two TablesProblemSolutionDiscussionUsing Custom Boundary QueriesProblemSolutionDiscussionRenaming Sqoop Job InstancesProblemSolutionDiscussionImporting Queries with Duplicated ColumnsProblemSolutionDiscussion
Transferring Data from HadoopProblemSolutionDiscussionInserting Data in BatchesProblemSolutionDiscussionExporting with All-or-Nothing SemanticsProblemSolutionDiscussionUpdating an Existing Data SetProblemSolutionDiscussionUpdating or Inserting at the Same TimeProblemSolutionDiscussionSee AlsoUsing Stored ProceduresProblemSolutionDiscussionExporting into a Subset of ColumnsProblemSolutionDiscussionEncoding the NULL Value DifferentlyProblemSolutionDiscussionSee AlsoExporting Corrupted DataProblemSolutionDiscussion
Scheduling Sqoop Jobs with OozieProblemSolutionDiscussionSpecifying Commands in OozieProblemSolutionDiscussionUsing Property Parameters in OozieProblemSolutionDiscussionInstalling JDBC Drivers in OozieProblemSolutionDiscussionSee AlsoImporting Data Directly into HiveProblemSolutionDiscussionSee AlsoUsing Partitioned Hive TablesProblemSolutionDiscussionReplacing Special Delimiters During Hive ImportProblemSolutionDiscussionUsing the Correct NULL String in HiveProblemSolutionDiscussionSee AlsoImporting Data into HBaseProblemSolutionDiscussionImporting All Rows into HBaseProblemSolutionDiscussionImproving Performance When Importing into HBaseProblemSolutionDiscussion
Overriding Imported boolean Values in PostgreSQL Direct ImportProblemSolutionDiscussionSee AlsoImporting a Table Stored in Custom Schema in PostgreSQLProblemSolutionDiscussionExporting into PostgreSQL Using pg_bulkloadProblemSolutionDiscussionSee AlsoConnecting to MySQLProblemSolutionDiscussionUsing Direct MySQL Import into HiveProblemSolutionDiscussionSee AlsoUsing the upsert Feature When Exporting into MySQLProblemSolutionDiscussionSee AlsoImporting from OracleProblemSolutionDiscussionUsing Synonyms in OracleProblemSolutionDiscussionFaster Transfers with OracleProblemSolutionDiscussionSee AlsoImporting into Avro with OraOopProblemSolutionDiscussionChoosing the Proper Connector for OracleProblemSolutionDiscussionExporting into TeradataProblemSolutionDiscussionSee AlsoUsing the Cloudera Teradata ConnectorProblemSolutionDiscussionSee AlsoUsing Long Column Names in TeradataProblemSolutionDiscussion

Content preview from Apache Sqoop Cookbook

About the Authors

Kathleen Ting is currently a Customer Operations Engineering Manager at Cloudera where she helps customers deploy and use the Hadoop ecosystem in production. She has spoken on Hadoop, ZooKeeper, and Sqoop at many Big Data conferences including Hadoop World, ApacheCon, and OSCON. She's contributed to several projects in the open source community and is a Committer and PMC Member on Sqoop.

Jarek Jarcec Cecho is currently a Software Engineer at Cloudera where he develops software to help customers better access and integrate with the Hadoop ecosystem. He has led the Sqoop community in the architecture of the next generation of Sqoop, known as Sqoop 2. He's contributed to several projects in the open source community and is a Committer and PMC Member on Sqoop, Flume, and MRUnit.