Time for action – exporting data from MySQL to HDFS

We'll use a straightforward example here, where we just pull all the data from a single MySQL table and write it to a single file on HDFS.

  1. Run Sqoop to export data from MySQL onto HDFS:
    $ sqoop import --connect jdbc:mysql://10.0.0.100/hadooptest 
--username hadoopuser \ > --password password --table employees
    Time for action – exporting data from MySQL to HDFS
  2. Examine the output directory:
    $ hadoop fs -ls employees

    You will receive the following response:

    Found 6 items
-rw-r--r--   3 hadoop supergroup          0 2012-05-21 04:10 /user/hadoop/employees/_SUCCESS
drwxr-xr-x   - hadoop supergroup          0 2012-05-21 04:10 /user/hadoop/employees/_logs
-rw-r--r-- 3 … /user/hadoop/employees/part-m-00000 ...

Get Hadoop: Data Processing and Modelling now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial