Importing and exporting data into HDFS using Hadoop shell commands

HDFS provides shell command access to much of its functionality. These commands are built on top of the HDFS FileSystem API. Hadoop comes with a shell script that drives all interaction from the command line. This shell script is named hadoop and is usually located in $HADOOP_BIN, where $HADOOP_BIN is the full path to the Hadoop binary folder. For convenience, $HADOOP_BIN should be set in your $PATH environment variable. All of the Hadoop filesystem shell commands take the general form hadoop fs -COMMAND.

To get a full listing of the filesystem commands, run the hadoop shell script passing it the fs option with no commands.

hadoop fs

These command names along with their functionality ...

Get Hadoop Real-World Solutions Cookbook now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.