Working with Hadoop shell commands

We have seen HDFS-specific commands in the previous section. Now, let's go over all of the filesystem-specific commands. These can be called with hadoop fs <command> or hdfs dfs <command> directly. Hadoop provides a generic shell command that can be used across different filesystems. The following table describes the list of commands, the different parameters that need to be passed, and their description. I have also covered important parameters in a day-to-day context that you would need. Apache also provides FS shell command guide (https://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-hdfs/HDFSCommands.html), where you can see more specific details with examples:

Command

Parameters

Get Apache Hadoop 3 Quick Start Guide now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.