Scala and Spark for Big Data Analytics

Step 11: Starting the HDFS

From the bin directory in step 10, execute the following command:

$ cd ../sbin$ ./hadoop-daemon.sh start namenode

Upon successful execution of the preceding command, you should see the following on your terminal:

starting namenode, logging to /opt/yarn/hadoop-2.7.3/logs/hadoop-hdfs-namenode-limulus.out

To start the secondarynamenode and the datanode, you should use the following command:

$ ./hadoop-daemon.sh start secondarynamenode

You should receive the following message on your terminal if the preceding commands succeed:

Starting secondarynamenode, logging to /opt/yarn/hadoop-2.7.3/logs/hadoop-hdfs-secondarynamenode-limulus.out

Then use the following command to start the data node:

$ ./hadoop-daemon.sh start datanode ...