Submitting Jobs to Your HDInsight Cluster
Apart from the cluster-management operations you saw in the previous chapter, you can use the .NET SDK and the Windows PowerShell cmdlets to control your job submission and execution in your HDInsight cluster. The jobs are typically MapReduce jobs because that is the only thing that Hadoop understands. You can write your MapReduce jobs in .NET and also use supporting projects—such as Hive, Pig, and so forth—to avoid coding MapReduce programs, which can often be tedious and time consuming.
In all the samples I have shown so far, I used the command-line consoles. However, this does not need to ...