CHAPTER 5
Submitting Jobs to Your HDInsight Cluster
Apart from the cluster-management operations you saw in the previous chapter, you can use the .NET SDK and the Windows PowerShell cmdlets to control your job submission and execution in your HDInsight cluster. The jobs are typically MapReduce jobs because that is the only thing that Hadoop understands. You can write your MapReduce jobs in .NET and also use supporting projects—such as Hive, Pig, and so forth—to avoid coding MapReduce programs, which can often be tedious and time consuming.
In all the samples I have shown so far, I used the command-line consoles. However, this does not need to ...
Get Pro Microsoft HDInsight: Hadoop on Windows now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
