O'Reilly logo

Pro Microsoft HDInsight: Hadoop on Windows by Debarchan Sarkar

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

CHAPTER 5

image

Submitting Jobs to Your HDInsight Cluster

Apart from the cluster-management operations you saw in the previous chapter, you can use the .NET SDK and the Windows PowerShell cmdlets to control your job submission and execution in your HDInsight cluster. The jobs are typically MapReduce jobs because that is the only thing that Hadoop understands. You can write your MapReduce jobs in .NET and also use supporting projects—such as Hive, Pig, and so forth—to avoid coding MapReduce programs, which can often be tedious and time consuming.

In all the samples I have shown so far, I used the command-line consoles. However, this does not need to ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required