Loading data to Azure Blob storage using Azure PowerShell

Azure HDInsight provides 100 percent HDFS functionality using Azure Blob storage under the covers. So, to load data to the cluster, we can load data straight to Azure Blob storage without the need of the HDInsight cluster, thereby, making this more cost effective. In this section, we will see how to load data to Azure Blob using Azure PowerShell.

To load the data to Azure Blob storage from a local filesystem, we will perform the following steps:

  1. Open Azure PowerShell using the shortcut on your desktop and type in the Get-AzurePublishSettingsFile command. This will open the manage.windowsazure.com web page and download a .publishsettings file.
  2. Next, type in the Import-AzurePublishSettingsFile ...

Get HDInsight Essentials - Second Edition now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial