O'Reilly logo

SQL Server 2017 Integration Services Cookbook by Dejan Sarka, Matija Lah, Christian Cote

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

How to do it...

  1. In the StgAggregatedSales.dtsx SSIS package, drag and drop an Azure Pig Task onto the control flow. Rename it apt_AggregateData.
  1. Double-click on it to open the Azure HDInsight Pig Task Editor and set the properties as shown in the following screenshot:
  1. In the script property, insert the following code:
SalesExtractsSource = LOAD 'wasbs:///Import/FactOrdersAggregated.txt'; 
rmf wasbs:///Export/; 
STORE SalesExtractsSource INTO 'wasbs:///Export/' USING PigStorage('|'); 
  1. The first line holds a reference to the Import/FactOrdersAggregated.txt file. The second line removes (deleting) the directory /Export. Finally, the data ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required