Embarrassingly parallel jobs and Not embarrassingly parallel jobs

Embarrassingly parallel jobs are tasks that can be executed independently without any dependency requirement between the tasks. This enables each task to have its process and computing space and in turn, scale parallely to complete the given job faster:

Embarrassingly parallel job

Let's take a simple example, where we are counting, number of a topic from Twitter stream every 10 minutes. The key words to look in this example is the PARTITION BY PartitionId. Stream Analytics job takes advantage of partitions in the input or output. PARTITION BY PartitionId let's divide the data ...

Get Stream Analytics with Microsoft Azure now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.