Software Architect's Handbook

Batch job

Batch jobs are placed in a job queue, either on-demand or based on a schedule. For the purpose of speeding up the execution of the jobs, the master/worker pattern can be used with jobs. The master/worker pattern, which is sometimes referred to as the master/slave pattern, speeds up jobs by splitting them up into smaller tasks so that the tasks can be processed in parallel.

The following diagram shows the processing of a job:

A component playing the role of Master splits the job (working set) up into tasks and launches workers. In this case, the workers are function instances and they can process tasks in parallel. Workers continue ...