Simplified grid computing

Cloud computing gives us enough power and technologies to do almost anything. Such a statement is true until we do not deal with real-world limits. As discussed in the Parallel programming section in Chapter 1, Performance Thoughts in, some overhead that limits the system's scalability always exists. This is Amdahl's law. Although this sentence is definitely true, we can avoid many such limitations. Grid computing is the art of parallelizing computation with a large number of systems.

Although specific frameworks or languages do exist, we will see how to create a small grid computing system from scratch in C#.

The first thing to do is have a huge dataset divided into smaller datasets. This improves scalability at the highest ...

Get Learning .NET High-performance Programming now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.