Mastering Spark for Data Science

Practical applications

Now that we have our algorithm coded, let's look at practical applications for this method on real data. We will start by understanding how the algorithm performs, so that we can determine where we might use it.

Algorithm characteristics

So, what are the characteristics of this algorithm? Below is a list of strengths and weaknesses.

Advantages

The advantages are as follows:

• The algorithm is general, lending itself well to both stream based and Spark implementations
• The theory is simple, yet effective
• The implementation is fast and efficient
• The result is visual and interpretable
• The method is stackable and allows for multi scale studies; this is very simple when using Spark windows

Disadvantages

The disadvantages are as follows:

• A lagging ...