Mastering Machine Learning with Spark 2.x

Model deployment

The model deployment is the most important part of model life cycle. At this stage, the model is fed by real-life data and produce results that can support decision making (for example, accepting or rejecting a loan).

In this chapter, we will build a simple application combining the Spark streaming the models we exported earlier and shared code library, which we defined while writing the model-training application.

The latest Spark 2.1 introduces structural streaming, which is built upon the Spark SQL and allows us to utilize the SQL interface transparently with the streaming data. Furthermore, it brings a strong feature in the form of "exactly-once" semantics, which means that events are not dropped or delivered multiple ...