Hands-On Industrial Internet of Things

Streaming versus batch analytics

Streaming analytics are triggered when data flows into the system. This method is very good for simpler analytics, such as simple rules or signal-processing. However, things become more complicated if analytics require the support of an additional data source or if they require data of a specific size.

An alternative to streaming is to schedule the analytics to run regularly after a set period of time, such as every 10 seconds. This involves checking the availability of the data and then pulling it from the data lake or the time-series database. We call these analytics micro-batch analytics.

Micro-batch analytics have a few great advantages:

• They are easy to debug and to develop offline
• They can require a ...