Industrial Internet Application Development

Data ingestion

Data from the IIoT devices typically gets ingested to the Data APIs, such as the time series store, the asset store, or the event store. Ingestion typically happens using a well defined end point such as the REST API End Point, or using a Pub/Sub model using one of the cloud connector protocol options we discussed before, such as MQTT, HTTPs or WebSockets. A typical Publisher/Subscribe model is implemented using event hub/HTTP REST proxy, or custom clients for Kafka. Data can then be processed using real-time processing engines such as Storm or Spark runtime, and then kept for longer time storage in the HDFS, NoSQL, or OLTP data store, depending on the types of data. This can be seen in the following diagram: