O'Reilly logo

Industrial Internet Application Development by Kishore Reddipalli, Prashant Tyagi, Jayant Thomas, Alena Traukina

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Technology stack to handle data for IIoT

The architecture that we just described can be implemented using a variety of available technologies. Some of this information is summarized in the following diagram, where the choice of technology stack is related to the use case, as well as notes/highlights associated with each one of these:

Platform service Technology stack Use case Highlights
Talend Use for first-time ingestion. Barch and real time.
Scoop Bulk data transfer between Hadoop and relational data stores. Two-way replication with both snapshots and incremental updates.
Ingestion Flume Online analytics applications and collects log data to store on HDFS. Reliable, available, maintains central list of ongoing data flows.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required