To use the standard (Cloud Pub/Sub to Cloud Storage text) Dataflow template, we'll break the setup into four steps:
- Creation of the Pub/Sub topic and subscription
- Creating the Dataflow pipeline
- Sending test temperature data to the Pub/Sub topic
- Viewing the processed data and the stored data on Google Storage
Let's look into these steps in detail:
- First, let's create a Pub/Sub topic to receive the IoT sensor's temperate data:
$ gcloud pubsub topics create tempSensorTopic
- Next, we'll create a subscription that can read data off the topic:
$ gcloud pubsub subscriptions create readTempSubscptn --topic tempSensorTopic
- On the GCP Console, you can view the created Pub/Sub topic and subscription:
- The next stage is the creation ...