April 2018
Beginner to intermediate
282 pages
9h 53m
English
In the following use case, we will be discussing how BigQuery and PubSub can be used to stream Twitter data to BigQuery. The architecture is as follows for this use case. Let's discuss that in more detail:

Here, we have the requirement of streaming Twitter data using Cloud PubSub to Cloud BigQuery and performing analytics on top of it. Therefore, we first have to create an application on Twitter. This Twitter application will give us authority to access Twitter tweets.
Then we will create a topic in Cloud PubSub, and also a Google Kubernetes Engine cluster. Now we have to publish Twitter streaming data to Cloud PubSub. And CLoud BigQuery ...