As well as Hadoop tools such as Apache Pig, Spark Core, and Spark SQL - you can also use Cloud Dataflow. We can use Cloud Dataflow for batch as well as streaming data.
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month, and much more.