Hands-On Big Data Analytics with PySpark

Constructing the graph using edge

As we saw in the previous sections, we have edges and vertices, which is an RDD. As this is an RDD, we can get an edge. We have a lot of methods that are available on the normal RDD. We can use the max method, min method, sum method, and all other actions. We will apply the reduce method, so the reduce method will take two edges, we will take e1, e2, and we can perform some logic on it.

The e1 edge is an edge that has an attribute, destination, and a source, as shown in the following screenshot:

Since the edge is chaining together two vertices, we can perform some logic here. For example, if the e1 edge ...