Mastering Machine Learning with Spark 2.x

Graph properties and operations

Having seen yet another artificial example, let's turn to a more interesting example next, which we will use to investigate some of the core properties that we have studied in the previous section. The data we will be considering in this chapter can be found at http://networkrepository.com/, an open network data repository with a vast amount of interesting data. First, we will load a relatively small data set retrieved from Twitter, which can be downloaded from http://networkrepository.com/rt-occupywallstnyc.php. Download the zip file available on this page, that is, store rt_occupywallstnyc.zip and unpack it to access the file, rt_occupywallstnyc.edges. The file is in the CSV format with commas as separators. ...