Hands-On Software Engineering with Golang

Creating an ER diagram for the link graph store

The following diagram presents the ER diagram for the link graph data access layer. Given that the crawler retrieves web page links and discovers connections between websites, it makes sense for us to use a graph-based representation for our system modeling. As you can see, the ER diagram is comprised of two models: Link and Edge:

Figure 2: The ER diagram for the link graph component

Link model instances represent the set of web pages that have been processed or discovered by the crawler component. Its attribute set consists of an ID value for uniquely identifying each link, the URL associated ...