In this chapter, we will look at the metadata repositories for data management.
As you will notice, this chapter is short. It describes data catalogs and database modeling tools as unique metadata repositories. Following these two repositories, we will look at a handful of technologies that support various aspects of data management, including data engineering and science. These are not metadata repositories as such but can still be thought of as containing crucial metadata that is relevant for the overall topic of this book. This detail is important to remember as you read the chapter.
In sum, the metadata repositories covered in this chapter are:
Data catalogs (DCs)
Database model management (DBM)
Other metadata repositories for data management
Ready? Here we go!
Data Catalog
The DC is like a search engine for data in your company.1 Some metadata repositories, such as the CMDB discussed in the previous chapter or the ISMS discussed in the next chapter, make generic and rather abstract lists of the data that is assumed to be in the IT landscape. That’s not the case with the DC, which shows you the data that actually is in your IT landscape.
The DC depicts the data in your IT landscape at a metadata layer by either crawling or streaming metadata from the data sources in the IT landscape into the DC. It therefore has a physical connection to what it depicts, as you can see in the diagram of the core capability of a DC in Figure 4-1.
Figure ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month, and much more.
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
