book

The Enterprise Data Catalog

by Ole Olesen-Bagneux

February 2023

Beginner to intermediate

216 pages

5h 51m

English

O'Reilly Media, Inc.

Book available

Read now

Unlock full access

Who Should Read This BookNavigating This BookConventions Used in This BookO’Reilly Online LearningHow to Contact UsAcknowledgments
The Core Functionality of a Data CatalogCreate an Overview of the IT LandscapeOrganize DataEnable Search of Company DataData DiscoveryThe Data Discovery TeamData ArchitectsData EngineersData Discovery Team SetupEnd-User Roles and ResponsibilitiesSummary
Organizing Domains in the Data CatalogDomain Architecture in a Data CatalogUnderstanding DomainsProcesses and CapabilitiesData SourcesGetting Assets into the Data CatalogPullPushOrganizing Assets in the DomainsAsset MetadataMetadata QualityClassificationSummary
Why Do You Search in a Data Catalog?Search Features in a Data CatalogSearching in Data Versus Searching for DataHow Do You Search a Data Catalog?Data Catalog Query LanguageThe Search Features in a Data Catalog ExplainedSearching for Everything?The Mechanics of SearchRecall and PrecisionZipf’s LawSerendipitySummary
Search Like Librarians—Not Like Data ScientistsSearch PatternsBasic Simple SearchDetailed Simple SearchFlexible Simple SearchRange SearchBlock SearchStatement SearchBrowsing PatternsGlossary BrowsingDomain BrowsingLineage BrowsingGraph BrowsingSearching a Graph-Based Data CatalogSummary
A Data Catalog Is a Social NetworkActive MetadataEnsure Stakeholder EngagementEngage Data Governance LeadersEngage Data Analytics LeadersEngage Domain LeadersSeeing All Data Through One LensThe Operational Backbone and the Data PlatformSummary
Choosing a Data CatalogVendor AnalysisSome Key VendorsCatalog of CatalogsHow to Access DataData Providers and Data ConsumersCentralized ApproachDecentralized ApproachCombined ApproachBuilding DomainsQuestionnaire No. 1: Domain Owner Description of Domain and AssetsQuestionnaire No. 2: Asset Steward Description of Assets in the DomainQuestionnaire No. 3: Asset Steward Description of the Glossary Terms of Their AssetsSummary

The Value of Data Lifecycle Management and Why the Data Catalog Is a Game ChangerVarious LifecyclesData LifecycleUsing the Data Catalog for Data Lifecycle ManagementThe Data Asset Lifecycle in the Data CatalogGlossary Term LifecycleData Source LifecycleLifecycle Influence and SupportApplied Search Based on LifecyclesApplied Search for Regulatory ComplianceMaintenance Best PracticesMaintenance of the Data Outside the Data CatalogMaintenance of Metadata Inside the Data CatalogImproved Data Lifecycle ManagementSummary
The Company Search EngineThe Company Search Engine in Hugin & MuninFrom Data to KnowledgeA Medium Theoretical Take on the Company Search EngineIs the Company Search Engine New?Will the Company Search Engine Become Reality?Summary
Consider Implementing a Data CatalogFollow Me

Content preview from The Enterprise Data Catalog

Part III. Envisioning the Future of Data Catalogs

In the last part of this book, I present my vision of how data catalogs will evolve in the future. In my view, they will evolve into company search engines, providing access to not only all the data but all the knowledge in your company.

In Chapter 8, “Looking Ahead: The Company Search Engine and Improved Data Management”, you will take a look at the conceptual and technical foundation for a future company search engine. I will discuss how smooth and complete search in companies will be in the future.

In the Afterword, I discuss the philosophical implications of the company search engine. Just like searching the web, being able to search all the data and knowledge in your company raises many ethical dilemmas that need to be addressed and handled.

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Start your free trial

Data Quality Fundamentals

Barr Moses, Lior Gavish, Molly Vorwerck

Data Management at Scale, 2nd Edition

Piethein Strengholt

Financial Data Engineering

Tamer Khraisha

Data Governance: The Definitive Guide

Evren Eryurek, Uri Gilad, Valliappa Lakshmanan, Anita Kibunguchy-Grant, Jessi Ashdown

Publisher Resources

ISBN: 9781492098706Errata Page