Skip to Content
Creating a Data-Driven Enterprise with DataOps
book

Creating a Data-Driven Enterprise with DataOps

by Ashish Thusoo, Joydeep Sen Sarma
March 2017
Beginner to intermediate
163 pages
3h 45m
English
O'Reilly Media, Inc.
Content preview from Creating a Data-Driven Enterprise with DataOps

Chapter 7. Metadata and Big Data

Data by itself means very little. After all, a piece of digital data is simply a collection of bits. To be discovered (found) or understood, this collection of bits needs something called metadata. In this chapter, we cover what metadata is and why it’s important to the self-service data model.

First, a basic definition: metadata is any information that gives you information about the data. It’s data about data.

The Three Types of Metadata

There are different kinds of metadata that describe different aspects of the data with which they are associated. Specifically, metadata can be categorized as one of three types: descriptive, structural, or administrative, as illustrated in Figure 7-1.

Depending on the type of metadata, it is used for different purposes. For example, descriptive metadata would be used when business analysts want to know what exactly the data consists of. Structural metadata would tell us the relationship between different datasets. And administrative metadata would inform us about ownership and rights management.

Classes of metadata
Figure 7-1. Classes of metadata

Descriptive Metadata

Descriptive metadata describes a collection of bits, or piece of digital data, so that it can be cataloged, discovered, identified, explored, and so on. It can include elements such as title, abstract, author, and keywords. It is typically meant to be read by humans. ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

Managing Data Orchestration and Integration at Scale

Managing Data Orchestration and Integration at Scale

Kevin Poskitt, Ginger Gatling
Azure AI Services at Scale for Cloud, Mobile, and Edge

Azure AI Services at Scale for Cloud, Mobile, and Edge

Simon Bisson, Mary Branscombe, Chris Hoder, Anand Raman
Microsoft Azure Data Solutions - An Introduction

Microsoft Azure Data Solutions - An Introduction

Daniel A. Seara, Francesco Milano, Danilo Dominici

Publisher Resources

ISBN: 9781492049227