Skip to Content
Data Management at Scale
book

Data Management at Scale

by Piethein Strengholt
July 2020
Intermediate to advanced
345 pages
10h 47m
English
O'Reilly Media, Inc.
Content preview from Data Management at Scale

Glossary

Apache Avro

Apache Avro is an open source project that provides data serialization and data exchange services for the Apache Kafka and Apache Hadoop ecosystems. It has a serialization service programs can use to serialize the data into files or messages efficiently. It relies on a schema-based system (repository). In Avro the schema is always provided with the data. It stores the data definition in JSON. Apache Avro currently works well within the Hadoop ecosystem (including Apache Kafka).

Apache Thrift

Apache Thrift was developed at Facebook in 2007 and is an open source project. It uses a wide ranges of languages and offers a full client/server stack many projects can directly work with. It also uses an IDL (interface definition language) for describing the data types, which is quite similar to JSON and easily readable by humans.

Access tokens

Rather than using a username and password, an access token is used to represent the identity of the user or user’s groups. It can contain additional attributes and abstracts that describe the context in which the token can be used or the time window in which the token is valid.

Accuracy

The degree to which the data reflect the truth or reality. A spelling mistake is a good example of inaccurate data.

ACID

ACID stands for atomicity, consistency, isolation, durability.

Atomicity ensures that a transaction is either fully completed, or is not begun at all. Consistency enforces that the system is in a valid state at the ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

Data Management at Scale, 2nd Edition

Data Management at Scale, 2nd Edition

Piethein Strengholt
Data Governance: The Definitive Guide

Data Governance: The Definitive Guide

Evren Eryurek, Uri Gilad, Valliappa Lakshmanan, Anita Kibunguchy-Grant, Jessi Ashdown
Data Quality Fundamentals

Data Quality Fundamentals

Barr Moses, Lior Gavish, Molly Vorwerck
The Enterprise Data Catalog

The Enterprise Data Catalog

Ole Olesen-Bagneux

Publisher Resources

ISBN: 9781492054771Errata Page