October 2021
Beginner to intermediate
256 pages
4h 38m
English
Content preview from The Informed Company
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Chapter TwentyStyle Guide Example
Going through and creating a clean data warehouse and marts makes the data easier to understand for everyone. As an organization grows, more than one person will help clean and transform the data. There are aspects of cleaning that are subjective, and we need to codify what we want to happen. For example, we will want to rename a column to make it more readable, but should we use snake case (e.g. example_new_column) or camel case (e.g. ExampleNewColumn)? In the book we said snake case, but this is a judgment call and you could go with another convention.
Document cleaning goals and stylistic preferences in a style guide so that we clean the data consistently and others can help.
We have provided sample style guides at the end of the chapter.
Simplify
It's quite common for raw data to be extremely complicated. When data comes into existence, in most cases, it's intended to be used by applications and not directly by business users. Taking time to simplify data significantly improves the ability for business users to successfully query it.
Only Include Fields That Have an Apparent Analytical Purpose
If your system makes it easy to update/add new columns, it's best to start modeling with only the most relevant columns, excluding any columns that have no direct or apparent analytical purpose.
Extract Relevant Data from Complex Data Tpes
Application data sources may contain JSON, arrays, Hstore, and other complex data types. These are typically ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.