If you were handed two different but related sets of data, what tools would you use to find the matches? What if all you had was SQL SELECT access to a database? In this practical book, author Jim Lehmer provides best practices, techniques, and tricks to help you import, clean, match, score, and think about heterogeneous data using SQL.
DBAs, programmers, business analysts, and data scientists will learn how to identify and remove duplicates, parse strings, extract data from XML and JSON, generate SQL using SQL, regularize data and prepare datasets, and apply data quality and ETL approaches for finding the similarities and differences between various expressions of the same data.
Full of real-world techniques, the examples in the book contain working code. You'll learn how to:
- Identity and remove duplicates in two different datasets using SQL
- Regularize data and achieve data quality using SQL
- Extract data from XML and JSON
- Generate SQL using SQL to increase your productivity
- Prepare datasets for import, merging, and better analysis using SQL
- Report results using SQL
- Apply data quality and ETL approaches to finding similarities and differences between various expressions of the same data
Table of contents
- What Problems Are We Trying to Solve?
- What Will We Cover?
- Who Is This Book For?
- Why SQL?
- Warning! Opinions Ahead!
- Typographical Conventions Used in This Book
- Additional Information on the Book’s Conventions
- The Data “Model”
- Using Code Examples
- O’Reilly Online Learning
- How to Contact Us
- I. Review
- 1. A SELECT Review
2. Function Junction
- Aggregate Functions
- Conversion Functions
- Cryptographic Functions: HASHBYTES
- Date and Time Functions
- Logical Functions: IIF
- String Functions
- System Functions
- Final Thoughts on Functions
- II. Various Data Problems
- 3. Names, Names, Names
- 4. Location, Location, Location
- 5. Dates, Dates, Dates
- 6. Email
- 7. Phone Numbers
- 8. Bad Characters
- 9. Orthogonal Data
- III. Bringing It Together
- 10. The Big Score
- 11. Data Quality, or GIGO
- 12. Tying It All Together
- 13. Code Is Data, Too!
- Appendix. The Data “Model”
- About the Author
- Title: Fuzzy Data Matching with SQL
- Release date: October 2023
- Publisher(s): O'Reilly Media, Inc.
- ISBN: 9781098152277
You might also like
How do you turn raw, unprocessed, or malformed data into dynamic, interactive web visualizations? In this …
SQL for Data Analysis
With the explosion of data, computing power, and cloud data warehouses, SQL has become an even …
Cost-Effective Data Pipelines
The low cost of getting started with cloud services can easily evolve into a significant expense …
SQL Antipatterns, Volume 1
SQL is the ubiquitous language for software developers working with structured data. Most developers who rely …