March 2025
Intermediate to advanced
408 pages
10h 29m
Portuguese (Portugal, Brazil)
Content preview from Guia de estudo do Databricks Certified Data Engineer Associate
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Capítulo 6. Criando pipelines de produção
Este trabalho foi traduzido com recurso a IA. Agradecemos o teu feedback e comentários: translation-feedback@oreilly.com
À medida que nossos pipelines de dados crescem em complexidade, precisamos considerar como produzi-los para garantir confiabilidade, escalabilidade e facilidade de manutenção. É aqui que entra a criação de pipelines de produção, que é o foco das páginas a seguir. Neste capítulo, exploraremos como criar pipelines de produção robustos e eficientes usando Delta Live Tables e Databricks Jobs. Vamos nos aprofundar nas nuances do controle da qualidade dos dados, capturando alterações de dados e orquestrando fluxos de trabalho para automatizar nossos pipelines.
Explorar as mesas Delta Live
O Delta Live Tables (DLT) é uma ferramenta poderosa que permite-te criar facilmente pipelines de dados de produção. Ao fornecer uma forma simples e intuitiva de gerir pipelines de dados, a DLT permite-te concentrar-te na extração de informações dos teus dados. Nesta secção, vamos mergulhar no mundo das Tabelas dinâmicas Delta, explorando as suas principais funcionalidades, vantagens e casos de utilização.
Apresentamos-te as mesas Delta Live
O Delta Live Tables é uma estrutura ETL declarativa alimentada pelo Apache Spark para criar pipelines de dados fiáveis e fáceis de manter. Foi concebido para simplificar o processo de criação de pipelines de processamento de dados em grande escala, mantendo as dependências de tabelas e a qualidade dos ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.