Data Engineering on Microsoft Fabric: Build, Manage, and Scale Data Solutions

Data is everywhere, and it comes in many shapes and forms. How can you handle the complexity and diversity of data sources and formats, and use them to gain insights and drive decisions? Microsoft Fabric is the answer. It is a comprehensive solution that lets you create and use Lakehouses and Data Warehouses, two data architectures that combine the strengths of data lakes and data warehouses. Whether you need to work with structured or unstructured data, or perform simple or complex queries, or apply machine learning models, this course will help you master Microsoft Fabric and achieve your data goals.

In this course, you will learn the fundamentals of Lakehouses and Data Warehouses, and how to choose the best option for your data scenario. You will also learn how to use the tools and services within Microsoft Fabric to ingest, transform, and query data, using both low-code and coding approaches. You will also learn how to create and manage data pipelines, and how to monitor and optimize the performance and security of your data systems. By the end of this course, you will have the skills and confidence to work with Microsoft Fabric and take your data career to the next level. This course is ideal for data engineers, data analysts, and data scientists who want to learn how to use Microsoft Fabric to handle diverse and complex data challenges.

What you’ll learn and how to apply it

• Create and load data into lakehouses and data warehouses using Data Flows Gen 2 and Pipelines
• Use Apache Spark notebooks and Data Wrangler to explore and transform data in the Data Engineering Workload
• Use T-SQL and CoPilot to query and optimize data in the Data Warehouse Workload
• Select the most appropriate workload for different use cases and leverage Taskflows to orchestrate multiple workloads
• Create and schedule reports in Power BI using Direct Lake and other connectors
• Utilize shortcuts, cloning, APIs, Activator, Git integration, and security features to enhance their productivity and collaboration in Microsoft Fabric

This course is for you because

You are a data engineer, data analyst, and data scientist who wants to learn how to use Microsoft Fabric to handle diverse and complex data challenges.

Prerequisites

• Knowledge of managing and maintaining data systems is required
• Creating and administering Power BI reports
• Basic understanding of SQL, Python or Apache Spark