Table of Contents
Preface
Part 1 – Introduction to Data Engineering, Scala, and an Environment Setup
1
Scala Essentials for Data Engineers
Technical requirements
Understanding functional programming
Understanding objects, classes, and traits
Classes
Object
Trait
Working with higher-order functions (HOFs)
Examples of HOFs from the Scala collection library
Understanding polymorphic functions
Variance
Option type
Collections
Understanding pattern matching
Wildcard patterns
Constant patterns
Variable patterns
Constructor patterns
Sequence patterns
Tuple patterns
Typed patterns
Implicits in Scala
Summary
Further reading
2
Environment Setup
Technical requirements
Setting up a cloud environment
Leveraging cloud object storage
Using Databricks
Local ...
Get Data Engineering with Scala and Spark now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
