Skip to Content on-demand course PySpark and AWS: Master Big Data with PySpark and AWS September 2021
Beginner to intermediate
16h 11m
English
Closed Captioning available in English Course outline Chapter 1 : Introduction 12m
Chapter 2 : Introduction to Hadoop, Spark Ecosystems and Architectures 43m
Chapter 3 : Spark RDDs 4h 52m
Chapter 4 : Spark DFs 4h 53m
Introduction to Spark DFs8m 9s
Creating Spark DFs10m 35s
Spark Infer Schema7m 48s
Spark Provide Schema8m 29s
Create DF from RDD8m 21s
Rectifying the Error5m 18s
Select DF Columns11m 50s
Spark DF with Column19m 46s
Spark DF with Column Renamed and Alias6m 13s
Spark DF Filter Rows16m 5s
Quiz (Select, Withcolumn, Filter)1m 27s
Solution (Select, Withcolumn, Filter)10m 20s
Spark DF (Count, Distinct, Duplicate)10m 56s
Quiz (Distinct, Duplicate)45s
Solution (Distinct, Duplicate)5m 8s
Spark DF (Sort, OrderBy)6m 25s
Quiz (Sort, OrderBy)1m 55s
Solution (Sort, OrderBy)8m 54s
Spark DF (Group By)12m 31s
Spark DF (Group By - Multiple Columns and Aggregations)10m 38s
Spark DF (Group By -Visualization)13m 27s
Spark DF (Group By - Filtering)11m 8s
Quiz (Group By)52s
Solution (Group By)7m 38s
Quiz (Word Count)54s
Solution (Word Count)4m 30s
Spark DF (UDFs)8m 34s
Quiz (UDFs)1m 30s
Solution (UDFs)7m 57s
Solution (Cache and Persist)7m 30s
Spark DF (DF to RDD)7m 24s
Spark DF (Spark SQL)6m 16s
Spark DF (Write DF)10m 45s
Project Overview2m 11s
Project (Count and Select)4m 11s
Project (Group By)4m 26s
Project (Group By, Aggregations and Order By)5m 4s
Project (Filtering)8m 20s
Project (UDF and WithColumn)6m 12s
Project (Write)3m 17s
Chapter 5 : Collaborative Filtering 1h 3m
Chapter 6 : Spark Streaming 50m
Chapter 7 : ETL Pipeline 1h 6m
Chapter 8 : Project - Change Data Capture / Replication Ongoing 2h 29m
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month, Start your free trial