Video description
The course Scala from Beginner to Pro is refreshingly different. The well-thought-out quizzes and mini projects that cover all the important aspects will make your Scala learning journey that much easier. This course includes an overview of Hadoop and Spark with a hands-on project with Scala Spark. Right through the course, every theoretical explanation is followed by practical implementation.
This course is designed to reflect the most in-demand Scala skills that you will start using right away at the workplace. The course is simple to follow and understand. Expressive, exhaustive, and practical with live coding sessions and replete with quizzes. Rich with state-of-the-art and up-to-date knowledge of this field.
The 6 mini-projects and one Scala Spark project included in this course are a vital component of this course. These projects present you with a hands-on opportunity to experiment for yourself with trial and error. You get a chance to learn from the mistakes you make. Importantly, it’s easy to understand the potential gaps that might exist between theory and practice.
What You Will Learn
- Explore variables in data types in Scala
- Explore functions and their usage in Scala
- Learn data structures; namely, lists, ListBuffer, maps, sets, and stack
- Understand the flow controls in Scala and different ways to control the flow
- Explore the difference between Spark RDDs and Spark DFs
- ETL pipeline from AWS S3 to AWS RDS using Spark
Audience
This course is for absolute beginners who want to learn Spark and Scala along with its implementation in realistic projects; people who want to develop smart solutions; data scientists; and machine learning experts.
About The Author
AI Sciences: AI Sciences are experts, PhDs, and artificial intelligence practitioners, including computer science, machine learning, and Statistics. Some work in big companies such as Amazon, Google, Facebook, Microsoft, KPMG, BCG, and IBM.
AI sciences produce a series of courses dedicated to beginners and newcomers on techniques and methods of machine learning, statistics, artificial intelligence, and data science. They aim to help those who wish to understand techniques more easily and start with less theory and less extended reading. Today, they publish more comprehensive courses on specific topics for wider audiences.
Their courses have successfully helped more than 100,000 students master AI and data science.
Table of contents
- Chapter 1 : Introduction
-
Chapter 2 : Overview
- What is Scala
- Scala Setup (Local Machine)
- Hello World
- Scala Setup (Online)
- Variables in Scala
- Arithmetic Operations on Variables-1
- Arithmetic Operations on Variables-2
- Quiz (Arithmetic Operations)
- Solution (Arithmetic Operations)
- Quiz (Strings)
- Solution (Strings)
- Type Casting
- Taking Input from User
- Quiz (User Input and Type Casting)
- Solution (User Input and Type Casting)
-
Chapter 3 : Flow Control
- Overview of Control Statements
- If else statements
- Conditions in If
- Quiz (if statement)
- Solution (if statement)
- Nested If Else
- Quiz (Nested If Else)
- Solution (nested if else)
- Logical Operators
- Quiz (Logical Operators)
- Solution (Logical Operators)
- If Else If
- Quiz (If Else If)
- Solution (If Else If)
- Overview of Loops
- Overview of While Loop
- While Loop
- Quiz (While Loop)
- Solution 1 (While Loop)
- Solution 2 (While Loop)
- Do While Loop
- For Loop
- Quiz (For Loop)
- Solution (For Loop)
- Quiz(For Loop)
- Solution(For Loop)
- Break
- Break Fix
- Project Overview
- Project Solution Design
- Project Solution Code 1
- Project Solution Code 2
- Project Solution Code 3
- Project Solution Code 4
-
Chapter 4 : Functions
- Overview of Functions
- Writing Addition Function
- Quiz (Basic Functions)
- Solution (Basic Functions)
- Functions Common Issues
- Named Arguments
- Quiz (String Concatenation Function)
- Solution (String Concatenation Function)
- Quiz (Dividing Code in Functions)
- Solution (Dividing Code in Functions)
- Default Arguments
- Quiz (Default Arguments)
- Solution (Default Arguments)
- Anonymous Functions
- Quiz (Anonymous Functions)
- Solution (Anonymous Functions)
- Scopes
- Project Overview
- Checking Credentials
- Prompting the Menu
- Basic Functions
- Breaking Code in More Functions
- Final Run
- Chapter 5 : Classes
-
Chapter 6 : Data Structures
- Introduction of Data Structures
- Lists introduction
- Lists Create and Delete Elements
- Lists Take
- ListBuffer Introduction
- Add Data in ListBuffer
- Remove Data from ListBuffer
- Take Data from ListBuffer
- Project Overview
- Project Architecture Discussion
- Project Architecture Implementation
- User Input for Objects
- Implementing the Control Flow
- Creating Required Functions Inside Class
- Overview of Maps
- Creating Maps
- Check Key in Map
- Update Value in Map
- Add and Remove Items from Maps
- Iterating in Maps
- Project Overview
- Project Architecture
- Project Structure Code
- Using Maps for Word Count
- Final Run
- Sets Overview
- Add and Remove Item from the Set
- Set Operations
- Overview of Stack
- Push and Pop in Stack
- Stack Attributes
- Project Overview
- Project Architecture
- Extra Closing Bracket Use Case
- Extra Starting Bracket Use Case
-
Chapter 7 : Project
- Project Introduction
- Why Spark
- Hadoop Ecosystem
- Spark Architecture
- Spark Ecosystem
- DataBricks Account
- Setting Up DataBricks Cluster
- Spark Local Setup
- Spark Hadoop Setup
- Spark RDDs
- Spark RDDs (textFile, collect)
- Spark Local Run
- Understanding Map
- Understanding Flat Map
- Understanding Reduce by Key
- Word Count Example
- Spark DFs
- Spark DF Read Data
- Spark Print Schema, Select
- Spark Group By
- Spark DF Write
- Creating S3 Bucket
- Creating Database in RDS
- Performing ETL
Product information
- Title: Scala & Spark-Master Big Data with Scala and Spark
- Author(s):
- Release date: August 2021
- Publisher(s): Packt Publishing
- ISBN: 9781803248653
You might also like
video
Apache Spark with Scala - Learn Spark from a Big Data Guru
This course covers all the fundamentals of Apache Spark with Scala and teaches you everything you …
video
Spark Programming in Scala for Beginners with Apache Spark 3
Apache Spark is a lightning-fast unified analytics engine for big data and machine learning. Since its …
video
Streaming Big Data with Spark Streaming, Scala, and Spark 3!
In this course, you will learn the basics of the Scala programming language; learn how Apache …
video
Scala for the Impatient
4+ Hours of Video Instruction Overview In Scala for the Impatient LiveLessons best-selling author and professor …