book

PySpark Recipes: A Problem-Solution Approach with PySpark2

Name: PySpark Recipes: A Problem-Solution Approach with PySpark2
Author: Raju Kumar Mishra
ISBN: 9781484231418

by Raju Kumar Mishra

December 2017

Intermediate to advanced

280 pages

5h 56m

English

Apress

Content preview from PySpark Recipes: A Problem-Solution Approach with PySpark2

Raju Kumar MishraPySpark Recipeshttps://doi.org/10.1007/978-1-4842-3141-8_2

2. Installation

Raju Kumar Mishra¹

(1)

Bangalore, Karnataka, India

In the upcoming chapters, we are going to solve many problems by using PySpark . PySpark also interacts with many other big data frameworks to provide end-to-end solutions. PySpark might read data from HDFS , NoSQL databases , or a relational database management system (RDBMS) . After data analysis, we can also save the results into HDFS or databases.

This chapter covers all the software installations that are required to go through this book. We are going to install all the required big data frameworks on the CentOS operating system . CentOS is an enterprise-class operating system. ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Processing Covid-19 Data with Apache Spark

Publisher Resources

ISBN: 9781484231418

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

PySpark Recipes: A Problem-Solution Approach with PySpark2

by Raju Kumar Mishra

2. Installation

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.