Analyzing Data Using Spark 2.0 DataFrames With Python

Analyzing Data Using Spark 2.0 DataFrames With Python

by Jose Marcial Portilla
Released May 2017
Publisher(s): Infinite Skills
ISBN: 9781491986844

Watch it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Video description

Apache Spark 2.0 has become the gold standard for processing large datasets. This course, designed for learners with basic Python programming experience, takes you on an introductory journey into the world of big data analysis using Spark 2.0, Python, and the Spark DataFrame API.

Beginning with an overview of Spark 2.0 and Python, and then moving into a detailed examination of DataFrames, you'll learn about using SQL with DataFrames, DataFrame dates and timestamps, DataFrame aggregate operations, and about DataFrames and missing data. The course includes a hands-on data analysis exercise using real stock data. Learners should have Python and Spark installed on their computers before starting the class.

  • Gain a core understanding of Spark 2.0 and Spark DataFrames
  • Learn how to use Python with Spark DataFrames
  • Gain big data experience analyzing stock data with Python and Spark DataFrames
Jose Marcial Portilla is Head of Data Science at SF Bay area based Pierian Data, where he creates and delivers data science and Python training courses for Fortune 500 clients such as Credit Suisse, General Electric, and The New York Times. Jose holds degrees in Mechanical Engineering from Santa Clara University.

Product information

  • Title: Analyzing Data Using Spark 2.0 DataFrames With Python
  • Author(s): Jose Marcial Portilla
  • Release date: May 2017
  • Publisher(s): Infinite Skills
  • ISBN: 9781491986844