O'Reilly logo

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Big Data Analytics Projects with Apache Spark

Video Description

Perform real-life data operations with Apache Spark.

About This Video

  • Explore and analyze large volumes of data effectively by combining the power of Big Data processing tools such as Hadoop and Spark.
  • Work with different kinds of data and implement various probabilistic models.
  • Learn the best use cases, identify the problem areas, and solved meet them with the help of the right data science techniques and methods for your projects.

In Detail

Ready to use statistical and machine-learning techniques across large data sets? This course shows you how the Apache Spark and the Hadoop MapReduce ecosystem is perfect for the job.

This course contains various projects that consist of real-world examples. The first project is to find top selling products for an e-commerce business by efficiently joining data sets in the Map/Reduce paradigm. Next, a Market Basket Analysis will help you identify items likely to be purchased together and find correlations between items in a set of transactions.

Moving on, you'll learn about probabilistic logistic regression by finding an author for a post. Next, you'll build a content-based recommendation system for movies to predict whether an action will happen, which we’ll do by building a trained model. Finally, we’ll use the Map/Reduce Spark program to calculate mutual friends on social network.

By the end of this course, you’ll have been exposed to a wide variety of mathematical techniques that can be utilized as training models with the Spark and Hadoop software, and know how to solve common problems.