How do I run an Apache Spark script on an Amazon Elastic MapReduce (EMR) cluster?

Learn how to use steps in the EMR console to schedule and run Spark scripts stored in Amazon S3, on both new and existing clusters.

By Frank Kane
June 9, 2017
Screenshot from "How do I run an Apache Spark script on an Amazon Elastic MapReduce (EMR) cluster?" Screenshot from "How do I run an Apache Spark script on an Amazon Elastic MapReduce (EMR) cluster?" (source: O'Reilly)

Amazon Web Services pro Frank Kane shows you how to use steps in the AWS Elastic MapReduce (EMR) console to quickly run your Spark scripts stored in S3. Learn how to save time and money by automating the running of a Spark driver script when a new cluster is created, saving the results in S3, and terminating the cluster when it is done.

Learn more about running Spark for big data analysis on the Amazon Elastic MapReduce service (EMR) with video training from Frank Kane.

Learn faster. Dig deeper. See farther.

Join the O'Reilly online learning platform. Get a free trial today and find answers on the fly, or master something new and useful.

Learn more
Post topics: Data
Post tags: Questions
Share: