Skip to Main Content
Implementing AWS: Design, Build, and Manage your Infrastructure
book

Implementing AWS: Design, Build, and Manage your Infrastructure

by Yohan Wadia, Rowan Udell, Lucas Chan, Udita Gupta
January 2019
Intermediate to advanced content levelIntermediate to advanced
690 pages
16h
English
Packt Publishing
Content preview from Implementing AWS: Design, Build, and Manage your Infrastructure

Executing remote commands using AWS Data Pipeline

One of the best parts of working with Data Pipeline is that versatility of tasks that you can achieve by just using this one tool. In this section, we will be looking at a relatively simple pipeline definition using which you can execute remote scripts and commands on EC2 instances.

How does this setup work? Well, to start with, we will be requiring one S3 bucket (can be present in any AWS region) to be created that will store and act as a repository for all our shell scripts. Once the bucket is created, simply create and upload the following shell script to the bucket. Note however that in this case, the shell script is named simplescript.sh and the same name is used in the following pipeline ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

AWS Account Setup Best Practices

AWS Account Setup Best Practices

Chad Smith
AWS Administration Cookbook

AWS Administration Cookbook

Rowan Udell, Lucas Chan

Publisher Resources

ISBN: 9781788835770OtherErrata Page