Skip to Main Content
Implementing AWS: Design, Build, and Manage your Infrastructure
book

Implementing AWS: Design, Build, and Manage your Infrastructure

by Yohan Wadia, Rowan Udell, Lucas Chan, Udita Gupta
January 2019
Intermediate to advanced content levelIntermediate to advanced
690 pages
16h
English
Packt Publishing
Content preview from Implementing AWS: Design, Build, and Manage your Infrastructure

Working with data pipeline definition Files

The AWS Data Pipeline console provides us with three different options to get started with creating a new pipeline. You could use the architect mode, which is exactly what we ended up working with in the earlier section, or alternatively, use any one of the pre-defined templates as a boilerplate and build your pipeline fro them. Last but not the least, the console also provides you with an ability to upload your very own pipeline definition file, which is basically a collection of various pipeline objects and conditions written in a JSON format. In this section, we will be learning how to write our very own pipeline definitions and later, use the same for building a custom pipeline as well.

To start, ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

AWS Account Setup Best Practices

AWS Account Setup Best Practices

Chad Smith
AWS Administration Cookbook

AWS Administration Cookbook

Rowan Udell, Lucas Chan

Publisher Resources

ISBN: 9781788835770OtherErrata Page