book

Ansible: Up and Running

Name: Ansible: Up and Running
Author: Lorin Hochstein
ISBN: 9781491915325

by Lorin Hochstein

May 2015

Intermediate to advanced

200 pages

7h 14m

English

O'Reilly Media, Inc.

Read now

Unlock full access

Foreword
Preface
Why I Wrote This BookWho Should Read This BookNavigating This BookConventions Used in This BookOnline ResourcesSafari® Books OnlineHow to Contact UsAcknowledgments
1. Introduction
A Note About VersionsAnsible: What Is It Good For?How Ansible WorksWhat’s So Great About Ansible?Easy-to-Read SyntaxNothing to Install on the Remote HostsPush-BasedAnsible Scales DownBuilt-in ModulesVery Thin Layer of AbstractionIs Ansible Too Simple?What Do I Need to Know?What Isn’t CoveredInstalling AnsibleSetting Up a Server for TestingUsing Vagrant to Set Up a Test ServerTelling Ansible About Your Test ServerSimplifying with the ansible.cfg FileMoving Forward
2. Playbooks: A Beginning
Some PreliminariesA Very Simple PlaybookSpecifying an nginx Config FileCreating a Custom HomepageCreating a Webservers GroupRunning the PlaybookPlaybooks Are YAMLStart of FileCommentsStringsBooleansListsDictionariesLine FoldingAnatomy of a PlaybookPlaysTasksModulesPutting It All TogetherDid Anything Change? Tracking Host StateGetting Fancier: TLS SupportGenerating TLS certificateVariablesGenerating the Nginx Configuration TemplateHandlersRunning the Playbook
3. Inventory: Describing Your Servers
The Inventory FilePreliminaries: Multiple Vagrant MachinesBehavioral Inventory Parametersansible_connectionansible_shell_typeansible_python_interpreteransible_*_interpreterChanging Behavioral Parameter DefaultsGroups and Groups and GroupsExample: Deploying a Django AppAliases and PortsGroups of GroupsNumbered Hosts (Pets versus Cattle)Hosts and Group Variables: Inside the InventoryHost and Group Variables: In Their Own FilesDynamic InventoryThe Interface for a Dynamic Inventory ScriptWriting a Dynamic Inventory ScriptPre-Existing Inventory ScriptsBreaking Out the Inventory into Multiple FilesAdding Entries at Runtime with add_host and group_byadd_hostgroup_by
4. Variables and Facts
Defining Variables in PlaybooksViewing the Values of VariablesRegistering VariablesFactsViewing All Facts Associated with a ServerViewing a Subset of FactsAny Module Can Return FactsLocal FactsUsing set_fact to Define a New VariableBuilt-in Variableshostvarsinventory_hostnameGroupsSetting Variables on the Command LinePrecedence
5. Introducing Mezzanine: Our Test Application
Why Deploying to Production Is ComplicatedPostgreSQL: The DatabaseGunicorn: The Application ServerNginx: The Web ServerSupervisor: The Process Manager
6. Deploying Mezzanine with Ansible
Listing Tasks in a PlaybookOrganization of Deployed FilesVariables and Secret VariablesUsing Iteration (with_items) to Install Multiple PackagesAdding the Sudo Clause to a TaskUpdating the Apt CacheChecking Out the Project Using GitInstalling Mezzanine and Other Packages into a virtualenvComplex Arguments in Tasks: A Brief DigressionCreating the Database and Database UserGenerating the local_settings.py File from a TemplateRunning django-manage CommandsRunning Custom Python Scripts in the Context of the ApplicationSetting Service Configuration FilesEnabling the Nginx ConfigurationInstalling TLS CertificatesInstalling Twitter Cron JobThe Full PlaybookRunning the Playbook Against a Vagrant MachineDeploying Mezzanine on Multiple Machines
7. Complex Playbooks
Running a Task on the Control MachineRunning a Task on a Machine Other Than the HostManually Gathering FactsRunning on One Host at a TimeRunning Only OnceDealing with Badly Behaved Commands: changed_when and failed_whenRetrieving the IP Address from the HostEncrypting Sensitive Data with VaultPatterns for Specifying HostsLimiting Which Hosts RunFiltersThe Default FilterFilters for Registered VariablesFilters That Apply to File PathsWriting Your Own FilterLookupsfilepipeenvpasswordtemplatecsvfilednstxtredis_kvetcdWriting Your Own Lookup Plug-inMore Complicated Loopswith_lineswith_fileglobwith_dictLooping Constructs as Lookup Plug-ins
8. Roles: Scaling Up Your Playbooks
Basic Structure of a RoleExample: Database and Mezzanine RolesUsing Roles in Your PlaybooksPre-Tasks and Post-TasksA “Database” Role for Deploying the DatabaseA “Mezzanine” Role for Deploying MezzanineCreating Role Files and Directories with ansible-galaxyDependent RolesAnsible GalaxyWeb InterfaceCommand-Line InterfaceContributing Your Own Role

9. Making Ansible Go Even Faster
SSH Multiplexing and ControlPersistManually Enabling SSH MultiplexingSSH Multiplexing Options in AnsiblePipeliningEnabling PipeliningConfiguring Hosts for PipeliningFact CachingJSON File Fact-Caching BackendRedis Fact Caching BackendMemcached Fact Caching BackendParallelismAccelerated ModeFireball Mode
10. Custom Modules
Example: Checking That We Can Reach a Remote ServerUsing the Script Module Instead of Writing Your Owncan_reach as a ModuleWhere to Put Custom ModulesHow Ansible Invokes ModulesGenerate a Standalone Python Script with the Arguments (Python Only)Copy the Module to the HostCreate an Arguments File on the Host (Non-Python Only)Invoke the ModuleExpected OutputsOutput Variables Ansible ExpectsImplementing Modules in PythonParsing ArgumentsAccessing ParametersImporting the AnsibleModule Helper ClassArgument OptionsAnsibleModule Initializer ParametersReturning Success or FailureInvoking External CommandsCheck Mode (Dry Run)Documenting Your ModuleDebugging Your ModuleImplementing the Module in BashSpecifying an Alternaive Location for BashExample Modules
11. Vagrant
Convenient Vagrant Configuration OptionsPort Forwarding and Private IP AddressesEnabling Agent ForwardingThe Ansible ProvisionerWhen the Provisioner RunsInventory Generated by VagrantProvisioning in ParallelSpecifying Groups
12. Amazon EC2
TerminologyInstanceAmazon Machine ImageTagsSpecifying CredentialsEnvironment VariablesConfiguration FilesPrerequisite: Boto Python LibraryDynamic InventoryInventory CachingOther Configuration OptionsAuto-Generated GroupsDefining Dynamic Groups with TagsApplying Tags to Existing ResourcesNicer Group NamesEC2 Virtual Private Cloud (VPC) and EC2 ClassicConfiguring ansible.cfg for Use with ec2Launching New InstancesEC2 Key PairsCreating a New KeyUpload an Existing KeySecurity GroupsPermitted IP AddressesSecurity Group PortsGetting the Latest AMIAdding a New Instance to a GroupWaiting for the Server to Come UpCreating Instances the Idempotent WayPutting It All TogetherSpecifying a Virtual Private CloudDynamic Inventory and VPCBuilding AMIsWith the ec2_ami ModuleWith PackerOther Modules
13. Docker
The Case for Pairing Docker with AnsibleDocker Application Life CycleDockerizing Our Mezzanine ApplicationCreating Docker Images with AnsibleMezzanineThe Other Container ImagesPostgresMemcachedNginxCertsBuilding the ImagesDeploying the Dockerized ApplicationStarting the Database ContainerRetrieving the Database Container IP Address and Mapped PortWaiting for the Database to Start UpInitializing the DatabaseStarting the Memcached ContainerStarting the Mezzanine ContainerStarting the Certificate ContainerStarting the Nginx ContainerThe Entire Playbook
14. Debugging Ansible Playbooks
Debugging SSH IssuesThe Debug ModuleThe Assert ModuleChecking Your Playbook Before ExecutionSyntax CheckList HostsList TasksCheck ModeDiff (Show File Changes)Limiting Which Tasks RunStepStart-at-TaskTagsOnward
A. SSH
Native SSHSSH AgentStarting Up ssh-agentMac OS XLinuxAgent ForwardingSudo and Agent ForwardingHost Keys
B. Default Settings
C. Using IAM Roles for EC2 Credentials
AWS Management ConsoleCommand-Line
Glossary
Bibliography
Index

Content preview from Ansible: Up and Running

Chapter 12. Amazon EC2

Ansible has a number of features that make working with infrastructure-as-a-service (IaaS) clouds much easier. This chapter focuses on Amazon EC2 because it’s the most popular IaaS cloud and the one I know best. However, many of the concepts should transfer to other clouds supported by Ansible.

The two ways Ansible supports EC2 are:

A dynamic inventory plug-in for automatically populating your Ansible inventory instead of manually specifying your servers
Modules that perform actions on EC2 such as creating new servers

In this chapter, we’ll discuss both the EC2 dynamic inventory plug-in, as well as the EC2 modules.

What Is an IaaS Cloud?

You’ve probably heard so many references to “the cloud” in the technical press that you’re suffering from buzzword overload.¹ I’ll be precise about what I mean by an infrastructure-as-a-service (IaaS) cloud.

To start, here’s a typical user interaction with an IaaS cloud:

User: I want five new servers, each one with two CPUs, 4 GB of memory, and 100 GB of storage, running Ubuntu 14.04.
Service: Request received. Your request number is 432789.
User: What’s the current status of request 432789?
Service: Your servers are ready to go, at IP addresses 203.0.113.5, 203.0.113.13, 203.0.113.49, 203.0.113.124, 203.0.113.209.
User: I’m done with the servers associated with request 432789.
Service: Request received, the servers will be terminated.

An IaaS cloud is a service that enables a user to provision (create) new ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Publisher Resources

ISBN: 9781491915318Errata Page

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Ansible: Up and Running

by Lorin Hochstein

Chapter 12. Amazon EC2

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.