book

Pro Puppet

Name: Pro Puppet
ISBN: 9781430230571

by James Turnbull, Jeffrey McCune

May 2011

Intermediate to advanced

336 pages

8h 5m

English

Apress

Read now

Unlock full access

Copyright
About the Authors
About the Technical Reviewer
Acknowledgments
Introduction
1. Getting Started with Puppet
1.1. What Is Puppet?1.1.1. Deployment1.1.2. Configuration Language and Resource Abstraction Layer1.1.2.1. Configuration Language1.1.2.2. Resource Abstraction Layer1.1.3. Transactional Layer1.2. Selecting the Right Version of Puppet1.3. Can I mix releases of Puppet?1.4. Installing Puppet1.4.1. Installing on Red Hat Enterprise Linux and Fedora1.4.2. Installing on Debian and Ubuntu1.4.3. Installing on OpenSolaris1.4.4. Installing from Source1.4.5. Installing on Microsoft Windows1.4.6. Installing on other Platforms1.5. Configuring Puppet1.5.1. The site.pp file1.5.2. Firewall Configuration1.5.3. Starting the Puppet Master1.6. Connecting Our First Agent1.6.1. Completing the Connection1.7. Creating Our First Configuration1.7.1. Extending the site.pp file1.7.2. Agent Configuration1.8. Creating our first module1.8.1. Module Structure1.8.2. The init.pp file1.9. Applying Our First Configuration1.10. Summary1.11. Resources
2. Building Hosts with Puppet
2.1. Getting Started2.1.1. Installing Puppet2.1.2. Configuring Nodes2.1.2.1. Working With Similar Hosts2.1.2.2. Using External Sources2.1.2.3. Specifying a Default Node2.1.2.4. Node Inheritance Structure2.1.2.4.1. Variable Scoping2.2. Making (More) Magic With Modules2.2.1. Version Controlling Your Modules2.3. Creating a module to Manage SSH2.3.1. Managing Our Classes2.3.1.1. The ssh::install Class2.3.1.2. The ssh::config Class2.3.1.3. The ssh::service Class2.4. Creating a Module to Manage Postfix2.4.1. The postfix::install class2.4.2. The postfix::config class2.4.3. The postfix::service class2.5. Managing MySQL with the mysql Module2.5.1. The mysql::install class2.5.2. The mysql::config class2.5.3. The mysql::service class2.6. Managing Apache and Websites2.6.1. The apache::install class2.6.2. The apache::service class2.6.3. The Apache definition2.7. Managing Puppet with the Puppet Module2.8. Summary2.9. Resources
3. Working with Environments
3.1. Configuring Puppet Environments3.1.1. Populating the New Environments3.1.1.1. Creating a Clone3.1.2. Making Changes to the Development Environment3.2. Testing the New Environments with the Puppet Agent3.3. Environment Branching and Merging3.3.1. Setting Up a Central Repository3.3.1.1. Creating a Bare Repository for the Modules3.3.1.2. Making Individual Changes3.3.2. Developing a Change Using a Branch3.3.2.1. Making Changes to the sshd Configuration File3.3.2.2. Testing the Puppet Agent Against the sshd Configuration File3.3.2.3. Making Changes to the Postfix Configuration File3.3.2.4. Testing the Puppet Agent Against the Postfix Configuration File3.3.3. Merging Changes into a Testing Environment3.3.3.1. Creating the Testing Branch3.3.3.2. Merging the Changes into the Development Branch3.3.3.3. Merging into the Testing Branch3.3.3.4. Performing Checkout on the Testing Branch3.3.3.5. Testing the Changes3.4. Production Environment Releases3.5. Summary3.6. Resources
4. Puppet Scalability
4.1. Identifying the Challenges4.2. Running the Puppet Master with Apache and Passenger4.2.1. Installing Apache and Passenger on Enterprise Linux4.2.2. Installing Apache and Passenger on Debian-Based Systems4.2.3. Installing Passenger Using Ruby Gems4.2.4. Configuring Apache and Passenger4.2.5. Testing the Puppet Master in Apache4.3. Load-Balancing Multiple Puppet Masters4.3.1. HTTP Load Balancing4.3.1.1. Puppet Master Worker Configuration4.3.1.2. Front End Load Balancer Configuration4.3.1.3. Testing the Load Balancer Configuration4.3.2. Puppet CA Load Balancing Configuration4.3.2.1. Puppet CA Worker Configuration4.3.2.2. Synchronizing the Hot Standby Puppet CA Directory4.3.2.3. Puppet CA Hot Standby4.3.2.4. Primary Puppet CA Fail Back4.4. Measuring Performance4.4.1. Splay Time4.5. Summary4.6. Resources
5. Externalizing Puppet Configuration
5.1. External Node Classification5.1.1. Configuring Nodes Using An External Node Classifier5.1.2. An External Node Classifier in a Shell Script5.1.3. A Ruby External Node Classifier5.1.4. A Perl External Node Classifier5.1.5. Back-Ending a Node Classification5.2. Storing Node Configuration in LDAP5.2.1. Installing Ruby LDAP Libraries5.2.2. Setting Up the LDAP Server5.2.3. Adding the Puppet Schema5.2.4. Configuring LDAP in Puppet5.3. Summary5.4. Resources

6. Exporting and Storing Configuration
6.1. Virtual Resources6.1.1. Declaring and Realizing a Virtual Resource6.1.2. Applying the Realize Function6.1.3. Making Virtual Resources Real6.1.4. Relationship-Chaining Syntax6.2. Getting Started with Exported and Stored Configurations6.2.1. The Stored Configuration Database Server6.2.1.1. Installing Packages on Enterprise Linux-Based Systems6.2.1.2. Installing Packages on Debian and Ubuntu6.2.1.3. Installing Rails Using Gems6.2.2. Configuring Puppet Master for Stored Configuration6.2.3. Adding a MySQL Table Index6.3. Using Exported Resources6.3.1. Automated SSH Public Host Key Management6.3.2. Exporting Load Balancer Worker Resources6.3.3. Automating Nagios Service Checks6.4. Scaling Stored Configurations6.4.1. Thin Stored Configurations6.4.2. Queue Support for Stored Configurations6.4.3. Installing ActiveMQ on Enterprise Linux-Based Systems6.4.4. Installing ActiveMQ on Debian-Based Systems6.4.5. Puppet Master Queue Configuration6.5. Expiring Stale Resources6.6. Summary6.7. Resources
7. Puppet Consoles: Puppet Dashboard and The Foreman
7.1. Puppet Dashboard7.1.1. Installing Puppet Dashboard7.1.1.1. Installing the Red Hat Prerequisites7.1.1.2. Installing the Ubuntu Prerequisites7.1.1.3. Installing the Dashboard Package7.1.1.3.1. RPM Packages via Yum7.1.1.3.2. DEB Packages via APT7.1.1.3.3. Installing from Source7.1.2. Configuring the Dashboard7.1.3. Running Puppet Dashboard7.1.3.1. Running Puppet Dashboard with Webrick7.1.3.2. Running Puppet Dashboard with Passenger7.1.3.2.1. Installing Prerequisite Packages7.1.3.2.2. Configure an Apache Virtual Host7.1.4. Integrating Puppet Dashboard7.1.4.1. Importing Existing Reports7.1.4.2. Live Report Aggregation7.1.4.2.1. Puppet 2.6.0 and later7.1.4.2.2. Puppet 0.25.x and earlier7.1.4.3. Viewing Reports7.1.5. External Node Classification7.1.6. Logging, Database Backup and Performance7.2. The Foreman7.2.1. Installing Foreman7.2.1.1. Installing Foreman via RPM7.2.1.2. Installing via DEB7.2.2. Configuring Foreman7.2.2.1. Configuring Foreman on Red Hat7.2.2.2. Configuring Foreman on Ubuntu and Debian7.2.2.3. Managing Foreman's Database7.2.2.4. Importing Data from Puppet7.2.3. Starting Foreman7.2.4. Integrating Foreman's Capabilities7.2.4.1. Using Foreman as an ENC7.2.5. Displaying Reports in Foreman7.2.6. Displaying Nodes Information in Foreman7.2.7. Using Foreman to trigger Puppet7.3. Summary7.4. Resources
8. Tools and Integration
8.1. Puppet Forge and Module Tool8.1.1. Installing the Puppet Module Tool8.1.2. Searching and Installing a Module from the Forge8.1.3. Using a Module8.1.4. Creating a Module with the Puppet-Module Tool8.1.4.1. Managing Modules with Git8.1.4.2. Managing Platform-Specific Resources8.1.4.3. Building and Testing a Puppet Module8.1.4.4. Adding Enterprise Linux Support to the NTP Module8.1.4.5. Releasing the NTP Module to the Forge8.2. Puppet Ruby DSL8.2.1. The Problem: Resources from Data8.2.2. Declaring Resources from Data8.2.2.1. A Small Puppet Module Using the Ruby DSL8.2.2.2. Testing the Ruby DSL8.2.2.3. Account Information from an ENC8.2.2.4. Accounts Ruby DSL Module8.2.2.5. Testing the Ruby DSL Accounts Module8.3. Cucumber Puppet8.3.1. Installing Cucumber Puppet8.3.2. Writing a Story8.3.3. Testing the Basic Catalog Policy8.3.3.1. Testing the failure case8.3.4. Validating Specific Resources8.3.4.1. Adding a Check Step to the Policy8.3.4.2. Implementing the Cucumber Check8.3.4.3. Catching Changes in the ENC Data8.4. Summary8.5. Resources
9. Reporting with Puppet
9.1. Getting Started9.2. Configuring Reporting9.3. Report Processors9.3.1. log9.3.2. tagmail9.3.3. rrdgraph9.3.4. http9.4. Custom Reporting9.5. Summary9.6. Resources
10. Extending Facter and Puppet
10.1. Writing and Distributing Custom Facts10.1.1. Configuring Puppet for Custom Facts10.1.2. Writing Custom Facts10.1.3. Testing the Facts10.2. Developing Custom Types, Providers and Functions10.2.1. Configuring Puppet for Types, Providers and Functions10.2.2. Writing a Puppet Type and Provider10.2.2.1. Creating Our Type10.2.2.2. Creating the Subversion Provider10.2.2.3. Using Your New Type10.2.3. Writing a Parsed File Type and Provider10.2.3.1. The Shells Type10.2.3.2. The Shells Provider10.2.4. A More Complex Type and Provider10.2.4.1. The httpauth Type10.2.4.2. The httpauth Provider10.2.5. Testing Types and Providers10.2.6. Writing Custom Functions10.3. Summary10.4. Resources
11. Marionette Collective
11.1. Installing and Configuring RabbitMQ11.1.1. Installing RabbitMQ on Debian11.1.2. Installing RabbitMQ on RHEL / CentOS11.1.3. RabbitMQ Configuration11.1.4. Installing MCollective on Debian and Ubuntu11.1.5. Installing MCollective on Enterprise Linux11.1.6. MCollective Server Configuration11.2. MCollective Plugins11.2.1. Puppet Agent MCollective Plugins11.2.1.1. Downloading the Plugins11.2.1.2. Installing an MCollective Agent Plugin11.2.1.3. Loading the Agent Plugin11.2.1.4. Verifying the Agent Plugin is Loaded11.2.1.5. Running Puppet from MCollective11.2.1.6. Listing All Loaded Agent Plugins11.2.2. The Facter Plugin for MCollective11.2.3. Additional Plugins11.3. Addressing Hosts with Metadata11.4. Summary11.5. Resources
A. Working with Puppet
A.1. Getting Support and TrainingA.2. ResourcesA.2.1. WebA.2.2. Mailing ListsA.2.3. Puppet Module ForgeA.2.4. Puppet EnterpriseA.2.5. Support (commercial)A.2.6. TrainingA.2.7. IRC

Content preview from Pro Puppet

Chapter 6. Exporting and Storing Configuration

So far in the book, you've seen how Puppet models configuration on a single host. In many cases, however, you have configuration on multiple hosts that have a relationship; for example, your monitoring system needs to know about configuration on hosts being monitored. In this chapter we look at three features that exist in Puppet to help model resources on multiple hosts: virtual resources, exported resources, and stored configuration.

The first feature, virtual resources, is a method of managing resources where multiple configurations require a resource. For example, a user may be required on some hosts but not others. Virtual resources allow you to define a resource but be selective about where you ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Publisher Resources

ISBN: 9781430230571Purchase book

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Pro Puppet

by James Turnbull, Jeffrey McCune

Chapter 6. Exporting and Storing Configuration

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.