book

Developing Web Applications with Perl, memcached, MySQL® and Apache

Name: Developing Web Applications with Perl, memcached, MySQL® and Apache
Author: Patrick Galbraith
ISBN: 9780470414644

by Patrick Galbraith

July 2009

Intermediate to advanced

887 pages

21h 8m

English

Wrox

Read now

Unlock full access

Copyright
Credits
About the Author
About the Technical Editor
Acknowledgments
Foreword
Introduction
Who This Book Is ForWhat This Book CoversHow This Book Is StructuredWhat You Need to Use This BookConventionsSource CodeErratap2p.wrox.com
1. LAMMP, Now with an Extra M
1.1. Linux1.2. Apache1.3. MySQL1.4. memcached1.4.1. Gear61.4.2. Clickability1.4.3. GaiaOnline1.4.4. How memcached Can Work for You1.5. Perl1.6. Other Technologies1.6.1. Sphinx1.6.2. Gearman1.7. The New Picture1.8. The Future of Open-Source Web Development and Databases1.9. Projects to Watch!1.10. Summary
2. MySQL
2.1. How CGI and PHP Changed the Web Dramatically2.2. About MySQL2.3. MySQL Programs2.3.1. Client Programs2.3.1.1. mysql2.3.1.2. mysql>2.3.1.3. mysqldump2.3.1.4. mysqladmin2.3.1.5. mysqlimport2.3.1.6. mysqlshow2.3.2. Utility Programs2.3.2.1. myisamchk2.3.2.2. mysqlbinlog2.3.2.3. mysql_config2.3.3. MySQL Daemon and Startup Utilities2.3.3.1. mysqld2.3.3.2. mysqld_safe2.3.3.3. mysql.server2.3.3.4. mysqld_multi2.4. Working with Data2.4.1. Creating a Schema and Tables2.4.1.1. What Exactly Is (or Is Not) NULL?2.4.1.2. Column Data Types2.4.1.3. Indexes2.4.1.4. Schema Information2.4.1.5. Schema Modification2.4.2. Inserting Data2.4.2.1. Basic Insert2.4.2.2. Bulk Insert2.4.2.3. INSERT IGNORE2.4.2.4. Delayed and Low Priority INSERTs2.4.3. Querying Data2.4.3.1. Basic Queries2.4.3.2. Aliasing2.4.3.3. Limiting Results2.4.3.4. WHERE Clause2.4.3.5. Operators2.4.3.6. Ranges2.4.3.7. Ordering2.4.3.8. Grouping2.4.3.9. JOIN2.4.3.10. UNION2.4.3.11. INSERT . . . SELECT2.4.4. Updating Data2.4.5. Deleting Data2.4.6. Replacing Data2.4.7. INSERT ... ON DUPLICATE KEY UPDATE2.4.8. Operators2.4.9. Functions2.4.9.1. Informational Functions2.4.9.2. Aggregate Functions2.4.9.3. Numeric Functions2.4.9.4. String Functions2.4.9.5. Date Functions2.4.9.6. Date and Time Functions; Control Flow Functions2.4.10. Using Help2.4.11. User-Defined Variables in MySQL2.5. MySQL Privileges2.5.1. MySQL Access Control Privilege System2.5.2. MySQL Global System User2.5.3. MySQL System Schema Grant Tables2.5.4. Account Management2.5.4.1. CREATE USER2.5.4.2. DROP USER2.5.4.3. SET PASSWORD2.5.4.4. GRANT2.5.4.5. SHOW GRANTS2.5.4.6. INFORMATION SCHEMA2.6. Summary
3. Advanced MySQL
3.1. SQL Features3.1.1. Stored Procedures and Functions3.1.1.1. Why Would You (Not) Want to Use Stored Procedures or Functions?3.1.1.2. Syntax3.1.1.3. Example 13.1.1.4. Example 23.1.1.5. Example 33.1.1.6. Example 43.1.1.7. Example Summary3.1.2. Triggers3.1.2.1. Creating a Trigger3.1.2.2. First Trigger Example3.1.2.3. Second Trigger Example3.1.2.4. Third Trigger Example3.1.2.5. Trigger Limitations in MySQL3.1.3. Views3.1.4. User Defined Functions3.1.4.1. Writing a UDF3.1.4.2. UDF Required Functions3.1.4.3. Simple User-Defined Function Example3.2. Storage Engines3.2.1. Commonly Used Storage Engines3.2.2. Storage Engine Abilities3.3. Using Storage Engines3.3.1. MyISAM3.3.1.1. Creating a MyISAM Table3.3.1.2. MyISAM Under the Hood3.3.1.3. MyISAM Table Maintenance3.3.2. InnoDB3.3.2.1. InnoDB Configuration3.3.2.2. Creating An InnoDB Table3.3.2.3. InnoDB Under the Hood3.3.2.4. The Beauty of Transactions3.3.3. Archive3.3.3.1. Archive under the Hood3.3.3.2. Archive Table Maintenance3.3.4. The Federated Storage Engine3.3.4.1. Characteristics of the Federated Storage Engine3.3.4.2. Creating a Federated Table3.3.4.3. Federated Servers3.3.4.4. Federated under the Hood3.3.5. Tina/CSV Storage Engine3.3.5.1. Creating a CSV Table3.3.5.2. CSV under the Hood3.3.6. Blackhole Storage Engine3.4. Replication3.4.1. Replication Overview3.4.2. Replication schemes3.4.3. Replication Command Options3.4.4. Setting Up Replication3.4.4.1. Running Multiple Instances of MySQL with mysqld_multi3.4.4.2. Adding Replication Command Options3.4.4.3. Verify the Replication is Running3.4.4.4. Manually Setting the Master3.4.5. Searching Text3.4.5.1. MySQL FULLTEXT Indexes3.4.5.2. Using MySQL Full-text Indexes3.4.5.3. Full-text Index Issues3.4.5.4. Sphinx Full-Text Search Engine3.4.5.5. Sphinx Configuration and Installation3.4.5.6. Sphinx.conf Settings3.4.5.6.1. Sphinx Data Sources3.4.5.6.2. Sphinx Indexes3.4.5.6.3. Sphinx Indexer Section3.4.5.6.4. The searchd Section3.4.5.6.5. Defining the Main Index3.4.5.7. Starting Sphinx3.4.5.8. Searching Sphinx3.4.5.8.1. Boolean Query Syntax3.4.5.8.2. The Utility Search3.4.6. When to Use Sphinx3.5. Summary

4. Perl Primer
4.1. What Exactly Is Perl?4.2. Perl Primer4.3. Perl Data Types4.3.1. Scalars4.3.2. Arrays4.3.3. Hashes4.3.4. File Handles4.3.5. Type Globs4.3.6. Subroutines4.4. Variable Usage4.4.1. References4.4.1.1. Scalar References4.4.1.2. Array References4.4.1.3. Hash References4.4.1.4. Reducing Arguments Passed with Hash References4.4.1.5. Subroutine References4.4.1.6. Using a Hash to Create a Dispatch Table4.4.1.7. Identifying References4.4.2. Scalar Usage4.4.3. Array Usage and Iteration4.4.3.1. for/foreach loop:4.4.3.2. map4.4.3.3. Adding and Splicing Arrays4.4.3.4. shift, unshift, pop, and push4.4.3.5. split and join4.4.3.6. sort4.4.3.7. reverse4.4.3.8. scalar4.4.3.9. Last Subscript Value of Array4.4.3.10. Array Slices4.4.3.11. Printing an Array4.4.4. Working with Hashes4.4.4.1. Looping: keys and values4.4.4.2. Make a Hash Out of Two Arrays4.4.4.3. Hashes as Arrays4.4.4.4. Complex Perl Data Structures4.4.4.5. File Handles4.4.4.6. File Functions4.4.4.7. Reading Files4.4.5. Writing to Files4.4.6. STDOUT and STDERR4.4.7. File Handles to Processes4.4.7.1. Reading from Process File Handles4.4.7.2. Writing to Process File Handles4.4.7.3. Directory Handles4.4.8. Subroutines4.4.8.1. shift Versus Using @_4.4.8.2. Who Called?4.4.9. Variable Scope4.4.9.1. Symbol Table4.4.9.2. Scope Example4.4.9.3. Forcing Scope Adherence4.5. Packages4.5.1. Perl Modules4.5.2. Writing a Perl Module4.5.3. @ISA array4.5.4. Documenting Your Module4.5.5. Making Your Module Installable4.5.6. Testing4.5.7. Adding a MANIFEST file4.5.8. CPAN4.6. Regex One-Liners4.6.1. Storing Regular Expressions in Variables4.6.2. Regex Optimizations4.6.2.1. Regex Compilation4.6.2.2. Grouping Optimization4.7. Perl 6 Tidbits4.8. Summary
5. Object-Oriented Perl
5.1. About Object Orientation5.2. Object Orientation in Perl5.2.1. Writing a Perl Class5.2.1.1. Creating a Package5.2.1.2. Constructors5.2.2. Adding Methods5.2.2.1. Accessors5.2.2.2. Setting Methods5.2.3. On-Demand Method Manifestation Using AUTOLOAD5.2.4. Other Methods5.2.4.1. Debug5.2.4.2. Documentation5.2.4.3. Inheritance and Felidea Subclassing5.2.5. Making Life Easier: Moose5.3. Summary
6. MySQL and Perl
6.1. Perl DBI6.1.1. DBI and DBD6.1.2. Installation6.1.2.1. Ubuntu6.1.2.2. Redhat, CentOS6.1.2.3. CPAN6.1.3. DBI API6.1.3.1. Loading DBI6.1.3.2. Driver Methods6.2. Connect6.2.1. $dsn6.2.2. $username and $password6.2.3. $attributes6.2.4. connect_cached6.3. Statement Handles6.3.1. Writing Data6.3.2. Reading Data6.3.3. Fetch Methods, One Row at a Time6.3.4. Fetch Methods—the Whole Shebang6.3.4.1. fetchall_arrayref6.3.4.2. fetchall_hashref6.3.4.3. Finish6.4. Binding Methods6.4.1. Binding Input Parameters6.4.2. Binding Output Parameters6.5. Other Statement Handle Methods6.5.1. rows6.5.2. dump_results6.6. Statement Handle Attributes6.7. MySQL-Specific Statement Handle Attributes6.8. Multistep Utility Methods6.8.1. do6.8.2. selectall_arrayref6.8.3. selectall_hashref6.8.4. selectcol_arrayref6.8.5. selectrow_array6.8.6. selectrow_arrayref6.8.7. selectrow_hashref6.9. Other Database Handle Methods6.9.1. last_insert_id6.9.2. ping6.9.3. clone6.9.4. Transactional Methods—begin_work, commit, rollback6.10. Stored Procedures6.11. Error Handling6.12. Server Admin6.13. Summary
7. Simple Database Application
7.1. Planning Application Functionality7.1.1. Schema Design7.1.2. Writing Up a Wire-Frame7.1.3. Declarations, Initializations7.1.4. Program Entry Point7.2. Table Creation Subroutine7.2.1. Using information_schema7.2.2. Listing Contacts7.2.3. Editing a Contact7.2.4. Inserting a Contact7.2.5. Updating a Contact7.2.6. Deleting a Contact7.3. Testing update_contact, insert_contact, and delete_contact7.3.1. Editing a Contact7.3.2. Adding a Contact7.3.3. Deleting a Contact7.4. Lookup of a Contact7.5. Testing Lookup of a Contact7.6. Summary
8. memcached
8.1. What Is memcached?8.2. How memcached Is Used8.2.1. What Is Gearman?8.2.2. Caching Strategies8.3. Installing memcached8.3.1.8.3.1.1. CentOS8.3.1.2. Ubuntu8.3.1.3. Installing memcached from Source8.4. Starting memcached8.4.1. Startup Scripts8.4.1.1. Debian-Based Startup Scripts8.4.1.2. Redhat-based Startup Scripts8.4.2. Installing the Cache::Memcached Perl Module8.5. Using Cache::Memcached8.5.1. Connecting, Instantiation8.5.2. Memcached Operations8.5.3. Cache::Memcached API8.6. Simple Examples8.6.1. Storing a Scalar8.6.2. Complex Data Types8.6.3. Add and Replace8.7. A More Practical Example8.7.1. User Application8.7.2. Data Design8.7.3. UserApp Package8.7.4. Instantiation8.7.5. Database Connector Method8.7.6. Data Retrieval Methods8.7.7. Simple Accessor Methods8.7.8. Data Modification Methods8.7.9. Using UserApp8.7.10. Memcached Connector Method8.7.11. Caching Implementation Plan8.7.12. Where to Add Caching?8.7.13. Caching Key Scheme8.7.14. Precaching8.7.15. Precaching Cities8.7.16. Precaching States8.7.17. Using Instantiation for Precaching Method Calls8.7.18. Modifying Accessor Methods to Use Cache8.7.18.1. getCity()8.7.18.2. getState()8.7.18.3. No Change Needed for Accessor Methods8.7.19. User Data Caching—Set Method Modifications8.7.20. User Data Caching—Get Method Modifications8.7.21. UserApp Now Has Caching!8.7.22. Other Caching Issues8.7.22.1. Cache Stampede/Dog-Piling/Thundering Herd8.7.22.2. Example of a Stale Key Used to Avoid Dog-Pile Effect8.7.22.3. Replicating Data to Multiple Caches8.8. Summary
9. Libmemcached
9.1. What Is libmemcached?9.1.1. libmemcached Features9.1.2. Libmemcache Utility Programs9.1.3. Installing libmemcached9.2. libmemcached Utility Programs9.2.1. memcat9.2.2. memflush9.2.3. memcp9.2.4. memstat9.2.5. memrm9.2.6. memslap9.2.7. memerror9.3. libmemcached Perl Driver9.3.1. Installation9.3.2. Memcached::libmemcached and libmemcached API using Memcached::libmemcached9.3.3. Connection Functions9.3.4. libmemcached Behavioral Functions9.3.5. Functions for Setting Values9.3.6. Data Retrieval (get) Functions9.3.7. Increment, Decrement, and Delete9.3.8. Informational and Utility Functions9.3.9. Object-Oriented Interface9.3.10. Procedure Memcached::libmemcached Program Example9.3.11. Object-Oriented Memcached::libmemcached Program Example9.4. Cache::memcached::libmemcached9.4.1. Performance Comparisons9.4.2. Writing Your Own Comparison Script9.5. Summary
10. Memcached Functions for MySQL
10.1. What Are Memcached Functions for MySQL?10.2. How Do the Memcached Functions for MySQL Work?10.3. Install the Memcached Functions for MySQL10.3.1. Prerequisites10.3.2. Configure the Source10.3.3. Build the Source10.3.4. Install the UDF10.3.4.1. SQL Script Install10.3.4.2. Perl Install Utility10.3.5. Checking Installation10.4. Using the Memcached Functions for MySQL10.4.1. Establishing a Connection to the memcached Server10.4.1.1. memc_servers_set10.4.1.2. memc_server_count10.4.2. Setting Values10.4.2.1. memc_set10.4.2.2. memc_set_by_key10.4.2.3. memc_add10.4.2.4. memc_replace10.4.2.5. memc_cas10.4.2.6. memc_prepend10.4.2.7. memc_append10.4.2.8. memc_delete10.4.3. Fetching, Incrementing, and Decrementing Functions10.4.3.1. memc_get10.4.3.2. memc_increment10.4.3.3. memc_decrement10.4.4. Behavioral Functions10.4.4.1. memc_list_behaviors10.4.4.2. memc_behavior_get10.4.4.3. memc_behavior_set10.4.4.4. memc_list_hash_types10.4.4.5. memc_list_distribution_types10.4.5. Statistical Functions10.4.5.1. memc_stats10.4.5.2. memc_stat_get_value10.4.5.3. memc_stat_get_keys10.4.6. Version Functions10.4.6.1. memc_libmemcached_version10.4.6.2. memc_udf_version10.5. Using memcached UDFs10.5.1. Single Database Handle Example10.5.1.1. Changes to Connection10.5.1.2. Changes to getUser()10.5.1.3. Creating More Convenience with Generic Get and Set Methods10.5.2. Fun with Triggers (and UDFs)10.5.3. Read-Through Caching with Simple Select Statements10.5.4. Updates, Too!10.6. Summary
11. Apache
11.1. Understanding Apache: An Overview11.2. Understanding the Apache Modules API11.2.1. Apache 2.2 Changes Since Apache 1.311.2.2. Apache 2.2 Request Phases11.2.2.1. Request Parsing Phase11.2.2.2. Security Phase11.2.2.3. Preparation Phase11.2.2.4. Handler Phase11.2.2.5. Understanding Hooks and Filters11.2.3. New and Modified Modules11.3. Installing Apache11.3.1. Installing Apache on Windows11.3.1.1. Installation of mod_perl11.3.2. Installing Apache and mod_perl on a Working UNIX System11.3.2.1. Ubuntu/Debian-based Linux11.3.2.2. Redhat-Based Systems (Centos, Fedora, Redhat Enterprise, etc.)11.3.3. Installing Apache on Apple OS X (10.5)11.3.4. Apache Source Install on UNIX11.4. Installing mod_perl from Source11.5. Installing libapreq2 from Source11.6. Apache Configuration11.6.1. Configuration Section Container Directives11.6.1.1. <Directory> and <DirectoryMatch>11.6.1.2. <Files> and <FilesMatch>11.6.1.3. <Location>11.6.1.4. <LocationMatch>11.6.1.5. <IfDefine>11.6.1.6. <IfModule>11.6.1.7. <IfVersion>11.6.1.8. <Limit>11.6.1.9. <LimitExcept>11.6.1.10. <Proxy>11.6.1.11. <ProxyMatch>11.6.1.12. <VirtualHost>11.6.2. Basic Directives11.6.2.1. ServerName11.6.2.2. ServerRoot11.6.2.3. DocumentRoot11.6.2.4. Include11.6.2.5. Listen11.6.2.6. LoadModule11.6.2.7. Options11.6.2.8. Redirect11.6.2.9. User11.6.2.10. AddType11.6.3. Server Tuning Directives11.6.3.1. StartServers11.6.3.2. MaxClients11.6.3.3. MaxSpareServers11.6.3.4. MinSpareServers11.6.3.5. ServerLimit11.6.3.6. MaxRequestsPerChild11.6.3.7. ThreadLimit11.6.3.8. ThreadsPerChild11.6.3.9. KeepAlive11.6.3.10. MaxKeepAliveRequests11.6.3.11. KeepAliveTimeout11.6.3.12. Timeout11.6.4. Logging Directives11.6.4.1. CustomLog11.6.4.2. TransferLog11.6.4.3. ErrorLog11.6.4.4. LogFormat11.6.4.5. LogLevel11.6.5. Error Directives11.6.5.1. ErrorDocument11.6.5.2. ServerSignature11.6.6. Access Control, Authentication, and Authorization11.6.6.1. Access Control11.6.6.2. Authentication11.6.6.3. Authorization11.6.6.4. Order11.6.6.5. Require11.6.6.6. AuthName11.6.6.7. AuthType11.6.6.8. AuthBasicProvider11.6.6.9. AuthUserFile11.6.6.10. AuthGroupFile11.6.6.11. AuthDBMType11.6.6.12. AuthDBMUserFile11.6.7. .htaccess File Directives11.6.7.1. AccessFileName11.6.7.2. AllowOverride11.6.8. Indexing Directives11.6.8.1. DirectoryIndex11.6.8.2. HeaderName11.6.8.3. IndexOptions11.6.8.4. IndexOrderDefault11.6.8.5. HeaderName11.6.8.6. AddIcon11.6.8.7. AddIconByEncoding11.6.8.8. AddIconByType11.6.8.9. DefaultIcon11.6.8.10. IndexIgnore11.6.9. CGI Directives11.6.9.1. ScriptAlias11.6.9.2. ScriptAliasMatch11.6.9.3. User Directory Directives11.6.9.4. UserDir11.6.10. VirtualHost Directives11.6.10.1. Types of Virtual Hosting11.6.10.2. NameVirtualHost11.6.11. Handler and Filter Directives11.6.11.1. AddHandler11.6.11.2. SetHandler11.6.11.3. AddInputFilter11.6.11.4. AddOutputFilter11.6.12. Client Handling11.6.12.1. BrowserMatch11.6.13. SSL Directives11.6.13.1. SSLEngine11.6.13.2. SSLRequireSSL11.6.13.3. SSLCertificateFile11.6.13.4. SSLCertificateKeyFile11.6.13.5. SSLSessionCache11.6.13.6. SLSessionCacheTimeout11.6.13.7. SSLMutex11.6.13.8. Limitations when Using Virtual Hosts and SSL11.6.14. Clickstream Analysis11.6.15. Rewriting URLs11.6.15.1. RewriteEngine11.6.15.2. RewriteCond11.6.15.3. Test String11.6.15.4. Back-References11.6.15.5. Rewrite Map Extensions11.6.16. Conditional Pattern11.6.16.1. Flags11.6.16.2. RewriteRule11.6.16.3. Condition-Pattern11.6.16.4. Substitution11.6.16.5. Flags11.6.16.6. RewriteLog11.6.16.7. RewriteLogLevel11.6.17. Apache Reverse Proxying11.6.18. Enabling mod_proxy11.6.19. mod_proxy Directives11.6.19.1. ProxyPass11.6.19.2. ProxyPassReverse11.6.19.3. ProxyPassReverseCookieDomain11.6.19.4. ProxyPassReverseCookiePath11.6.19.5. ProxyPreserveHost11.6.20. Apache Server Control11.7. Apache Configuration Schemes11.7.1. Source Install11.7.2. Ubuntu/Debian11.7.2.1. Configuration Files11.7.2.2. Documents, Content11.7.2.3. Apache Modules11.7.2.4. Binary Files11.7.2.5. Apache Server Control11.7.3. Centos/Redhat Variants11.7.3.1. Configuration Files11.7.3.2. Binary Files, Server Control11.7.3.3. Documents, Content11.7.4. SUSE11.7.4.1. Configuration Files11.7.4.2. Binaries11.7.4.3. Modules11.7.4.4. Documents, Content11.7.4.5. Apache Server Control11.7.5. Windows11.7.5.1. Configuration11.7.5.2. Configuration Files11.7.5.3. Other Files11.7.5.4. Apache Administration on Windows11.8. Common Apache Tasks11.8.1. Configuring a Name-Based Virtual Host11.8.1.1. Step 1: Modify Your Apache Configuration File11.8.1.2. Step 2: Create the Virtual Host Directories11.8.1.3. Step 3: Restart Apache11.8.1.4. Adding Other Virtual Hosts11.8.2. Setting Up HTTP Basic Authentication11.8.2.1. Step 1: Modify the Apache Configuration11.8.2.2. Step 2: Adding Users to the Password File11.8.2.3. Step 3: Restart Apache11.8.3. Setting Up Digest Authentication11.8.3.1. Step 1: Modify Your Apache configuration11.8.3.2. Step 2: Create Digest Users11.8.3.3. Step 3: Restart Apache11.8.4. Configuring a Secure Server11.8.4.1. Step 1: Create a Self-Signed Certificate11.8.4.2. Step 2: Add the Secure Virtual Host11.8.4.3. Step 3: Restart Apache11.8.5. Settin Up a Secure Server with a Valid Secure Certificate11.8.5.1. Step 1: Create a Key and Certificate Request11.8.5.2. Step 2: Obtain a Certificate Using the Certificate Request11.8.5.3. Step 3: Set Up a Virtual Host11.8.5.4. Step 4: Restart Apache11.8.6. Setting up a Reverse Proxy with Two Virtual Hosts11.8.6.1. Step 1: Set Up the Internal Virtual Host11.8.6.2. Step 2: Add Proxy Directives to the Front-End Server Configuration11.8.6.3. Step 3: Restart Apache11.9. Summary
12. Contact List Application
12.1. Using MySQL and memcached Together12.2. A CGI Program12.2.1. CGI Apache Setup12.2.2. Your Basic CGI Program, and Then Some12.2.2.1. Understanding the Application's Functionality12.2.2.2. Conceptualizing12.2.2.3. Program Requirements12.2.3. User Interface12.2.3.1. The Main User Form, User Listing12.2.3.2. User Edit Form12.2.3.3. Contact View Page12.2.4. Database Storage Requirements12.3. Program Flow12.3.1. First Things First12.3.2. Program Implementation12.3.2.1. Getting Started12.3.2.2. main() Subroutine12.3.2.3. header() Subroutine12.3.2.4. dispatcher() Subroutine12.3.2.5. mainform() Subroutine12.3.2.6. userlist() Subroutine12.3.2.7. userform() Subroutine12.3.2.8. viewuser() Subroutine12.4. WebApp Class Methods12.4.1. Instantiation with the new() Method12.4.2. Connection to MySQL12.4.3. Connection to memcached12.4.4. The getUsers() Method12.4.5. The getUser() Method12.4.6. The saveUser() Method12.5. Database Methods12.5.1. The insertUser() Method12.5.2. The updateUser() Method12.5.3. The deleteUsers() Method12.5.4. The userExists() Method12.6. Caching Methods12.6.1. The saveUserToCache() Method12.6.2. The cacheUsers() Method12.6.3. The getUsersFromCache() Method12.6.4. The userExistsInCache() Method12.6.5. The deleteUserFromCache Method12.6.6. The setMemcUIDList() Method12.6.7. The updateMemcUIDList Method12.6.8. The deleteMemcUIDList() Method12.6.9. The getMemcUIDList Method12.7. Other Methods12.7.1. The getStates() Method12.7.2. The getState() Method12.7.3. The encodeUserData() Method12.8. Testing12.9. Summary
13. mod_perl
13.1. New mod_perl 2.0 Features13.2. Configuring mod_perl13.3. mod_perl Configuration Directives13.3.1. <Perl> Sections13.3.2. PerlModule13.3.3. PerlLoadModule13.3.4. SetHandler perl-script13.3.5. SetHandler modperl13.3.6. PerlSetEnv13.3.7. PerlPassEnv13.3.8. PerlSetVar13.3.9. PerlAddVar13.3.10. PerlPostConfigRequire13.3.11. PerlRequire13.3.12. PerlOptions13.3.13. PerlSwitches13.3.14. POD13.4. mod_perl Handler Directives13.4.1. Handler Scope13.4.2. Handler Type13.4.3. Handler Category13.5. Apache Life Cycle Overview13.5.1. Server Life Cycle Phase Handlers13.5.2. Connection Cycle Phase Handlers13.5.2.1. Connection Cycle Phase Handler Template13.5.2.2. Connection Cycle Phase Handler Names13.5.3. Filter Handlers13.5.3.1. Filter Handler Template13.5.3.2. Filter Handler Type Descriptions13.5.3.3. HTTP Request Cycle Phase Handlers13.5.3.4. HTTP Request Cycle Handler Template13.5.3.5. HTTP Request Cycle Handler Phase Names13.6. Perl Apache2 Modules13.6.1. Apache2 Constants and Request Record Perl Modules13.6.1.1. Apache2::Const13.6.1.2. Apache2::Request13.6.1.3. Apache2::RequestRec13.6.1.4. Apache2::RequestUtil13.6.1.5. Apache2::RequestIO13.6.1.6. Apache2::Response13.6.1.7. Apache2::Access13.6.1.8. Apache2::URI13.6.1.9. Apache2::Util13.6.2. Apache2 Connection and Filter Record Modules13.6.2.1. Apache2::Connection13.6.2.2. Apache2::Filter13.6.3. Apache2 Server Record Modules13.6.3.1. Apache2::ServerRec13.6.3.2. Apache2::ServerUtil13.6.3.3. Apache2::Log13.6.4. Apache2 Configuration Modules13.6.4.1. Apache2::Directive13.6.4.2. Apache2::MPM13.6.4.3. Apache2::PerlSections13.6.5. Apache2 Resource/Performance, Status, and Other Modules13.6.5.1. Apache2::Reload13.6.5.2. Apache::DBI13.6.5.3. Apache2::Resource13.6.5.4. Apache2::SizeLimit13.6.5.5. Apache2::Status13.7. Summary
14. Using mod_perl Handlers
14.1. PerlResponseHandler Example14.1.1. Initial Handler Setup14.1.2. Log Messages Using the Server Object and Form Parsing14.1.3. Setting the Log Level and Printing the HTTP Header14.1.4. Redirection14.1.5. Print the Document Header14.2. Connection mod_perl Handlers14.3. PerlPreConnectionHandler Example14.4. Other HTTP Request Cycle Phase Handlers14.4.1. PerlAccessHandler Example14.4.2. PerlAuthenHandler Example14.4.3. PerlAuthzHandler Example14.4.4. PerlLogHandler Example14.4.5. Perl Filter Handler Example14.5. Summary
15. More mod_perl
15.1. mod_perl Handlers or ModPerl::Registry?15.1.1. Using ModPerl::RegistryLoader15.1.2. Converting a ModPerl::Registry Script to a mod_perl Handler15.1.3. Converting a mod_perl Handler to a ModPerl::Registry Script15.2. Dealing with Cookies15.2.1. CookieTestHandler15.2.2. Tools for Testing Cookies and Headers15.3. Generic Database Methods15.3.1. dbGetRef()15.3.2. dbInsert()15.3.3. dbUpdate()15.3.4. dbDelete()15.3.5. whereClause()15.3.6. buildUpdate()15.3.7. buildInsert ()15.3.8. Other Changes to WebApp15.4. Session Management15.4.1. Implementing the mod_perl Handler LoginHandler15.4.2. Understanding the WebApp Class15.4.3. Storing Session Data15.5. File Upload mod_perl Handler15.5.1. Storing Files in the Database or Not?15.5.2. Database Table15.5.3. mod_perl Handler Implementation15.5.3.1. Set Up the Uploads Directory in the Apache Configuration15.5.3.2. Implement the mod_perl Handler15.5.3.3. The handler() Subroutine15.5.3.4. The saveUpload() Subroutine15.5.4. Methods That Need to be Added to WebApp15.5.4.1. getFiles() Method15.5.4.2. fileExists() Method15.5.4.3. saveFileInfo() Method15.5.5. Using the mod_perl Upload Handler15.6. Templating15.6.1. Template Toolkit15.6.2. Features15.6.3. Plug-Ins to Template Toolkit15.6.4. Template Toolkit Syntax15.6.5. A mod_perl Handler Example Using Template Toolkit15.6.5.1. Handler Declaration in the Apache Configuration File15.6.5.2. Handler Body15.6.6. Caching Templates15.7. HTML::Template15.7.1. Tags15.7.2. A mod_perl Handler Example Using HTML::Template15.7.3. HTML::Template template15.8. HTML::Mason (Mason)15.8.1. Mason Syntax15.8.2. In-Line Perl Sections15.8.3. Mason Objects15.8.4. Mason Components15.8.5. Initialization and Cleanup15.8.6. Userlisting Page in Mason15.9. Summary
16. Perl and Ajax
16.1. What Is Ajax?16.2. mod_perl Applications and Ajax16.2.1. Basic Ajax Examples16.2.1.1. Example 116.2.1.2. mod_perl Handler for Example 116.2.1.3. Ajax Example 2: Display Returned HTML Table16.2.1.4. mod_perl Handler for Example 216.2.1.5. Example 2: Template Code16.2.2. More Examples Using the JSON Perl Module16.2.2.1. Ajax Example 3: Building the Table on the Client16.2.2.2. Example 3: mod_perl Handler16.2.2.3. Example 4: MySQL Ajax Client16.2.2.4. Example 4: mod_perl Handler16.2.2.5. Example 4 in Action16.2.2.6. Example 5: Reading the Raw Post Data16.2.2.7. Example 5: mod_perl Handler16.2.2.8. Example 6: Using the Prototype JavaScript Framework16.2.2.9. Example 7: Account Creation with Ajax16.2.2.10. Account Page mod_perl Handler16.2.2.11. Account Page Template16.2.2.12. Account Handler16.2.2.12.1. The handler() Subroutine16.2.2.12.2. The notifyUser() Subroutine16.2.2.13. New WebApp Method sendEmail()16.2.2.14. Ajax Account Creation in Action16.3. Summary
17. Search Engine Application
17.1. Using Gearman to Put the Search Engine Application Together17.1.1.17.1.1.1. Gearman17.1.2. Installing and Running Gearman17.1.2.1. gearmand Job Server Install17.1.2.2. Gearman MySQL UDF Install17.1.2.3. Running the Gearman Job Server17.1.3. Using the Gearman MySQL UDFs17.1.3.1. gman_severs_set()17.1.3.2. gman_do()17.1.3.3. gman_sum()17.1.3.4. Usage Examples17.1.4. Perl and Gearman17.1.4.1. Perl Gearman Worker17.1.4.2. Perl Gearman Client17.2. The Search Engine Application17.2.1. Database Tables for the Search Engine Application17.2.2. Database Triggers17.2.3. Sphinx Setup17.2.4. Gearman Workers17.2.4.1. Web Client Worker17.2.4.2. Data Storage Worker17.2.4.3. Indexer Worker17.2.5. Running the Workers17.3. mod_perl Handler Web Applications17.3.1. Search Application17.3.1.1. Search Template17.3.1.2. The mod_perl Search Handler17.3.1.3. Main Handler Method17.3.1.4. The search() Subroutine17.3.1.5. The get_results_from_db() Subroutine17.3.1.6. Paginating the Search Application17.3.2. Using the Search Application17.3.3. URL Queue Application17.3.4. URLHandler—AJAX Application17.3.4.1. The Main handler() Subroutine17.3.4.2. URLHandler JavaScript17.3.4.3. JavaScript Functions17.3.4.4. URLHandler Template17.3.5. URLQueueHandler mod_perl Handler17.4. URLQueueHandler handler() Subroutine17.4.1. URLQueue Interface17.5. Summary
A. Installing MySQL
A.1. Choosing a MySQL VersionA.2. Choosing a MySQL Package TypeA.3. Installing MySQL on WindowsA.4. Installing MySQL on RPM-based Linux SystemsA.5. Installing MySQL on UbuntuA.6. Installing MySQL from Source on UNIX SystemsA.7. Unix Post Install
B. Configuring MySQL
B.1. Running MySQL for the First TimeB.2. Setting Up Privileges and Creating a SchemaB.3. MySQL Server Configuration FileB.3.1. Basic Command OptionsB.3.1.1. datadirB.3.1.2. tmpdirB.3.1.3. userB.3.1.4. portB.3.1.5. socketB.3.2. InnoDB Path and Tablespace Command OptionsB.3.2.1. innodb_data_file_pathB.3.2.2. innodb_file_per_tableB.4. BackupsB.4.1. Replication Backup SlaveB.4.2. mysqldumpB.4.3. Scripting mysqldump Backups with PerlB.4.4. Creating a Backup by Copying Data FilesB.4.5. mysqlhotcopyB.4.6. Snapshots Using LVMB.4.7. InnoDB Hotbackup, ibbackupB.5. MonitoringB.5.1. NagiosB.5.2. CactiB.5.3. MySQL Enterprise MonitorB.6. my.cnf Sample FileB.7. Sample sphinx.conf

Content preview from Developing Web Applications with Perl, memcached, MySQL® and Apache

Chapter 17. Search Engine Application

In the beginning of the World Wide Web, search engine applications were one of the first types of applications implemented. Being able to collect and store data from various sources across the web and provide an interface to make that data searchable for users is a common functionality that has been implemented in a number of ways throughout the history of computing and, more recently, the Web. There are a lot of requirements for this functionality: a means of storing the data, a means of full-text indexing the data so terms or queries can be used to perform searches against that data and retrieve results, having hits that are quickly returned, and a user interface for the person performing the search.

This chapter shows you a search engine application—one that's probably implemented differently than other search engine applications you have seen before. This chapter shows you the following:

How to implement a search engine from top to bottom!
How to use Sphinx for a real-life application.
How to use Gearman to distribute work and how to use both the Perl client and worker API for Gearman, as well as the Gearman MySQL UDFs, which you can use with triggers to further automate job assignments.
A simple web client crawler implemented in Perl that is a worker to which the Gearman job server will assign work.
Yet another application that takes advantage of memcached and MySQL together, and even more practical examples of using the Memcached Functions for ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Publisher Resources

ISBN: 9780470414644Purchase book

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Developing Web Applications with Perl, memcached, MySQL® and Apache

by Patrick Galbraith

Chapter 17. Search Engine Application

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.