book

Python Automation Cookbook - Second Edition

Name: Python Automation Cookbook - Second Edition
Author: Jaime Buelta
ISBN: 9781800207080

by Jaime Buelta

May 2020

Intermediate to advanced

526 pages

10h 31m

English

Packt Publishing

Read now

Unlock full access

Preface
Who this book is forWhat this book coversTo get the most out of this bookGet in touch
Let's Begin Our Automation Journey
Activating a virtual environmentGetting readyHow to do it…How it works…There's more…See alsoInstalling third-party packagesGetting readyHow to do it…How it works…There's more…See alsoCreating strings with formatted valuesGetting readyHow to do it…How it works…There's more…See alsoManipulating stringsGetting readyHow to do it…How it works…There's more…See alsoExtracting data from structured stringsGetting readyHow to do it…How it works…There's more…See alsoUsing a third-party tool—parseGetting readyHow to do it…How it works…There's more…See alsoIntroducing regular expressionsGetting readyHow to do it…How it works…There's more…See alsoGoing deeper into regular expressionsHow to do it…How it works…There's more…See alsoAdding command-line argumentsGetting readyHow to do it…How it works…There's more…See also
Automating Tasks Made Easy
Preparing a taskGetting readyHow to do it...How it works…There's more...See alsoSetting up a cron jobGetting readyHow to do it...How it works...There's more...See alsoCapturing errors and problemsGetting readyHow to do it...How it works...There's more...See alsoSending email notificationsGetting readyHow to do it...How it works...There's more...See also
Building Your First Web Scraping Application
Downloading web pagesGetting readyHow to do it...How it works...There's more...See alsoParsing HTMLGetting readyHow to do it...How it works...There's more...See alsoCrawling the webGetting readyHow to do it...How it works...There's more...See alsoSubscribing to feedsGetting readyHow to do it...How it works...There's more...See alsoAccessing web APIsGetting readyHow to do it...How it works...There's more...See alsoInteracting with formsGetting readyHow to do it...How it works...There's more...See alsoUsing Selenium for advanced interactionGetting readyHow to do it...How it works...There's more...See alsoAccessing password-protected pagesGetting readyHow to do it...How it works...There's more...See alsoSpeeding up web scrapingGetting readyHow to do it...How it works...There's more...See also
Searching and Reading Local Files
Crawling and searching directoriesGetting readyHow to do it...How it works...There's more...See alsoReading text filesGetting readyHow to do it...How it works...There's more...See alsoDealing with encodingsGetting readyHow to do it...How it works...There's more...See alsoReading CSV filesGetting readyHow to do it...How it works...There's more...See alsoReading log filesGetting readyHow to do it...How it works...There's more...See alsoReading file metadataGetting readyHow to do it...How it works...There's more...See alsoReading imagesGetting readyHow to do it...How it works...There's more...See alsoReading PDF filesGetting readyHow to do it...How it works...There's more...See alsoReading Word documentsGetting readyHow to do it...How it works...There's more...See alsoScanning documents for a keywordGetting readyHow to do it...How it works...There's more...See also
Generating Fantastic Reports
Creating a simple report in plain textGetting readyHow to do it...How it works...There's more...See alsoUsing templates for reportsGetting readyHow to do it...How it works...There's more...See alsoFormatting text in MarkdownGetting readyHow to do it...How it works...There's more...See alsoWriting a basic Word documentGetting readyHow to do it...How it works...There's more...See alsoStyling a Word documentGetting readyHow to do it...How it works...There's more...See alsoGenerating structure in Word documentsGetting readyHow to do it...How it works...There's more...See alsoAdding pictures to Word documentsGetting readyHow to do it...How it works...There's more...See alsoWriting a simple PDF documentGetting readyHow to do it...How it works...There's more...See alsoStructuring a PDFGetting readyHow to do it...How it works...There's more...See alsoAggregating PDF reportsGetting readyHow to do it...How it works...There's more...See alsoWatermarking and encrypting a PDFGetting readyHow to do it...How it works...There's more...See also
Fun with Spreadsheets
Writing a CSV spreadsheetGetting readyHow to do it...How it works...There's more...See alsoUpdating CSV filesGetting readyHow to do it...How it works...There's more...See alsoReading an Excel spreadsheetGetting readyHow to do it...How it works...There's more...See alsoUpdating an Excel spreadsheetGetting readyHow to do it...How it works...There's more...See alsoCreating new sheets in an Excel spreadsheetGetting readyHow to do it...How it works...There's more...See alsoCreating charts in ExcelGetting readyHow to do it...How it works...There's more...See alsoWorking with cell formats in ExcelGetting readyHow to do it...How it works...There's more...See alsoCreating a macro in LibreOfficeGetting readyHow to do it...How it works...There's more...See also
Cleaning and Processing Data
Preparing a CSV spreadsheetGetting readyHow to do it...How it works...There's more...See alsoAppending currency based on locationGetting readyHow to do it...How it works...There's more...See alsoStandardizing the date formatGetting readyHow to do it...How it works...There's more...See alsoAggregating results Getting readyHow to do it...How it works...There's more...See alsoProcess data in parallelGetting readyHow to do it...How it works...There's more...See alsoProcess data with Pandas Getting readyHow to do it...How it works...There's more...See also
Developing Stunning Graphs
Plotting a simple sales graphGetting readyHow to do it...How it works...There's more...See alsoDrawing stacked barsGetting readyHow to do it...How it works...There's more...See alsoPlotting pie chartsGetting readyHow to do it...How it works...There's more...See alsoDisplaying multiple linesGetting readyHow to do it...How it works...There's more...See alsoDrawing a scatter plotGetting readyHow to do it...How it works...There's more...See alsoVisualizing mapsGetting readyHow to do it...How it works...There's more...See alsoAdding legends and annotationsGetting readyHow to do it...How it works...There's more...See alsoCombining graphsGetting readyHow to do it...How it works...There's more...See alsoSaving chartsGetting readyHow to do it...How it works...There's more...See also
Dealing with Communication Channels
Working with email templatesGetting readyHow to do it...How it works...There's more...See alsoSending an individual emailGetting readyHow to do it...How it works...There's more...See alsoReading an emailGetting readyHow to do it...How it works...There's more...See alsoAdding subscribers to an email newsletterGetting readyHow to do it...How it works...There's more...See alsoSending notifications via emailGetting readyHow to do it...How it works...There's more...See alsoProducing SMS messagesGetting readyHow to do it...How it works...There's more...See alsoReceiving SMSGetting readyHow to do it...How it works...There's more...See alsoCreating a Telegram botGetting readyHow to do it...How it works...There's more...See also

Why Not Automate Your Marketing Campaign?
IntroductionDetecting opportunitiesGetting readyHow to do it...How it works...There's more...See alsoCreating personalized coupon codesGetting readyHow to do it...How it works...There's more...See alsoSending a notification to a customer on their preferred channelGetting readyHow to do it...How it works...There's more...See alsoPreparing sales informationGetting readyHow to do it...How it works...There's more...See alsoGenerating a sales reportGetting readyHow to do it...How it worksThere's more...See also
Machine Learning for Automation
IntroductionAnalyzing images with Google Cloud Vision AIGetting readyHow to do it...How it works...There's more...See alsoExtracting text from images with Google Cloud Vision AIGetting readyHow to do it...How it works...There's more...See alsoAnalyzing text with Google Cloud Natural LanguageGetting readyHow to do it...How it works...There's more...See alsoCreating your own custom machine learning model to classify textGetting readyHow to do it...How it works...There's more...See also
Automatic Testing Routines
IntroductionWriting and executing test casesGetting readyHow to do it...How it works...There's more...See alsoTesting external codeGetting readyHow to do it...How it works...There's more...See alsoTesting using dependency mockingGetting readyHow to do it...How it works...There's more...See alsoTesting using HTTP call mockingGetting readyHow to do it...How it works...There's more...See alsoPreparing testing scenariosGetting readyHow to do it...How it works...There's more...See alsoRunning tests selectivelyGetting readyHow to do it...How it works...There's more...See also
Debugging Techniques
IntroductionLearning Python interpreter basicsHow to do it...How it works...There's more...See alsoDebugging through loggingGetting readyHow to do it...How it works...There's more...See alsoDebugging with breakpointsGetting readyHow to do it...How it works...There's more...See alsoImproving your debugging skillsGetting readyHow to do it...How it works...There's more...See also
Other Books You May Enjoy
Index

Content preview from Python Automation Cookbook - Second Edition

7 Cleaning and Processing Data

Some automated tasks will require dealing with large amounts of data. As data grows, two new and distinct problems appear. Processing the task takes too long and input data quality issues cause more problems.

Both problems are well known in the realm of data science dealing with big quantities of data, but the problems can appear even at a smaller scale.

The quality of input data is highly related to the number of sources of the data. In general, data from a single source will be more consistent, but using a single source is limiting. Even if the data comes from the same source, it could still contain inconsistencies or errors.

Some examples of differences could be regional, such as date formats or currencies, ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Publisher Resources

ISBN: 9781800207080

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Python Automation Cookbook - Second Edition

by Jaime Buelta

7

Cleaning and Processing Data

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.