book

Python Automation Cookbook - Second Edition

by Jaime Buelta

May 2020

Intermediate to advanced

526 pages

10h 31m

English

Packt Publishing

Read now

Unlock full access

Who this book is forWhat this book coversTo get the most out of this bookGet in touch
Activating a virtual environmentGetting readyHow to do it…How it works…There's more…See alsoInstalling third-party packagesGetting readyHow to do it…How it works…There's more…See alsoCreating strings with formatted valuesGetting readyHow to do it…How it works…There's more…See alsoManipulating stringsGetting readyHow to do it…How it works…There's more…See alsoExtracting data from structured stringsGetting readyHow to do it…How it works…There's more…See alsoUsing a third-party tool—parseGetting readyHow to do it…How it works…There's more…See alsoIntroducing regular expressionsGetting readyHow to do it…How it works…There's more…See alsoGoing deeper into regular expressionsHow to do it…How it works…There's more…See alsoAdding command-line argumentsGetting readyHow to do it…How it works…There's more…See also
Preparing a taskGetting readyHow to do it...How it works…There's more...See alsoSetting up a cron jobGetting readyHow to do it...How it works...There's more...See alsoCapturing errors and problemsGetting readyHow to do it...How it works...There's more...See alsoSending email notificationsGetting readyHow to do it...How it works...There's more...See also
Downloading web pagesGetting readyHow to do it...How it works...There's more...See alsoParsing HTMLGetting readyHow to do it...How it works...There's more...See alsoCrawling the webGetting readyHow to do it...How it works...There's more...See alsoSubscribing to feedsGetting readyHow to do it...How it works...There's more...See alsoAccessing web APIsGetting readyHow to do it...How it works...There's more...See alsoInteracting with formsGetting readyHow to do it...How it works...There's more...See alsoUsing Selenium for advanced interactionGetting readyHow to do it...How it works...There's more...See alsoAccessing password-protected pagesGetting readyHow to do it...How it works...There's more...See alsoSpeeding up web scrapingGetting readyHow to do it...How it works...There's more...See also
Crawling and searching directoriesGetting readyHow to do it...How it works...There's more...See alsoReading text filesGetting readyHow to do it...How it works...There's more...See alsoDealing with encodingsGetting readyHow to do it...How it works...There's more...See alsoReading CSV filesGetting readyHow to do it...How it works...There's more...See alsoReading log filesGetting readyHow to do it...How it works...There's more...See alsoReading file metadataGetting readyHow to do it...How it works...There's more...See alsoReading imagesGetting readyHow to do it...How it works...There's more...See alsoReading PDF filesGetting readyHow to do it...How it works...There's more...See alsoReading Word documentsGetting readyHow to do it...How it works...There's more...See alsoScanning documents for a keywordGetting readyHow to do it...How it works...There's more...See also
Creating a simple report in plain textGetting readyHow to do it...How it works...There's more...See alsoUsing templates for reportsGetting readyHow to do it...How it works...There's more...See alsoFormatting text in MarkdownGetting readyHow to do it...How it works...There's more...See alsoWriting a basic Word documentGetting readyHow to do it...How it works...There's more...See alsoStyling a Word documentGetting readyHow to do it...How it works...There's more...See alsoGenerating structure in Word documentsGetting readyHow to do it...How it works...There's more...See alsoAdding pictures to Word documentsGetting readyHow to do it...How it works...There's more...See alsoWriting a simple PDF documentGetting readyHow to do it...How it works...There's more...See alsoStructuring a PDFGetting readyHow to do it...How it works...There's more...See alsoAggregating PDF reportsGetting readyHow to do it...How it works...There's more...See alsoWatermarking and encrypting a PDFGetting readyHow to do it...How it works...There's more...See also
Writing a CSV spreadsheetGetting readyHow to do it...How it works...There's more...See alsoUpdating CSV filesGetting readyHow to do it...How it works...There's more...See alsoReading an Excel spreadsheetGetting readyHow to do it...How it works...There's more...See alsoUpdating an Excel spreadsheetGetting readyHow to do it...How it works...There's more...See alsoCreating new sheets in an Excel spreadsheetGetting readyHow to do it...How it works...There's more...See alsoCreating charts in ExcelGetting readyHow to do it...How it works...There's more...See alsoWorking with cell formats in ExcelGetting readyHow to do it...How it works...There's more...See alsoCreating a macro in LibreOfficeGetting readyHow to do it...How it works...There's more...See also
Preparing a CSV spreadsheetGetting readyHow to do it...How it works...There's more...See alsoAppending currency based on locationGetting readyHow to do it...How it works...There's more...See alsoStandardizing the date formatGetting readyHow to do it...How it works...There's more...See alsoAggregating results Getting readyHow to do it...How it works...There's more...See alsoProcess data in parallelGetting readyHow to do it...How it works...There's more...See alsoProcess data with Pandas Getting readyHow to do it...How it works...There's more...See also
Plotting a simple sales graphGetting readyHow to do it...How it works...There's more...See alsoDrawing stacked barsGetting readyHow to do it...How it works...There's more...See alsoPlotting pie chartsGetting readyHow to do it...How it works...There's more...See alsoDisplaying multiple linesGetting readyHow to do it...How it works...There's more...See alsoDrawing a scatter plotGetting readyHow to do it...How it works...There's more...See alsoVisualizing mapsGetting readyHow to do it...How it works...There's more...See alsoAdding legends and annotationsGetting readyHow to do it...How it works...There's more...See alsoCombining graphsGetting readyHow to do it...How it works...There's more...See alsoSaving chartsGetting readyHow to do it...How it works...There's more...See also
Working with email templatesGetting readyHow to do it...How it works...There's more...See alsoSending an individual emailGetting readyHow to do it...How it works...There's more...See alsoReading an emailGetting readyHow to do it...How it works...There's more...See alsoAdding subscribers to an email newsletterGetting readyHow to do it...How it works...There's more...See alsoSending notifications via emailGetting readyHow to do it...How it works...There's more...See alsoProducing SMS messagesGetting readyHow to do it...How it works...There's more...See alsoReceiving SMSGetting readyHow to do it...How it works...There's more...See alsoCreating a Telegram botGetting readyHow to do it...How it works...There's more...See also

IntroductionDetecting opportunitiesGetting readyHow to do it...How it works...There's more...See alsoCreating personalized coupon codesGetting readyHow to do it...How it works...There's more...See alsoSending a notification to a customer on their preferred channelGetting readyHow to do it...How it works...There's more...See alsoPreparing sales informationGetting readyHow to do it...How it works...There's more...See alsoGenerating a sales reportGetting readyHow to do it...How it worksThere's more...See also
IntroductionAnalyzing images with Google Cloud Vision AIGetting readyHow to do it...How it works...There's more...See alsoExtracting text from images with Google Cloud Vision AIGetting readyHow to do it...How it works...There's more...See alsoAnalyzing text with Google Cloud Natural LanguageGetting readyHow to do it...How it works...There's more...See alsoCreating your own custom machine learning model to classify textGetting readyHow to do it...How it works...There's more...See also
IntroductionWriting and executing test casesGetting readyHow to do it...How it works...There's more...See alsoTesting external codeGetting readyHow to do it...How it works...There's more...See alsoTesting using dependency mockingGetting readyHow to do it...How it works...There's more...See alsoTesting using HTTP call mockingGetting readyHow to do it...How it works...There's more...See alsoPreparing testing scenariosGetting readyHow to do it...How it works...There's more...See alsoRunning tests selectivelyGetting readyHow to do it...How it works...There's more...See also
IntroductionLearning Python interpreter basicsHow to do it...How it works...There's more...See alsoDebugging through loggingGetting readyHow to do it...How it works...There's more...See alsoDebugging with breakpointsGetting readyHow to do it...How it works...There's more...See alsoImproving your debugging skillsGetting readyHow to do it...How it works...There's more...See also

Content preview from Python Automation Cookbook - Second Edition

7 Cleaning and Processing Data

Some automated tasks will require dealing with large amounts of data. As data grows, two new and distinct problems appear. Processing the task takes too long and input data quality issues cause more problems.

Both problems are well known in the realm of data science dealing with big quantities of data, but the problems can appear even at a smaller scale.

The quality of input data is highly related to the number of sources of the data. In general, data from a single source will be more consistent, but using a single source is limiting. Even if the data comes from the same source, it could still contain inconsistencies or errors.

Some examples of differences could be regional, such as date formats or currencies, ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Start your free trial

Publisher Resources

ISBN: 9781800207080Supplemental Content

Python Automation Cookbook - Second Edition

by Jaime Buelta

7

Cleaning and Processing Data

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

You might also like