book

Learn MongoDB 4.x

Name: Learn MongoDB 4.x
Author: Doug Bierer
ISBN: 9781789619386

by Doug Bierer

September 2020

Beginner to intermediate

610 pages

12h 40m

English

Packt Publishing

Read now

Unlock full access

Title Page
Copyright and Credits
Learn MongoDB 4.x
Dedication
About Packt
Why subscribe?
Foreword
Contributors
About the authorAbout the reviewerPackt is searching for authors like you
Preface
Who this book is forWhat this book coversTo get the most out of this bookDownload the example code filesDownload the color imagesConventions usedGet in touchReviews
Section 1: Essentials
Introducing MongoDB 4.x
High-level technology overview of MongoDB 4.xMongoDB is based upon documentsHigh availabilityHorizontal scalingDiscovering what's new and different in MongoDB 4.xSignificant new featuresMultidocument ACID transaction supportNonblocking secondary readsIn-progress index build interruptionOther noteworthy new featuresAggregation pipeline type conversionsClient-side field-level encryptionPassword promptWildcard indexesExtended JSON v2 supportImproved logging and diagnosticsHedged readsTCP fast open supportNatural sortInternal enhancementsTimestamps in the storage engineShard migrationChange streamsImportant new security enhancementsSHA-256 supportTLS handlingAvoiding problems when upgrading from MongoDB 3.x to 4.xMMAPv1 storage engineReplica set protocol versionVerifying that at least one oplog entry has replicatedUpgrading the primary to protocol version 1Feature compatibilityUser authenticationRemoved and deprecated itemsRemoved itemsSignificant removed itemsDeprecated SSL configuration optionsSummary
Setting Up MongoDB 4.x
Technical requirementsInstalling MongoDB on a customer siteAvailable versions of MongoDB 4.xUnderstanding RAM and CPU requirementsExamining storage requirementsChoosing the filesystem typeOther server considerationsInstalling MongoDB 4.xMongoDB 3 and MongoDB 4.x installation differencesInstalling MongoDB 4.x on LinuxInstalling on Windows and macOSConfiguring MongoDB 4.xThe name and location of the MongoDB configuration fileYAML configuration file syntaxConfiguration optionsStorage configuration optionsLogging configuration optionsNetwork configuration optionsExample MongoDB configuration fileCommand-line optionsExpansion directivesUsing the __rest expansion directiveUsing the __exec expansion directiveInstalling the PyMongo driver packagePython driver compatibilitypip3Installing PyMongo using pipTesting the connection between Python and MongoDBLoading the sample dataInstalling the source code and sample data using GitInstalling source and sample data by downloading and unzippingUnderstanding the source code directory structureCreating the demo environment using Docker and Docker ComposeInstalling Docker and Docker ComposeConfiguring Docker for Chapter 2Configuring Docker for Chapters 3 to 12Running the demo environmentConnecting to the container from your host computerSummary

Essential MongoDB Administration Techniques
Technical requirementsConnecting with the mongo shellThe mongo shell command-line switchesCustomizing the mongo shellShell command helpersUsing mongo shell methodsRunning scripts using the shellRunning a script from the command lineRunning a script from inside the shellShell script syntaxUsing the Mongo shell for common database operationsCreating a new database and collectionInserting documentsQuerying a collectionSimple queriesBuilding complex queries using query operatorsApplying projections to your queryUpdating a documentUpdate operatorsUpdating customer contact informationData cleanupDeleting a documentPerforming backup and restore operationsUsing mongodump to back up a local databasemongodump options summaryThings to consider before you back upBacking up a specific databaseRestoring using mongorestoreThings to consider before restoring dataRestoring the purchases collectionUsing the --nsInclude switch to restorePerformance monitoringMongo shell stats() methodsMonitoring server statusSummary
Section 2: Building a Database-Driven Web Application
Fundamentals of Database Design
Technical requirementsReviewing customer requirementsIntroducing Sweets Complete Inc.What data comes out of the application?What data goes into the application?What needs to be stored?A quick word on software designBuilding MongoDB document structuresDefining the products document structurePrimary key considerationsDefining the purchases document structureDefining the common document structureDeveloping a corresponding Python moduleDetermining common needs in a base classDefining classes for the products collectionDemo script for productUnit test for the product entityDefining classes for the remaining collectionsSummary
Mission-Critical MongoDB Database Tasks
Technical requirementsCreating a Connection classpymongo.MongoClientCreating the connectionDefining domain service classesProducts collection domain serviceGenerating a product sales reportUsing the pymongo.collection.Collection.find() classModeling the query in JavaScriptAdding the appropriate methods to the domain service classGeneric Query Method approachCustom Query Method approachUpdating product informationHandling a customer purchaseWeb environment support classesThe web.session.Session classThe web.auth.SimpleAuth classThe web.responder.Html classThe pymongo.collection.Collection.insert_one() and insert_many() classInserting documents into the purchase domain serviceWeb application for product purchaseConfiguring Apache for Python CGISimple customer authenticationSelecting products from a web pageCapturing and processing purchase information from a web formCanceling a purchaseThe pymongo.collection.Collection.delete_one() and delete_many() methodsIntegrating purchase cancellation into the web flowSummary
Using AJAX and REST to Build a Database-Driven Website
Technical requirementsPaginating MongoDB database queriesModifying the purchases domain serviceAdding pagination to the responder classConsolidating configurationAdding pagination to a web applicationHandling AJAX requestsA brief overview of jQuery and DataTablesIncorporating jQuery and DataTablesDefining a JSON responder classDelivering data from MongoDBCreating an AJAX handler web action scriptModifying the product select web action scriptModifying the product purchase web action scriptServing binary data directly from MongoDBProducing a Base64 image tagCreating an HTML template for the product detailsCreating a display scriptModifying the AJAX responseRevisiting the product selection action scriptResponding to REST requestsUnderstanding RESTUnderstanding HTTPHTTP status codesHTTP methodsJSON standards for a REST responseJSendJSON:APIhal+jsonStrategies for creating a REST responderResponse strategy base classJSend strategyThe JSON:API strategyThe hal+json strategyCreating a REST responderModifying the products domain serviceREST request action handlerSummary
Section 3: Digging Deeper
Advanced MongoDB Database Design
Technical requirementsReviewing customer requirementsIntroducing Book Someplace, Inc.What data is produced by the application?What data goes into the application?What needs to be stored?Building document structuresDefining a name structureDefining a location structureDefining a contact structureAdditional structures pertaining to usersDefining a property information structureDefining roomsDefining a structure for bookingDefining intermediary structuresCustomer booking structuresProperty booking structuresPutting it all togetherCustomer collection document structurePartner collection document structureProperty collection document structureBooking collection document structureCommon collection document structureDeveloping the corresponding Python entity classesDefining the booking moduleDefining the Common moduleTesting an entity classDefining domain service classesBase domain service classProperty domain service classUsing MongoDB with DjangoDetermining which web framework to useInstalling the web framework and MongoDB libraryApache configurationBook Someplace Django project structureMaking modifications to the main projectPresenting the viewDisplaying results in the view templateSummary
Using Documents with Embedded Lists and Objects
Technical requirementsOverviewAdding a document with embedded objects and arraysDefining forms for property subclassesDefining templates to match sub-formsDefining a FormService classDefining view logic to handle form rendering and postingDefining a route to addEdit()Generating the property keyUpdating the property domain serviceAdding a new propertyAdding to arrays embedded within documentsDefining an add room formDefining the view method and URL routeUpdating the databaseMongoDB update operatorsDomain service method to add roomsUsing the formUpdating documents with embedded objectsChoosing the partnerPartner and property AJAX lookupsContact information form and viewDefining JavaScript functions to generate AJAX requestsUsing operators to update contact informationUsing the contact update formQuerying properties of embedded objectsDefining a property listing view methodRoom types view methodAdding the appropriate URL routesProperty listing templatejQuery AJAX function requesting room typesListing resultsRemoving a documentDefining a property domain service deletion methodChoosing the partner and propertyDefining the choose and confirm delete templateDefining a URL routeSummary
Handling Complex Queries in MongoDB
Technical requirementsModeling complex queries using MongoDB CompassUnderstanding MongoDB CompassInstalling MongoDB CompassMongoDB Compass initial connectionSSL connection optionsMaking the connectionFormulating queries involving embedded objectsBuilding queries involving embedded arraysUsing the aggregation frameworkWorking with the MongoDB aggregate() methodPipeline stage operatorsPipeline expression operatorsString expression operatorsDate expression operatorsOther important expression operatorsAccumulator expression operatorsWorking with Map-Reduce functionsUnderstanding the mapReduce() method syntaxReviewing a Map-Reduce exampleHandling geospatial dataWorking with the flat 2D modelUsing aggregation to create the geospatial fieldDefining an indexUnderstanding GeoJSON objectsWorking with the spherical 2D geospatial modelUsing geospatial query operatorsExamining the geospatial aggregation pipeline stage operatorUsing aggregation to produce financial reportsUsing aggregation to generate revenue reportsUsing the mongo shell to build a queryGenerating 30-60-90 day aging reports using MongoDB aggregationPerforming risk analysis through revenue trendsSetting up the Django infrastructureDefining a form to capture query parametersDefining view methodsDefining the view templateDefining a method to generate trend dataViewing the resultsSummary
Section 4: Replication, Sharding, and Security in a Financial Environment
Working with Complex Documents Across Collections
Technical requirementsIntroducing BigLittle Micro Finance Ltd.Handling monetary data in MongoDBUser collection data structuresLoan collection data structureCommon collectionsStoring financial dataReferencing documents across collectionsTechniques for referencing documents across collectionsThe building block approachEmbedded documentsDocument referencesDatabase references (DBRefs)$lookup aggregation pipeline stagePractical example using document referencesGathering information to generate a loan proposalCreating a loan document using document referencesPractical example using the $lookup aggregation pipeline operatorConnecting two collections using $lookupProducing Python code from the JSON queryPerforming secondary updatesAccepting a loan paymentDjango view logic for choosing the borrowerDjango view logic for payment processingPayment processing domain service methodsLoan payment view templateDefining code to process secondary updatesThe publish/subscribe design patternDefining listeners for loan eventsEvent notificationAvoiding cross-collection problemsEnsuring uniquenessUsing ObjectId as a unique keyDefining a custom unique keyEnforcing uniquenessAvoiding creating orphans across collectionsUsing embedded arrays to avoid orphansUsing embedded documents to avoid orphansKeeping values properly synchronizedUploading files into GridFSWhy use GridFS?How to use GridFS from the command lineGridFS command-line optionsGridFS commandsCommand-line usage examplesPyMongo GridFS supportExample using GridFS to store loan documentsSummary
Administering MongoDB Security
Technical requirementsEnabling database securityUnderstanding MongoDB authenticationAuthentication versus authorizationUnderstanding the authentication databaseAuthentication mechanismsCreating a database userEnabling database securityUnderstanding role-based access controlUnderstanding privilege actions (rights)Operational rightsMaintenance rightsUnderstanding built-in rolesAssigning built-in roles applying to a single databaseCreating a user with rights on a single databaseAssigning built-in roles applying to all databasesCreating a user with rights on all databasesAdministrative built-in rolesCreating a user with SCRAM-based authenticationSetting up transport layer security with X.509 certificatesUnderstanding TLS, SSL and the transport layerCertificates needed for secure MongoDB communicationsConfiguring mongod for TLS/SSLEstablishing secure communications using PEM key filesCreating a client connection using TLSSummary
Developing in a Secured Environment
Technical requirementsDeveloping applications with minimal rightsCreating a database user with read rightsConfiguring the application for a database userLimiting an application to a single databaseCreating applications with expanded rightsApplications with rights to any databaseApplications that perform database and collection administrationApplications that perform database user managementConfiguring applications to communicate using TLSPyMongo client TLS configuration optionsSample app connecting with TLSSummary
Deploying a Replica Set
Technical requirementsMongoDB replication overviewWhat is a replica set?What are some potential replica set benefits?What happens if a server goes down?Replica set data synchronizationProper replica set designEstablishing a business rationaleModeling a replica set using DockerCreating the DockerfileBringing up multiple containers using Docker ComposeReplica set configuration and deploymentReplication configuration settingsDeploying the replica setNetwork connectivity between replica set membersReplica set member configurationStarting mongod instancesInitiating the replica setReplica set configuration fieldsReplica set members configuration directivesReplica set settings configuration directivesReplica set configuration exampleConfirming the replica set statusRestoring the sample dataSummary
Replica Set Runtime Management and Development
Technical requirementsManaging a running replica setManaging the oplog sizeMonitoring the replication statusControlling replication lagBacking up and restoring a replica setBacking up using mongodumpRestoring a replica setResynchronizing a replica set memberResynchronizing by forcing an initial syncResynchronizing by manual file copyManaging replica set impact on application program codeBasic replica set connectionManipulating read preferencesManaging write concernsSummary
Deploying a Sharded Cluster
Technical requirementsMongoDB sharding overviewWhat is a sharded cluster?Why deploy a sharded cluster?Vertical scalingHorizontal scalingDeveloping a business rationale for sharded cluster deploymentSharded cluster configurationUnderstanding the shard keyDocument distribution within shardsChoosing a shard keyCardinalityFrequencyChangeShard key strategiesHashed shardingRange-based shardingSharded cluster member configurationSharded cluster deploymentUsing Docker to model a sharded clusterUnderstanding the docker-compose.yml fileAdditional files needed by Docker and MongoDBConfirming sharded cluster network communicationsDeploying the config server replica setDeploying shard replica setsStarting a mongos instanceRestoring the sample dataAdding shards to the clusterEnabling sharding on the databaseChoosing a shard keySharding the collectionSummary
Sharded Cluster Management and Development
Technical requirementsManaging a sharded clusterMonitoring the sharded cluster statusWorking with sharded cluster zonesDefining zonesAssigning ranges to zonesWorking with the sharded cluster balancerDetermining the balancer stateDisabling the balancerEnabling the balancerManaging chunk sizeAdjusting chunk sizeSplitting a chunkManually migrating a chunkBacking up and restoring a sharded clusterSharded cluster impacts on program codeConnecting to a sharded clusterReading from a sharded clusterWriting to a sharded clusterSummary
Other Books You May Enjoy
Leave a review - let other readers know what you think

Overview

Explore the capabilities of MongoDB 4.x with this comprehensive guide designed for developers and administrators working with NoSQL databases. Dive into topics such as database design, advanced query handling, and security configuration, and gain hands-on experience through practical examples and insights.

What this Book will help me do

Learn to configure and install MongoDB 4.x for development and administration.
Understand the principles of NoSQL schema design for optimal performance.
Perform complex queries and operations to manage your MongoDB databases.
Secure your MongoDB setup with role-based access control and encryption techniques.
Monitor and optimize database performance for production environments.

Author(s)

None Bierer, the author of 'Learn MongoDB 4.x,' is a seasoned database expert with extensive experience in NoSQL technologies. With a focus on practicality and clear explanations, None brings deep insights into MongoDB's development and administration.

Who is it for?

This book is ideal for early-career developers, system administrators, and database enthusiasts eager to break into NoSQL technologies. If you are familiar with Python and basic database concepts, this book will guide you through mastering MongoDB. It's perfect for those building dynamic backend systems.

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Publisher Resources

ISBN: 9781789619386

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills