book

Microservices with Spring Boot and Spring Cloud - Second Edition

by Magnus Larsson

July 2021

Beginner to intermediate

774 pages

16h 47m

English

Packt Publishing

Read now

Unlock full access

Who this book is forWhat this book coversTo get the most out of this bookGet in touch
Technical requirementsMy way into microservicesBenefits of autonomous software componentsChallenges with autonomous software componentsEnter microservicesA sample microservice landscapeDefining a microserviceChallenges with microservicesDesign patterns for microservicesService discoveryProblemSolutionSolution requirementsEdge serverProblemSolutionSolution requirementsReactive microservicesProblemSolutionSolution requirementsCentral configurationProblemSolutionSolution requirementsCentralized log analysisProblemSolutionSolution requirementsDistributed tracingProblemSolutionSolution requirementsCircuit breakerProblemSolutionSolution requirementsControl loopProblemSolutionSolution requirementsCentralized monitoring and alarmsProblemSolutionSolution requirementsSoftware enablersOther important considerationsSummary
Technical requirementsSpring BootConvention over configuration and fat JAR filesCode examples for setting up a Spring Boot applicationThe magic @SpringBootApplication annotationComponent scanningJava-based configurationSpring WebFluxCode examples of setting up a REST serviceStarter dependenciesProperty filesSample RestControllerspringdoc-openapiSpring DataEntityRepositoriesSpring Cloud StreamCode examples for sending and receiving messagesDockerSummaryQuestions
Technical requirementsIntroducing the microservice landscapeInformation handled by the microservicesProduct serviceReview serviceRecommendation serviceProduct composite serviceInfrastructure-related informationTemporarily replacing service discoveryGenerating skeleton microservicesUsing Spring Initializr to generate skeleton codeSetting up multi-project builds in GradleAdding RESTful APIsAdding an API and a util projectThe API projectThe util projectImplementing our APIAdding a composite microserviceAPI classesPropertiesIntegration componentComposite API implementationAdding error handlingThe global REST controller exception handlerError handling in API implementationsError handling in the API clientTesting APIs manuallyAdding automated microservice tests in isolationAdding semi-automated tests of a microservice landscapeTrying out the test scriptSummaryQuestions
Technical requirementsIntroduction to DockerRunning our first Docker commandsChallenges with running Java in DockerLimiting available CPUsLimiting available memoryUsing Docker with one microserviceChanges in source codeBuilding a Docker imageStarting up the serviceRunning the container detachedManaging a landscape of microservices using Docker ComposeChanges in the source codeStarting up the microservice landscapeAutomating tests of cooperating microservicesTroubleshooting a test runSummaryQuestions
Technical requirementsIntroduction to using springdoc-openapiAdding springdoc-openapi to the source codeAdding dependencies to the Gradle build filesAdding OpenAPI configuration and general API documentation to the ProductCompositeServiceAdding API-specific documentation to the ProductCompositeService interfaceBuilding and starting the microservice landscapeTrying out the OpenAPI documentationSummaryQuestions
Technical requirementsChapter objectivesAdding a persistence layer to the core microservicesAdding dependenciesStoring data with entity classesDefining repositories in Spring DataWriting automated tests that focus on persistenceUsing TestcontainersWriting persistence testsUsing the persistence layer in the service layerLogging the database connection URLAdding new APIsCalling the persistence layer from the service layerDeclaring a Java bean mapperUpdating the service testsExtending the composite service APIAdding new operations in the composite service APIAdding methods in the integration layerImplementing the new composite API operationsUpdating the composite service testsAdding databases to the Docker Compose landscapeThe Docker Compose configurationDatabase connection configurationThe MongoDB and MySQL CLI toolsManual tests of the new APIs and the persistence layerUpdating the automated tests of the microservice landscapeSummaryQuestions
Technical requirementsChoosing between non-blocking synchronous APIs and event-driven asynchronous servicesDeveloping non-blocking synchronous REST APIs An introduction to Project ReactorNon-blocking persistence using Spring Data for MongoDBChanges in the test codeNon-blocking REST APIs in the core servicesChanges in the APIsChanges in the service implementationsChanges in the test codeDealing with blocking codeNon-blocking REST APIs in the composite servicesChanges in the APIChanges in the service implementationChanges in the integration layerChanges in the test codeDeveloping event-driven asynchronous servicesHandling challenges with messagingConsumer groupsRetries and dead-letter queuesGuaranteed order and partitionsDefining topics and eventsChanges in the Gradle build filesConsuming events in the core servicesDeclaring message processorsChanges in the service implementationsAdding configuration for consuming eventsChanges in the test codePublishing events in the composite servicePublishing events in the integration layerAdding configuration for publishing eventsChanges in the test codeRunning manual tests of the reactive microservice landscapeSaving eventsAdding a health APIUsing RabbitMQ without using partitionsUsing RabbitMQ with partitionsUsing Kafka with two partitions per topicRunning automated tests of the reactive microservice landscapeSummaryQuestions

Technical requirementsThe evolution of Spring CloudUsing Netflix Eureka for service discoveryUsing Spring Cloud Gateway as an edge serverUsing Spring Cloud Config for centralized configurationUsing Resilience4j for improved resilienceSample usage of the circuit breaker in Resilience4jUsing Spring Cloud Sleuth and Zipkin for distributed tracingSummaryQuestions
Technical requirementsIntroducing service discoveryThe problem with DNS-based service discoveryChallenges with service discoveryService discovery with Netflix Eureka in Spring CloudSetting up a Netflix Eureka serverConnecting microservices to a Netflix Eureka serverSetting up the configuration for development useEureka configuration parametersConfiguring the Eureka serverConfiguring clients to the Eureka serverTrying out the discovery serviceScaling upScaling downDisruptive tests with the Eureka serverStopping the Eureka serverStopping a review instanceStarting up an extra instance of the product serviceStarting up the Eureka server againSummaryQuestions
Technical requirementsAdding an edge server to our system landscapeSetting up Spring Cloud GatewayAdding a composite health checkConfiguring a Spring Cloud GatewayRouting rulesTrying out the edge serverExamining what is exposed outside the Docker engineTrying out the routing rulesCalling the product composite API through the edge serverCalling the Swagger UI through the edge serverCalling Eureka through the edge serverRouting based on the host headerSummaryQuestions
Technical requirementsIntroduction to OAuth 2.0 and OpenID ConnectIntroducing OAuth 2.0Introducing OpenID ConnectSecuring the system landscapeProtecting external communication with HTTPSReplacing a self-signed certificate at runtimeSecuring access to the discovery serverChanges in the Eureka serverChanges in Eureka clientsAdding a local authorization serverProtecting APIs using OAuth 2.0 and OpenID ConnectChanges in both the edge server and the product-composite serviceChanges in the product-composite service onlyChanges to allow Swagger UI to acquire access tokensChanges in the test scriptTesting with the local authorization serverBuilding and running the automated testsTesting the protected discovery serverAcquiring access tokensAcquiring access tokens using the client credentials grant flowAcquiring access tokens using the authorization code grant flowCalling protected APIs using access tokensTesting Swagger UI with OAuth 2.0Testing with an external OpenID Connect providerSetting up and configuring an account in Auth0Applying the required changes to use Auth0 as an OpenID providerChanging the configuration in the OAuth resource serversChanging the test script so it acquires access tokens from Auth0Running the test script with Auth0 as the OpenID Connect providerAcquiring access tokens using the client credentials grant flowAcquiring access tokens using the authorization code grant flowCalling protected APIs using the Auth0 access tokensGetting extra information about the userSummaryQuestions
Technical requirementsIntroduction to the Spring Cloud Configuration serverSelecting the storage type of the configuration repositoryDeciding on the initial client connectionSecuring the configurationSecuring the configuration in transitSecuring the configuration at restIntroducing the config server APISetting up a config serverSetting up a routing rule in the edge serverConfiguring the config server for use with DockerConfiguring clients of a config serverConfiguring connection informationStructuring the configuration repositoryTrying out the Spring Cloud Configuration serverBuilding and running automated testsGetting the configuration using the config server APIEncrypting and decrypting sensitive informationSummaryQuestions
Technical requirementsIntroducing the Resilience4j resilience mechanismsIntroducing the circuit breakerIntroducing the time limiterIntroducing the retry mechanismAdding the resilience mechanisms to the source codeAdding programmable delays and random errorsChanges in the API definitionsChanges in the product-composite microserviceChanges in the product microserviceAdding a circuit breaker and a time limiterAdding dependencies to the build fileAdding annotations in the source codeAdding fail-fast fallback logicAdding configurationAdding a retry mechanismAdding the retry annotationAdding configurationAdding automated testsTrying out the circuit breaker and retry mechanismBuilding and running the automated testsVerifying that the circuit is closed under normal operationsForcing the circuit breaker to open when things go wrongClosing the circuit breaker againTrying out retries caused by random errorsSummaryQuestions
Technical requirementsIntroducing distributed tracing with Spring Cloud Sleuth and ZipkinAdding distributed tracing to the source codeAdding dependencies to build filesAdding configuration for Spring Cloud Sleuth and ZipkinAdding Zipkin to the Docker Compose filesTrying out distributed tracingStarting up the system landscape with RabbitMQ as the queue managerSending a successful API requestSending an unsuccessful API requestSending an API request that triggers asynchronous processingMonitoring trace information passed to Zipkin in RabbitMQUsing Kafka as a message brokerSummaryQuestions
Technical requirementsIntroducing Kubernetes conceptsIntroducing Kubernetes API objectsIntroducing Kubernetes runtime componentsCreating a Kubernetes cluster using MinikubeWorking with Minikube profilesWorking with the Kubernetes CLI, kubectlWorking with kubectl contextsCreating a Kubernetes clusterTrying out a sample deploymentManaging a local Kubernetes clusterHibernating and resuming a Kubernetes clusterTerminating a Kubernetes clusterSummaryQuestions
Technical requirementsReplacing Netflix Eureka with Kubernetes ServicesIntroducing how Kubernetes will be usedUsing Spring Boot's support for graceful shutdown and probes for liveness and readinessIntroducing HelmRunning Helm commandsLooking into a Helm chartHelm templates and valuesThe common library chartThe ConfigMap templateThe Secrets templateThe Service templateThe Deployment templateThe components chartsThe environment chartsDeploying to Kubernetes for development and testBuilding Docker imagesResolving Helm chart dependenciesDeploying to KubernetesChanges in the test script for use with KubernetesTesting the deploymentTesting Spring Boot's support for graceful shutdown and probes for liveness and readinessDeploying to Kubernetes for staging and productionChanges in the source codeDeploying to KubernetesCleaning upSummaryQuestions
Technical requirementsReplacing the Spring Cloud Config ServerChanges required to replace the Spring Cloud Config ServerReplacing the Spring Cloud GatewayChanges required to replace the Spring Cloud GatewayAutomating certificate provisioningTesting with Kubernetes ConfigMaps, Secrets, Ingress, and the cert-managerRotating certificatesDeploying to Kubernetes for staging and productionVerifying that the microservices work without KubernetesChanges in the Docker Compose filesTesting with Docker ComposeSummaryQuestions
Technical requirementsIntroducing service meshes using IstioIntroducing IstioInjecting Istio proxies into microservicesIntroducing Istio API objectsSimplifying the microservice landscapeReplacing Kubernetes Ingress controller with Istio ingress gatewayReplacing the Zipkin server with Istio's Jaeger componentDeploying Istio in a Kubernetes clusterSetting up access to Istio servicesCreating the service meshSource code changesContent in the _istio_base.yaml templateContent in the _istio_dr_mutual_tls.yaml templateRunning commands to create the service meshObserving the service meshSecuring a service meshProtecting external endpoints with HTTPS and certificatesAuthenticating external requests using OAuth 2.0/OIDC access tokensProtecting internal communication using mutual authentication (mTLS)Ensuring that a service mesh is resilientTesting resilience by injecting faultsTesting resilience by injecting delaysPerforming zero-downtime updatesSource code changesVirtual services and destination rulesDeployments and servicesTying things together in the prod-env Helm chartDeploying v1 and v2 versions of the microservices with routing to the v1 versionVerifying that all traffic initially goes to the v1 version of the microservicesRunning canary testsRunning blue/green deploymentA short introduction to the kubectl patch commandPerforming the blue/green deploymentRunning tests with Docker ComposeSummaryQuestions
Technical requirementsIntroducing FluentdOverview of FluentdConfiguring FluentdDeploying the EFK stack on KubernetesBuilding and deploying our microservicesDeploying Elasticsearch and KibanaA walkthrough of the manifest filesRunning the deploy commandsDeploying FluentdA walkthrough of the manifest filesRunning the deploy commandsTrying out the EFK stackInitializing KibanaAnalyzing the log recordsDiscovering the log records from microservicesPerforming root cause analysesSummaryQuestions
Technical requirementsIntroduction to performance monitoring using Prometheus and GrafanaChanges in source code for collecting application metricsBuilding and deploying the microservicesMonitoring microservices using Grafana dashboardsInstalling a local mail server for testsStarting up the load testUsing Kiali's built-in dashboardsImporting existing Grafana dashboardsDeveloping your own Grafana dashboardsExamining Prometheus metricsCreating the dashboardTrying out the new dashboardExporting and importing Grafana dashboardsSetting up alarms in GrafanaSetting up a mail-based notification channelSetting up an alarm on the circuit breakerTrying out the circuit breaker alarmSummaryQuestions
Technical requirementsInstalling toolsInstalling HomebrewUsing Homebrew to install toolsInstall tools without HomebrewPost-installation actionsVerifying the installationsAccessing the source codeUsing an IDEThe structure of the code
Technical requirementsInstalling toolsInstalling tools on WindowsInstalling WSL 2 – Windows Subsystem for Linux v2Installing Ubuntu 20.04 on WSL 2Installing Windows TerminalInstalling Docker Desktop for WindowsInstalling Visual Studio Code and its extension for Remote WSLInstalling tools on the Linux server in WSL 2Installing tools using apt installInstalling the Spring Boot CLI using sdk installInstalling the remaining tools using curl and installVerifying the installationsAccessing the source codeThe structure of the code
Technical requirementsWhen to native compile Java source codeIntroducing the GraalVM projectIntroducing the Spring Native projectCompiling source code to a native imageChanges in the source codeUpdates to the Gradle build filesProviding native hints as annotationsWhen underlying frameworks and libraries don't support native compilationInstalling the tracing agentInstalling the tracing agent on macOSInstalling the tracing agent on Ubuntu under WSL 2 in Microsoft WindowsRunning the tracing agentCreating the native imagesTesting with Docker ComposeTesting with KubernetesSummaryQuestions

Content preview from Microservices with Spring Boot and Spring Cloud - Second Edition

20 Monitoring Microservices

In this chapter, we will learn how to use Prometheus and Grafana to collect, monitor, and alert about performance metrics. As we mentioned in Chapter 1, Introduction to Microservices, in a production environment it is crucial to be able to collect metrics for application performance and hardware resource usage. Monitoring these metrics is required to avoid long response times or outages for API requests and other processes.

To be able to monitor a system landscape of microservices in a cost-efficient and proactive way, we must also be able to define alarms that are triggered automatically if the metrics exceed the configured limits.

In this chapter, we will cover the following topics:

Introduction to performance ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Start your free trial

Hands-On Microservices with Spring Boot and Spring Cloud

Publisher Resources

ISBN: 9781801072977Supplemental Content

Microservices with Spring Boot and Spring Cloud - Second Edition

by Magnus Larsson

20

Monitoring Microservices

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

You might also like

Hands-On Microservices with Spring Boot and Spring Cloud

Practical Microservices Architectural Patterns: Event-Based Java Microservices with Spring Boot and Spring Cloud

Spring Boot Fundamentals: Building Java-Based Microservices and Enterprise Native Cloud Applications

Building Microservices with Spring Boot, Second Edition

Publisher Resources

20

Monitoring Microservices

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,and much more.

You might also like

Hands-On Microservices with Spring Boot and Spring Cloud

Practical Microservices Architectural Patterns: Event-Based Java Microservices with Spring Boot and Spring Cloud

Spring Boot Fundamentals: Building Java-Based Microservices and Enterprise Native Cloud Applications

Building Microservices with Spring Boot, Second Edition

Publisher Resources

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.