book

Elasticsearch 8.x Cookbook - Fifth Edition

Name: Elasticsearch 8.x Cookbook - Fifth Edition
Author: Alberto Paro
ISBN: 9781801079815

by Alberto Paro

May 2022

Intermediate to advanced

750 pages

13h 39m

English

Packt Publishing

Read now

Unlock full access

Fifth Edition
Fifth EditionContributorsAbout the authorAbout the reviewers
Preface
Who this book is forWhat this book coversTo get the most out of this bookDownload the example code filesDownload the color imagesConventions usedSectionsGetting readyHow to do it…How it works…There's more…See alsoGet in touchShare Your Thoughts
Chapter 1: Getting Started
Technical requirementsDownloading and installing ElasticsearchGetting readyHow to do it…How it works…There's more…See alsoSetting up networkingGetting readyHow to do it…How it works…See alsoSetting up a nodeGetting readyHow to do it…How it works…See alsoSetting up Linux systemsGetting readyHow to do it…How it works…There's more…Setting up different node rolesGetting readyHow to do it…How it works…There's more…See alsoSetting up a coordinating-only nodeGetting readyHow to do it…How it works…Setting up an ingestion nodeGetting readyHow to do it…How it works…There's more…Installing plugins in ElasticsearchGetting readyHow to do it…How it works…There's more…See alsoRemoving a pluginGetting readyHow to do it…How it works…Changing logging settingsGetting readyHow to do it…How it works…Setting up a node via DockerGetting readyHow to do it…How it works…There's more…See alsoDeploying on Elastic Cloud EnterpriseGetting readyHow to do it…How it works…See also
Chapter 2: Managing Mappings
Technical requirementsUsing explicit mapping creationGetting readyHow to do it…How it works…There's more…See alsoMapping base typesGetting readyHow to do it...How it works...There's more...See alsoMapping arraysGetting readyHow to do it…How it works…Mapping an objectGetting readyHow to do it…How it works…See alsoMapping a documentGetting readyHow to do it…How it works…See alsoUsing dynamic templates in document mappingGetting readyHow to do it…How it works…There's more...See alsoManaging nested objectsGetting readyHow to do it…How it works…There's more...See alsoManaging a child document with a join fieldGetting readyHow to do it…How it works…There's more...See alsoAdding a field with multiple mappingsGetting readyHow to do it…How it works…There's more...See alsoMapping a GeoPoint fieldGetting readyHow to do it…How it works…There's more...Mapping a GeoShape fieldGetting readyHow to do it…How it works…See alsoMapping an IP fieldGetting readyHow to do it…How it works…Mapping an Alias fieldGetting readyHow to do it...How it works…Mapping a Percolator fieldGetting readyHow to do it...How it works…Mapping the Rank Feature and Feature Vector fieldsGetting readyHow to do it…How it works…Mapping the Search as you type fieldGetting readyHow to do it…How it works…See alsoUsing the Range Fields typeGetting readyHow to do it...How it works…See alsoUsing the Flattened field typeGetting readyHow to do it…How it works…See alsoUsing the Point and Shape field typesGetting readyHow to do it…How it works…See alsoUsing the Dense Vector field typeGetting readyHow to do it…How it works...Using the Histogram field typeGetting readyHow to do it…How it works…See alsoAdding metadata to a mappingGetting readyHow to do it…How it works…Specifying different analyzersGetting readyHow to do it…How it works…See alsoUsing index components and templatesGetting readyHow to do it…How it works…See also
Chapter 3: Basic Operations
Technical requirementsCreating an indexGetting readyHow to do it...How it works...There's more...See alsoDeleting an indexGetting readyHow to do it...How it works...See alsoOpening or closing an indexGetting readyHow to do it...How it works...There's more...See alsoPutting a mapping in an indexGetting readyHow to do it...How it works...There's more...See alsoGetting a mappingGetting readyHow to do it...How it works...See alsoReindexing an indexGetting readyHow to do it...How it works...See alsoRefreshing an indexGetting readyHow to do it...How it works...See alsoFlushing an indexGetting readyHow to do it...How it works...See alsoUsing ForceMerge on an indexGetting readyHow to do it...How it works...There's more...See alsoShrinking an indexGetting readyHow to do it...How it works...There's more...See alsoChecking whether an index existsGetting readyHow to do it...How it works...Managing index settingsGetting readyHow to do it...How it works...There's more...See alsoUsing index aliasesGetting readyHow to do it...How it works...There's more...Managing dangling indicesGetting readyHow to do it…How it works...See alsoResolving index namesGetting readyHow to do it…How it works...See alsoRolling over an indexGetting readyHow to do it…How it works...There's more...See alsoIndexing a documentGetting readyHow to do it...How it works...There's more...See alsoGetting a documentGetting readyHow to do it...How it works...There's more...See alsoDeleting a documentGetting readyHow to do it...How it works...See alsoUpdating a documentGetting readyHow to do it...How it works...See alsoSpeeding up atomic operations (bulk operations)Getting readyHow to do it...How it works...Speeding up GET operations (multi-GET)Getting readyHow to do it...How it works...See also...
Chapter 4: Exploring Search Capabilities
Technical requirementsExecuting a searchGetting readyHow to do it...How it works...There's more...See alsoSorting resultsGetting readyHow to do it...How it works...There's more...See alsoHighlighting resultsGetting readyHow to do it...How it works...See alsoExecuting a scrolling queryGetting readyHow to do it...How it works...There's more...See alsoUsing the search_after functionalityGetting readyHow to do it…How it works...See alsoReturning inner hits in resultsGetting readyHow to do it...How it works...See alsoSuggesting a correct queryGetting readyHow to do it...How it works...See alsoCounting matched resultsGetting readyHow to do it...How it works...There's more...See alsoExplaining a queryGetting readyHow to do it...How it works...There's more...See alsoQuery profilingGetting readyHow to do it...How it works...Deleting by queryGetting readyHow to do it...How it works...There's more...See alsoUpdating by queryGetting readyHow to do it...How it works...There's more...See alsoMatching all of the documentsGetting readyHow to do it...How it works...See alsoUsing a Boolean queryGetting readyHow to do it...How it works...There's more...Using the search templateGetting readyHow to do it...How it works...See also
Chapter 5: Text and Numeric Queries
Technical requirementsUsing a term queryGetting readyHow to do it...How it works...There's more...Using a terms queryGetting readyHow to do it...How it works...There's more...See alsoUsing a terms set queryGetting readyHow to do it...How it works...See alsoUsing a prefix queryGetting readyHow to do it...How it works...There's more...See alsoUsing a wildcard queryGetting readyHow to do it...How it works...See alsoUsing a regexp queryGetting readyHow to do it...How it works...See alsoUsing span queriesGetting readyHow to do it...How it works...See alsoUsing a match queryGetting readyHow to do it...How it works...See alsoUsing a query string queryGetting readyHow to do it...How it works...There's more…See alsoUsing a simple query string queryGetting readyHow to do it...How it works...See alsoUsing the range queryGetting readyHow to do it...How it works...There's more...Using an IDs queryGetting readyHow to do it...How it works...See alsoUsing the function score queryGetting readyHow to do it...How it works...See alsoUsing the exists queryGetting readyHow to do it...How it works...See alsoUsing a pinned query (XPACK)Getting readyHow to do it...How it works...See also
Chapter 6: Relationships and Geo Queries
Technical requirementsUsing the has_child queryGetting readyHow to do it...How it works...There's more...See alsoUsing the has_parent queryGetting readyHow to do it...How it works...See alsoUsing the nested queryGetting readyHow to do it...How it works...See alsoUsing the geo_bounding_box queryGetting readyHow to do it...How it works...See alsoUsing the geo_shape queryGetting readyHow to do it...How it works...See alsoUsing the geo_distance queryGetting readyHow to do it...How it works...See also
Chapter 7: Aggregations
Executing an aggregationGetting readyHow to do it...How it works...See alsoExecuting a stats aggregationGetting readyHow to do it...How it works...See alsoExecuting a terms aggregationGetting readyHow to do it...How it works...There’s more...See alsoExecuting a significant terms aggregationGetting readyHow to do it...How it works...Executing a range aggregationGetting readyHow to do it...How it works...There’s more...See alsoExecuting a histogram aggregationGetting readyHow to do it...How it works...There’s more...See alsoExecuting a date histogram aggregationGetting readyHow to do it...How it works...There’s more...See alsoExecuting a filter aggregationGetting readyHow to do it...How it works...There’s more...See alsoExecuting a filters aggregationGetting readyHow to do it...How it works...Executing a global aggregationGetting readyHow to do it...How it works...Executing a geo distance aggregationGetting readyHow to do it...How it works...See alsoExecuting a children aggregationGetting readyHow to do it...How it works...Executing a nested aggregationGetting readyHow to do it...How it works...There’s more...Executing a top hit aggregationGetting readyHow to do it...How it works...See alsoExecuting a matrix stats aggregationGetting readyHow to do it...How it works...Executing a geo bounds aggregationGetting readyHow to do it...How it works...See alsoExecuting a geo centroid aggregationGetting readyHow to do it...How it works...See alsoExecuting a geotile grid aggregationGetting readyHow to do it...How it works...See alsoExecuting a sampler aggregationGetting readyHow to do it...How it works...Executing a pipeline aggregationGetting readyHow to do it...How it works...See also
Chapter 8: Scripting in Elasticsearch
Painless scriptingGetting readyHow to do it...How it works...There’s more...See alsoInstalling additional scripting languagesGetting readyHow to do it...How it works...There’s more...Managing scriptsGetting readyHow to do it...How it works...There’s more...See alsoSorting data using scriptsGetting readyHow to do it...How it works...There’s more...Computing return fields with scriptingGetting readyHow to do it...How it works...See alsoFiltering a search using scriptingGetting readyHow to do it...How it works...See alsoUsing scripting in aggregationsGetting readyHow to do it...How it works...Updating a document using scriptsGetting readyHow to do it...How it works...There’s more...Reindexing with a scriptGetting readyHow to do it...How it works...Scripting in ingest processorsGetting readyHow to do it...How it works...See also

Chapter 9: Managing Clusters
Controlling the cluster health using the health APIGetting readyHow to do it...How it works...There's more...See alsoControlling the cluster state using the APIGetting readyHow to do it...How it works...There's more...See alsoGetting cluster node information using the APIGetting readyHow to do it...How it works...There's more...See alsoGetting node statistics using the APIGetting readyHow to do it...How it works...There's more...Using the task management APIGetting readyHow to do it...How it works...There's more...See alsoUsing the hot threads APIGetting readyHow to do it...How it works...Managing the shard allocationGetting readyHow to do it...How it works...There's more...See alsoMonitoring segments with the segment APIGetting readyHow to do it...How it works...See alsoCleaning the cacheGetting readyHow to do it...How it works...
Chapter 10: Backups and Restoring Data
Managing repositoriesGetting readyHow to do it...How it works...There's more...See alsoExecuting a snapshotGetting readyHow to do it...How it works...There's more...Restoring a snapshotGetting readyHow to do it...How it works...Setting up an NFS share for backupsGetting readyHow to do it...How it works...Reindexing from a remote clusterGetting readyHow to do it...How it works...See also
Chapter 11: User Interfaces
Installing KibanaGetting readyHow to do it...How it works...See alsoManaging Kibana DiscoverGetting readyHow to do it...How it works...Visualizing data with KibanaGetting readyHow to do it...How it works...Using Kibana Dev ToolsGetting readyHow to do it...How it works...There's more...See also
Chapter 12: Using the Ingest Module
Pipeline definitionGetting readyHow to do it...How it works...There's more...See alsoInserting an ingest pipelineGetting readyHow to do it...How it works...Getting an ingest pipelineGetting readyHow to do it...How it works...There's more...Deleting an ingest pipelineGetting readyHow to do it...How it works...Simulating an ingest pipelineGetting readyHow to do it...How it works...There's more...Built-in processorsGetting readyHow to do it...How it works...See alsoThe grok processorGetting readyHow to do it...How it works...See alsoUsing the ingest attachment pluginGetting readyHow to do it...How it works...Using the ingest GeoIP processorGetting readyHow to do it...How it works...See alsoUsing the enrichment processorGetting readyHow to do it...How it works...See also
Chapter 13: Java Integration
Creating a standard Java HTTP clientGetting readyHow to do it...How it works...See alsoCreating a low-level Elasticsearch clientGetting readyHow to do it...How it works...See alsoUsing the Elasticsearch official Java clientGetting readyHow to do it...How it works...See alsoManaging indicesGetting readyHow to do it...How it works...See alsoManaging mappingsGetting readyHow to do it...How it works...There's more...See alsoManaging documentsGetting readyHow to do it...How it works...See alsoManaging bulk actionsGetting readyHow to do it...How it works...Building a queryGetting readyHow to do it...How it works...There's more...Executing a standard searchGetting readyHow to do it...How it works...See alsoExecuting a search with aggregationsGetting readyHow to do it...How it works...See alsoExecuting a scroll searchGetting readyHow to do it...How it works...See alsoIntegrating with DeepLearning4jGetting readyHow to do it...How it works...See also
Chapter 14: Scala Integration
Creating a client in ScalaGetting readyHow to do it…How it works...See alsoManaging indicesGetting readyHow to do it...How it works...See alsoManaging mappingsGetting readyHow to do it...How it works...See alsoManaging documentsGetting readyHow to do it...How it works...There's more...See alsoExecuting a standard searchGetting readyHow to do it...How it works...See alsoExecuting a search with aggregationsGetting readyHow to do it...How it works...See alsoIntegrating with DeepLearning.scalaGetting readyHow to do it...How it works...See also
Chapter 15: Python Integration
Creating a clientGetting readyHow to do it...How it works…See alsoManaging indicesGetting readyHow to do it…How it works…There's more…See alsoManaging mappingsGetting readyHow to do it…How it works…See alsoManaging documentsGetting readyHow to do it… How it works…See alsoExecuting a standard searchGetting readyHow to do it…How it works…See alsoExecuting a search with aggregationsGetting readyHow to do it…How it works…See alsoIntegrating with NumPy and scikit-learnGetting readyHow to do it...How it works...See alsoUsing AsyncElasticsearchGetting readyHow to do it...How it works...See alsoUsing Elasticsearch with FastAPIGetting readyHow to do it...How it works...See also
Chapter 16: Plugin Development
Creating a pluginGetting readyHow to do it...How it works...There's more...Creating an analyzer pluginGetting readyHow to do it...How it works...There's more...Creating a REST pluginGetting readyHow to do it...How it works...See alsoCreating a cluster actionGetting readyHow to do it...How it works...See alsoCreating an ingest pluginGetting readyHow to do it...How it works...See also
Chapter 17: Big Data Integration
Installing Apache SparkGetting readyHow to do it...How it works...There's more...Indexing data using Apache SparkGetting readyHow to do it...How it works...See alsoIndexing data with meta using Apache SparkGetting readyHow to do it...How it works...There's more...Reading data with Apache SparkGetting readyHow to do it...How it works...Reading data using Spark SQLGetting readyHow to do it...How it works...Indexing data with Apache PigGetting readyHow to do it...How it works...Using Elasticsearch with AlpakkaGetting readyHow to do it...How it works...See alsoUsing Elasticsearch with MongoDBGetting readyHow to do it...How it works...See also
Chapter 18: X-Pack
ILM – managing the index life cycleGetting readyHow to do it...How it works...There's more...See alsoILM – automating rolloverGetting readyHow to do it...How it works...There's more...See alsoUsing the SQL Rest APIGetting readyHow to do it…How it works...There's more...See alsoUsing SQL via JDBCGetting readyHow to do it…How it works...See alsoUsing X-Pack SecurityGetting readyHow to do it…How it works...See alsoUsing alerting to monitor data eventsGetting readyHow to do it…How it works...See also
Why subscribe?
Other Books You May EnjoyPackt is searching for authors like youShare Your Thoughts

Overview

"Elasticsearch 8.x Cookbook" is your go-to resource for harnessing the full potential of Elasticsearch 8. This book provides over 180 hands-on recipes to help you efficiently implement, customize, and scale Elasticsearch solutions in your enterprise. Whether you're handling complex queries, analytics, or cluster management, you'll find practical insights to enhance your capabilities.

What this Book will help me do

Understand the advanced features of Elasticsearch 8.x, including X-Pack, for improving functionality and security.
Master advanced indexing and query techniques to perform efficient and scalable data operations.
Implement and manage Elasticsearch clusters effectively including monitoring performance via Kibana.
Integrate Elasticsearch seamlessly into Java, Scala, Python, and big data environments.
Develop custom plugins and extend Elasticsearch to meet unique project requirements.

Author(s)

Alberto Paro is a seasoned Elasticsearch expert with years of experience in search technologies and enterprise solution development. As a professional developer and consultant, he has worked with numerous organizations to implement Elasticsearch at scale. Alberto brings his deep technical knowledge and hands-on approach to this book, ensuring readers gain practical insights and skills.

Who is it for?

This book is perfect for software engineers, data professionals, and developers working with Elasticsearch in enterprise environments. If you're seeking to advance your Elasticsearch knowledge, enhance your query-writing abilities, or seek to integrate it into big data workflows, this book will be invaluable. Regardless of whether you're deploying Elasticsearch in e-commerce, applications, or for analytics, you'll find the content purposeful and engaging.

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Publisher Resources

ISBN: 9781801079815

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills