Ingest node

We can use the ingest node for preprocessing the document before document indexing. It first applies the transformations and then pushes the document for indexing. All nodes are enabled by default for the ingest process, so they all can handle the ingest task.

If we want to preprocess any documents before indexing them, we need to first define a pipeline with a series of processors that can transform the document. We have the following ingest APIs:

  • Put Pipeline API: Using this API, we can add or update a pipeline. The following expression shows the put pipeline example:
PUT _ingest/pipeline/my-pipeline-id
{
  "description" : "describe pipeline",
  "processors" : [
    {
      "set" : {
        "field": "foo",
        "value": "bar"
      }
    }
  ]
}
  • Get Pipeline ...

Get Mastering Kibana 6.x now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.