Mastering Kibana 6.x

Mastering Kibana 6.x

by Anurag Srivastava
Released July 2018
Publisher(s): Packt Publishing
ISBN: 9781788831031

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

Get to grips with Kibana and its advanced functions to create interactive visualizations and dashboards

Key Features

  • Explore visualizations and perform histograms, stats, and map analytics
  • Unleash X-Pack and Timelion, and learn alerting, monitoring, and reporting features
  • Manage dashboards with Beats and create machine learning jobs for faster analytics

Book Description

Kibana is one of the popular tools among data enthusiasts for slicing and dicing large datasets and uncovering Business Intelligence (BI) with the help of its rich and powerful visualizations.

To begin with, Mastering Kibana 6.x quickly introduces you to the features of Kibana 6.x, before teaching you how to create smart dashboards in no time. You will explore metric analytics and graph exploration, followed by understanding how to quickly customize Kibana dashboards. In addition to this, you will learn advanced analytics such as maps, hits, and list analytics. All this will help you enhance your skills in running and comparing multiple queries and filters, influencing your data visualization skills at scale.

With Kibana's Timelion feature, you can analyze time series data with histograms and stats analytics. By the end of this book, you will have created a speedy machine learning job using X-Pack capabilities.

What you will learn

  • Create unique dashboards with various intuitive data visualizations
  • Visualize Timelion expressions with added histograms and stats analytics
  • Integrate X-Pack with your Elastic Stack in simple steps
  • Extract data from Elasticsearch for advanced analysis and anomaly detection using dashboards
  • Build dashboards from web applications for application logs
  • Create monitoring and alerting dashboards using Beats

Who this book is for

Mastering Kibana 6.x is for you if you are a big data engineer, DevOps engineer, or data scientist aspiring to go beyond data visualization at scale and gain maximum insights from their large datasets. Basic knowledge of Elasticstack will be an added advantage, although not mandatory.

Publisher resources

View/Submit Errata

Table of contents

  1. Title Page
  2. Copyright and Credits
    1. Mastering Kibana 6.x
  3. Packt Upsell
    1. Why subscribe?
    2. PacktPub.com
  4. Contributors
    1. About the author
    2. About the reviewers
    3. Packt is searching for authors like you
  5. Preface
    1. Who this book is for
    2. What this book covers
    3. To get the most out of this book
      1. Download the color images
      2. Conventions used
    4. Get in touch
      1. Reviews
  6. Revising the ELK Stack
    1. What is ELK Stack?
      1. Elasticsearch
      2. Logstash
      3. Kibana
      4. Beats
    2. Installing the ELK Stack
      1. Elasticsearch
        1. Installing Elasticsearch using a TAR file
        2. Installing Elasticsearch with Homebrew
        3. Installing Elasticsearch with MSI Windows Installer
        4. Installing Elasticsearch with the Debian package
        5. Installing Elasticsearch with the RPM package
      2. Logstash
        1. Using apt package repositories
        2. Using yum package repositories
      3. Kibana
        1. Installing Kibana using .tar.gz
        2. Installing Kibana using the Debian package
        3. Installing Kibana using rpm
        4. Installing Kibana on Windows
      4. Beats
        1. Packetbeat
        2. Metricbeat
        3. Filebeat
        4. Winlogbeat
        5. Heartbeat
    3. ELK use cases
      1. Log management
      2. Security monitoring and alerting
      3. Web scraping
      4. E-commerce search solutions
      5. Full text search
      6. Visualizing data
    4. Summary
  7. Setting Up and Customizing the Kibana Dashboard
    1. Setting up the stage
      1. Configuring Logstash to fetch data from the Apache log file
      2. Outputting the log data into Elasticsearch
      3. Configuring Kibana to read the Elasticsearch index
      4. Creating demo visualizations with Apache log data
    2. Creating the dashboard
      1. Customizing the dashboard
        1. Editing the visualization
        2. Changing the title by customizing the panel
        3. Moving the visualization to full screen
        4. Deleting the visualization from the dashboard
        5. Changing the colors of the visualization
        6. Dragging and dropping visualizations on a desired location on the dashboard
        7. Resizing the visualization as per our requirements
        8. Exporting CSV data from the visualization
        9. Getting the Elasticsearch request, response, and statistics
    3. Summary
  8. Exploring Your Data
    1. Kibana Discover
    2. Discovering data using Kibana Discover
      1. Configuring Packetbeat to push packet data into Elasticsearch
      2. Configuring Kibana to read the Elasticsearch index with packet logs
    3. Exploring Kibana Discover to access packet data
      1. Showing the required fields
      2. Applying the time filter
      3. Elasticsearch query DSL
      4. Filter
      5. Saving and opening searches
        1. Saving the result
        2. Opening the result
        3. Sharing results
      6. Field data statistics
    4. Summary
  9. Visualizing the Data
    1. Creating visualizations
      1. Basic charts
      2. Data
      3. Maps
      4. Time series
      5. Other
    2. Pie charts
      1. Metric aggregation
      2. Bucket aggregation
      3. Creating a pie chart
      4. Adding another dimension to the pie chart
    3. Bar charts
      1. Metric aggregation
      2. Bucket aggregation
      3. Creating a bar chart
    4. Area charts
      1. Creating an area chart
    5. Data metrics
      1. Creating a data metric
    6. Data tables
      1. Creating the data table
    7. Tag clouds
      1. Creating a tag cloud
    8. Markdown
      1. Creating a markdown visualization
    9. Sharing visualizations
    10. Summary
  10. Dashboarding to Showcase Key Performance Indicators
    1. Creating the dashboard
    2. Arranging visualizations
      1. Moving visualizations
      2. Resizing visualizations
      3. Removing visualizations
      4. Showing in full screen
      5. Showing visualization data
      6. Modifying the visualization
      7. Saving the dashboard
      8. Sharing the dashboard
        1. Sharing the saved dashboard
        2. Sharing the snapshot
      9. Cloning the dashboard
    3. Exploring the dashboard
      1. The search query
      2. Adding filters
      3. Applying the time filter
      4. Clicking on visualizations
    4. Summary
  11. Handling Time Series Data with Timelion
    1. Timelion interface
    2. Timeline expression
    3. .es function parameters
    4. Chainable methods
      1. .sum()
      2. .avg()
      3. .min()
      4. .max()
      5. .log()
      6. .abs()
      7. .divide()
      8. .multiply()
      9. .derivative()
      10. .bars()
      11. .color()
      12. .label()
      13. .legend()
      14. .movingaverage()
      15. .trend()
      16. .range()
      17. .precision()
    5. Data source functions
      1. Elasticsearch
        1. Static/value
        2. World bank
        3. Setting the offset for data sources
    6. Saving Timelion graph
    7. Timelion sheet option
    8. Deleting Timelion sheet
    9. Timelion help
      1. Function reference
      2. Keyboard tips
    10. Timelion auto-refresh
    11. Summary
  12. Interact with Your Data Using Dev Tools
    1. Console
      1. Copy as cURL
      2. Auto indent
      3. Multiple requests in console
    2. Profiling queries
      1. Query profile
      2. Aggregation profile
    3. Grok debugger
    4. Summary
  13. Tweaking Your Configuration with Kibana Management
    1. Index pattern
      1. Creating the index pattern
      2. Setting the default index pattern
      3. Refreshing index pattern fields
      4. Deleting an index pattern
      5. Managing fields
        1. String
        2. Dates
        3. Geographic point field
        4. Numbers
    2. Saved objects
      1. Dashboards
      2. Searches
      3. Visualizations
    3. Advanced settings
      1. xPack:defaultAdminEmail
      2. search:queryLanguage
      3. search:queryLanguage:switcher:enable
      4. dateFormat
      5. dateFormat:tz
      6. dateFormat:dow
      7. defaultIndex
    4. Reporting
    5. Security
      1. Roles
      2. Users
    6. Watcher
      1. Creating the watch
        1. Threshold alert
        2. Advanced watch
      2. Deleting the watch
    7. Summary
  14. Understanding X-Pack Features
    1. Installing X-Pack
      1. Installing X-Pack into Elasticsearch
      2. Installing X-Pack into Kibana
    2. Features of X-Pack
      1. Monitoring
        1. Elasticsearch monitoring
        2. Kibana monitoring
      2. Security settings
        1. Users
        2. Roles
      3. Machine learning
        1. Other options of X-Pack
      4. Application Performance Monitoring
      5. Logging
        1. Apache logs
        2. MySQL logs
        3. Nginx logs
        4. System logs
      6. Metrics
        1. Apache metrics
        2. Docker metrics
        3. Kubernetes metrics
        4. MySQL metrics
        5. Nginx metrics
        6. Redis metrics
        7. System metrics
    3. Summary 
  15. Machine Learning with Kibana
    1. Machine learning jobs
      1. Single metric Jobs
      2. Multi-metric jobs
      3. Population Jobs
      4. Advanced Jobs
    2. Create a machine learning job
      1. Data visualizer
      2. Single metric Job
      3. Managing jobs
        1. Job settings
        2. Job config
        3. Datafeed
        4. Counts
        5. JSON
        6. Job messages
        7. Datafeed preview
      4. Anomaly explorer
      5. Single metric viewer
      6. Multi metric job
      7. Explore multi metric job result
      8. Population job
    3. Summary 
  16. Create Super Cool Dashboard from a Web Application
    1. JDBC input plugin
      1. Scheduling
      2. Maintaining the last SQL value 
      3. Fetch size
    2. Configuring Logstash for database input
    3. Creating a dashboard using MySQL data
      1. Creating visualizations
        1. Total blog and top blog count
        2. Blogger-wise blog counts
        3. Tag cloud for blog categories
        4. Blogger name-category-views-blog pie chart
        5. Tabular view of blog details
      2. Create dashboard
    4. Summary
  17. Different Use Cases of Kibana
    1. Time-series data handling
      1. Conditional formatting
      2. Tracking trends
    2. A visual builder for handling time series data
    3. GeoIP for Elastic Stack
      1. Ingest node
      2. GeoIP with Packetbeat data
    4. Summary
  18. Creating Monitoring Dashboards Using Beats
    1. Configuring the Beats
      1. Filebeat
        1. Configuring Filebeat
      2. Metricbeat
        1. Configuring Metricbeat
          1. Enabling the modules using the metricbeat.yml file
          2. Enabling the modules from the modules.d directory
      3. Packetbeat
        1. Configuring Packetbeat
    2. Creating visualizations using Beat data
      1. Visualization using Filebeat
      2. Visualization using Metricbeat
      3. Visualization using Packetbeat
    3. Creating the dashboard
    4. Importing Beat dashboards
      1. Importing dashboards in Filebeat
      2. Importing dashboards in Metricbeat
      3. Importing dashboards in Packetbeat
    5. Summary
  19. Best Practices
    1. Requirement of test environment
    2. Picking the right time filter field
    3. Avoiding large document indexing
    4. Avoiding sparsity
      1. Avoiding unrelated data in the same index
      2. Normalizing the document
      3. Avoiding types in Indices
    5. Avoiding wildcard searches
    6. Summary
  20. Other Books You May Enjoy
    1. Leave a review - let other readers know what you think

Product information

  • Title: Mastering Kibana 6.x
  • Author(s): Anurag Srivastava
  • Release date: July 2018
  • Publisher(s): Packt Publishing
  • ISBN: 9781788831031