Skip to Content
Mastering Kafka Streams and ksqlDB
book

Mastering Kafka Streams and ksqlDB

by Mitch Seymour
February 2021
Intermediate to advanced
432 pages
11h 7m
English
O'Reilly Media, Inc.
Content preview from Mastering Kafka Streams and ksqlDB

Appendix B. ksqlDB Configuration

ksqlDB accepts most Kafka Streams and Kafka Client (i.e., producer and consumer) configurations. The recommended pattern is to prefix all Kafka Streams and Kafka Client configs with ksql.streams. For example, if you want to configure a record cache using the cache.max.bytes.buffering parameter in Kafka Streams, you would set the ksql.streams.cache.max.bytes.buffering parameter in your server.properties file. Furthermore, if you want to configure the auto.offset.reset Kafka Consumer configuration, this would also be prefixed the same way, and would become ksql.streams.auto.offset.reset. Technically, the prefix is optional, but comes as a recommendation from the creators of ksqlDB (Confluent).

In addition to the standard Kafka Streams and Kafka Client configs, ksqlDB also allows you to specify a Kafka Connect configuration if you are using ksqlDB’s data integration features (e.g., whenever you are executing a CREATE {SOURCE|SINK} CONNECTOR statement). We’ve already discussed this in “Configuring Connect Workers”, so please see that section for more detail.

Finally, there are several configurations that are specific to ksqlDB. We have grouped some of the most important configurations into two categories: query configurations and server configurations. This page should be used as a starting point for configuring ksqlDB. Please refer to the official documentation for a full list of ksqlDB configuration parameters.1

Query Configurations

The following ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

Kafka: The Definitive Guide

Kafka: The Definitive Guide

Neha Narkhede, Gwen Shapira, Todd Palino
Kafka: The Definitive Guide, 2nd Edition

Kafka: The Definitive Guide, 2nd Edition

Gwen Shapira, Todd Palino, Rajini Sivaram, Krit Petty
Kafka in Action

Kafka in Action

Dylan Scott, Viktor Gamov, Dave Klein

Publisher Resources

ISBN: 9781492062486Errata Page