November 2022
Beginner to intermediate
346 pages
11h
Chinese
Content preview from Kafka权威指南（第2版）
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
构建数据管道
｜
157
单机模式
需要注意的是，
Connect
也
支持单机模式。与分布式模式类似，单机模式只
是在启动时用
bin/connect-standalone.sh
代替
bin/connect-distributed.sh
。
你也可以通过命令行传入连接器的配置文件，不需要使用
REST API
。在单
机模式下，所有的连接器和任务都运行在单个独立的
worker
上。如果需要
让连接器和任务运行在某台特定机器上（例如，
Syslog
连接器会监听某个端
口，你需要知道它运行在哪台机器上），就可以采用这种模式。
9.3.2
连接器示例
：
文件数据源和文件数据池
这个示例使用了文件连接器和
JSON
转换器，它们都是
Kafka
自带的。接下来要确保
ZooKeeper
和
Kafka
都处于运行状态。
首先启动一个分布式
worker
。
为了实现高可用性，真实的生产环境一般需要至少
2~3
个
worker
。不过这个示例中只启动了一个。
bin/connect-distributed.sh config/connect-distributed.properties &
现在启动一个文件数据源。为方便起见，直接让它读取
Kafka
的配置文件，也就是说把
Kafka
配置文件中的内容发送到一个主题上。
echo '{"name":"load-kafka-config", "config":{"connector.class":
"FileStreamSource","file":"config/server.properties","topic": ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.