November 2022
Beginner to intermediate
346 pages
11h
Chinese
Content preview from Kafka权威指南（第2版）
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
170
｜
第
9
章
建议把
Kafka
看成能够处理数据集成（通过
Connect
）、应用集成（通过生产者和消费者）
和流式处理的平台。
Kafka
可以作为
ETL
工具的一个可行替代品。
9.4.3
流式处理框架
大部分流式处理框架具备从
Kafka
读取数据并将数据写入外部系统的能力。如果目标系统
支持，并且你已经打算使用流式框架处理来自
Kafka
的数据
，那么就可以使用同样的框架
进行数据集成。这样就可以省掉一个处理步骤（无须把处理过的数据保存到
Kafka
，
只需
读取数据，再把它们写入其他系统），只是在发生数据丢失或出现损坏数据时，诊断问题
会变得更难一些。
9.5
小结
本章讨论了如何使用
Kafka
进行数据集成。首先解释了为什么要使用
Kafka
进行数据集成，
并说明了数据集成方案的一般性考虑点。然后展示了为什么
Kafka
和
Connect
API
是一种
更好的选择，之后给出了一些例子，演示如何在不同的场景中使用
Connect
，并深入介绍
了
Connect
的工作原理。最后介绍了
Connect
之外的一些数据集成方案。
不管最终选择哪一种数据集成方案，都需要保证所有消息能够在各种恶劣条件下完成传
递。我们相信，有
Kafka
的可靠性作为基础
，
Connect
也具备了极高的可靠性。不过，仍
然需要对所选择的方案进行严格的测试，确保它们在发生进程停止、机器崩溃、网络延迟
和高负载的情况下不丢失消息。毕竟，数据集成系统的核心任务是传递数据。
当然，可靠性是在集成数据系统时的一个重要考虑因素，但也只是其中的一个需求。在选
择数据系统时，首先要明确需求（有关示例请参见 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.