May 2025
Intermediate to advanced
402 pages
5h 9m
Chinese
Content preview from Kafka Connect
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
前言
共识协议、流处理、分布式系统--在流媒体世界的各种令人兴奋的想法中，人们很容易忽视不起眼的连接器的作用。但是，连接器解决了流媒体世界中最根本的问题--在一个数据静止的世界中，如何访问流媒体？如何将数据流平台接入业务的其他部分？
Kafka Connect 的目标就是让这一切变得更容易。在 Kafka Connect 框架出现之前，我们看到许多人使用 Apache Kafka 构建集成，并重复同样的错误。从一个系统读取数据并写入另一个系统看似简单，但这一过程可能隐藏着许多复杂性。如果机器发生故障会怎样？请求超时会发生什么？如何扩展集成？每个独特的 Kafka 集成都必须从头开始解决这些问题。Kafka Connect 的设计目的是将读写到特定系统的逻辑与构建、运行和扩展这些集成的通用框架分离开来。
Kafka Connect 在很多重要方面都不同于其他集成层或连接器层：
它首先是为流媒体设计的。
它与 Kafka 的语义配合使用，可从允许精确一次性的系统中启用精确一次性，并为不允许精确一次性的系统提供最强大的语义。
它不仅能让你捕捉字节，还能传播数据的某些语义结构。
它解决了分区、扩展和容错方面的许多复杂问题。
它可以让你通过共享的硬件池，以同质化的方式操作和监控各种连接器。
我认为，这些原因正是 Kafka Connect 如此受欢迎的原因，也是它受到各类 Kafka 用户追捧的原因，更是其连接器生态系统发展到数以百计的原因。
成功使用 Kafka Connect 可以让你将公司各部门的数据开放到你的数据流平台上，但在将其用于生产之前，重要的是要认识到 Kafka Connect 本身就是一个复杂的分布式系统，并了解一下它的工作原理。
本书是学习如何使用连接器、配置Kafka Connect框架、在生产中监控和操作它，甚至开发自己的源和汇连接器的绝佳途径。对于那些希望深入研究这一重要课题的人来说，我想不出还有比这更好的资源，也想不出还有比这更快的方法让 Kafka 与你的其他系统和应用程序连接起来。
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.