January 2018
Beginner to intermediate
234 pages
7h 8m
Chinese
Content preview from Kafka权威指南
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
102
｜
第
7
章
本章将讨论在构建数据管道时需要考虑的几个常见问题。这些问题并非
Kafka
独有，它们
都是与数据集成相关的一般性问题。我们将解释为什么可以使用
Kafka
进行数据集成，以
及它是如何解决这些问题的。我们将讨论
Connect API
与普通的客户端
API
（
Producer
和
Consumer
）之间的区别，以及这些客户端
API
分别适合在什么情况下使用。然后我们会介
绍
Connect
。
Connect
的完整手册不在本章的讨论范围之内，不过我们会举几个例子来帮助
你入门，而且会告诉你可以从哪里了解到更多关于
Connect
的信息。最后介绍其他数据集
成系统，以及如何将它们与
Kafka
集成起来。
7.1
构建数据管道时需要考虑的问题
本书不打算讲解所有有关构建数据管道的细节，我们会着重讨论在集成多个系统时需要考
虑的几个最重要的问题。
7.1.1
及时性
有些系统希望每天一次性地接收大量数据，而有些则希望在数据生成几毫秒之内就能拿到
它们。大部分数据管道介于这两者之间。一个好的数据集成系统能够很好地支持数据管道
的各种及时性需求，而且在业务需求发生变更时，具有不同及时性需求的数据表之间可以
方便地进行迁移。
Kafka
作为一个基于流的数据平台，提供了可靠且可伸缩的数据存储，
可以支持几近实时的数据管道和基于小时的批处理。生产者可以频繁地向
Kafka
写入数
据，也可以按需写入；消费者可以在数据到达的第一时间读取它们，也可以每隔一段时间
读取一次积压的数据。
Kafka
在这里扮演了一个大型缓冲区的角色，降低了生产者和消费者之间的时间敏感度。 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.