Skip to Content
Kafka权威指南
book

Kafka权威指南

by Neha Narkhede, Gwen Shapira, Todd Palino
January 2018
Beginner to intermediate
234 pages
7h 8m
Chinese
Posts & Telecom Press
Content preview from Kafka权威指南
114
7
构建自己的连接器
任何人都可以基于公开的
Connector API
创建自己的连接器。事实上,人们
创建了各种连接器,然后把它们发布到连接器中心(
Connector Hub
),并告
诉我们怎么使用它们。如果你在连接器中心找不到可以适配你要集成的数据
存储系统的连接器,可以开发自己的连接器。你也可以把自己的连接器贡献
给社区,让更多的人知道和使用它们。关于构建连接器的更多细节已经超
出了本章的讨论范围,不过可以参考官方文档学习如何构建连接器(
http://
docs.confluent.io/3.0.1/connect/devguide.html
)。我们也建议将已有的连接器
作为入门参考,或者从使用
maven archtype
https://github.com/jcustenborder/
kafka-connect-archtype
)开始。另外,可以在
Kafka
的社区邮件组(
users@
kafka.apache.org
)寻求帮助,或者在邮件组里展示自己的连接器。
7.3.4
 深入理解
Connect
要理解
Connect
的工作原理,需要先知道
3
个基本概念,以及它们之间是如何进行交互
的。我们已经在之前的示例里演示了如何运行
worker
进程集群以及如何启动和关闭
连接
。不过我们并没有深入解释
转化器
是如何处理数据的——转换器把
MySQL
的数据行转
JSON
记录,然后由连接器将它们写入
Kafka
现在让我们深入理解每一个组件,以及它们之间是如何进行交互的。
1.
连接器和任务
连接器插件实现了 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

精通機器學習

精通機器學習

Aurélien Géron
精通特征工程

精通特征工程

Alice Zheng, Amanda Casari
高效能PYTHON程式設計

高效能PYTHON程式設計

Micha Gorelick, Ian Ozsvald

Publisher Resources

ISBN: 9787115473271