November 2022
Beginner to intermediate
346 pages
11h
Chinese
Content preview from Kafka权威指南（第2版）
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
构建数据管道
｜
153
Kafka
支持加密传输数据，从数据源到
Kafka
，再从
Kafka
到数据池。它还支持身份验证
（通过
SASL
来实现）和授权
，所以你可以确信，如果一个主题包含了敏感信息，那么在
不经授权的情况下，数据不会流到不安全的系统中。
Kafka
还
提供了审计日志来跟踪未经
授权的访问。通过编写额外的代码，还可能跟踪到每条消息来自哪里以及谁修改了消息，
从而可以对每条消息进行溯源。
第
11
章将详细讨论
Kafka
的安全性
。
Connect
及其连接器需要在身份验证之后连接到外部
数据系统，因此连接器的配置信息当中需要包含身份验证凭证。
不建议将凭证保存在配置文件中，因为如果这样就不得不格外小心地保护好这些文件。一
种常见的解决方案是使用外部密钥管理系统，比如
HashiCorp
Vault
。
Connect
支持外部密
钥配置。
Kafka
只
提供了允许接入外部可插拔配置提供程序的框架和一个从文件中读取
配置的提供程序示例。
Kafka
社
区开发了很多外部配置提供程序，可以与
Vault
、
AWS
和
Azure
集成。
9.1.7
故障处理
不能总是假设数据是完美的，而是要事先做好应对故障的准备。我们能否总是把缺损的数
据挡在数据管道之外？我们能否恢复无法解析的记录？我们能否修复（或许由人工手动修
复）并重新处理缺损的数据？如果在若干天之后才发现原先看起来正常的数据其实是缺损
数据，该怎么办？
因为
Kafka
可以长时间保留数据
，所以如果有必要，那么可以在适当的时候回过头来重新
处理出错的数据。如果目标系统错过了一些消息，那么可以重放保存在 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.