May 2021
Beginner to intermediate
380 pages
7h 48m
Korean
Content preview from 이벤트 기반 마이크로서비스 구축
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
142
이벤트 기반 마이크로서비스 구축
6.4.1
병렬 처리 시 워터마크
워터마크는 여러 독립적인 컨슈머 인스턴스 간의 이벤트 시간을 조정하는 유용한 수단입니다.
[그림
6
-
4
]는 두 컨슈머 인스턴스의 처리 토폴로지를 나타낸 것입니다. 각 컨슈머 인스턴스는
자신에게 할당된 파티션에서 이벤트를 가져와
groupByKey
함수와
aggregate
함수를 차례로
적용합니다. 이 때 키가 같은 이벤트는 모두 동일한 다운스트림
aggregate
인스턴스로 보내는
셔플
shuffle
(뒤섞기) 작업이 필요합니다. 여기서는 키가 같은 이벤트를 모두 같은 파티션에 두기
위해 인스턴스
0
과 인스턴스
1
의 이벤트를 각각 키별로 상대방에게 보냅니다.
태스크 인스턴스
0
(키, 타임스탬프)
(키, 타임스탬프)
셔플된 이벤트
노드
이벤트 시간
태스크 인스턴스
1
소비-
0
소비-
1
#1
토폴로지에서 일정 주기
마다 전파된 워터마크
#3
이벤트 다음에 전파된
워터마크
#2
노드 각각의 입력에서 마지
막으로 찍힌 워터마크
그림
6-4
여러 처리기로 구성된 토폴로지의 노드 간 워터마크 전파
[그림
6
-
4
] 다이어그램은 설명할 내용이 많아 하나씩 자세히 살펴보겠습니다.
워터마크는 소스 함수에서 생성되며 여기서 이벤트를 이벤트 스트림 파티션에서 소비합니다.
컨슈머 노드에서 계속 증가하는 이벤트 시간을 워터마크에 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.