Learning Apache Apex
by Ananth Gundabattula, Thomas Weise, Munagala V. Ramanath, David Yan, Kenneth Knowles
Containerized infrastructure
Apex works very well on YARN, but at the moment that's also still the only supported option for cluster orchestration and resource management. The complexity of setting up and maintaining YARN clusters is a hurdle for adoption, especially when it becomes a prerequisite for starter stream processing projects and isn't a strategic part of the larger enterprise infrastructure.
The trend toward containerized services and cloud infrastructure management solutions is clear, and big data streaming will be part of it. Apex needs to have a good story for Docker-based deployment, and then, support other cluster managers such as Kubernetes, DC/OS, or Docker Swarm/Enterprise. With Apex internal architecture that cleanly abstracts ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access