18. Exploring deployment constraints: Understanding the ecosystem
This chapter covers
- Learning key concepts behind deploying big data applications
- Learning the roles of resource and cluster managers
- Sharing data and files with Spark’s workers
- Securing both network communication and disk I/O
In this last chapter of the book, you will explore the key concepts required to grasp the infrastructure constraints of deploying a big data application. This chapter explores the constraints of deployment, not the deployment process itself or installing Apache Spark in a production environment. That essential information is covered in chapters 5 and 6, as well as appendix K.
Apache Spark lives in an ecosystem, where it shares resources, data, security, ...
Get Spark in Action, Second Edition now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
