© Andreas François Vermeulen 2018
Andreas François VermeulenPractical Data Sciencehttps://doi.org/10.1007/978-1-4842-3054-1_6

6. Three Management Layers

Andreas François Vermeulen1 
(1)
West Kilbride North Ayrshire, UK
 

This chapter is about the three management layers that are must-haves for any large-scale data science system. I will discuss them at a basic level. I suggest you scale-out these management capabilities, as your environment grows.

Operational Management Layer

The operational management layer is the core store for the data science ecosystem’s complete processing capability. The layer stores every processing schedule and workflow for the all-inclusive ecosystem.

This area enables you to see a singular view of the entire ecosystem. It reports ...

Get Practical Data Science: A Guide to Building the Technology Stack for Turning Data Lakes into Business Assets now with the O’Reilly learning platform.

O’Reilly members experience live online training, plus books, videos, and digital content from nearly 200 publishers.