Chapter 11: Infrastructure Provisioning
While the demand for data analytics grows, data engineers are becoming an expensive and hard-to-find commodity in the marketplace. On the other hand, organizations that hire data engineers are finding innovative methods to do more with less so that they can justify the high resource costs. In a recent trend, most of these organizations have started to use automated infrastructure provisioning as a means to streamline cloud deployments. Until recently, infrastructure provisioning work has typically been handled by the DevOps group, but not anymore.
In the previous chapter, we talked about the dynamic nature of the data engineer's job profile. The modern data engineer needs to keep up with this latest trend ...
Get Data Engineering with Apache Spark, Delta Lake, and Lakehouse now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
