Data Observability for Data Engineering

4

Data Observability Elements

In the previous chapter, we covered the methods that can be used to collect observability metrics in the context of a data application. We will now focus on the observations themselves. What do you need to collect to keep the data application under control?

In the general observability paradigm, which involves collecting data, the application, and the application’s infrastructure, as described in Chapter 2, Fundamentals of Data Observability, we saw that observability metrics can be gathered from diverse sources. In Chapter 3, Data Observability Techniques, we learned how to extract information directly from data applications. In this chapter, we will focus on which metrics can be collected from the data application ...