Data Engineering on Azure

10 Compliance

This chapter covers

• Compliance for a data platform
• Data classification and handling
• Designing a compliant access model
• Supporting GDPR requirements

Data platforms, by definition, deal with data. While some types of data are harmless, other types carry liability. In this chapter, we will talk about compliance and data handling. First, we’ll see some examples of data classification and data handling standards. Depending on the nature of the data we process, we will see where we can store it, who can access it, what we can do with it, how long can we keep it, and so on. We will also look at some techniques we can use to change the type of the data. This includes anonymization and pseudonymization of personably identifiable information, ...