Data Engineering Best Practices

14

Key Considerations for Data Delivery Best Practices

This chapter will address important data delivery areas for consideration in your solution, such as the following:

• Data streaming
• Publish/subscribe
• Data flows
• Huge volume implications
• Efficient data organization
• Confidential compute

In this chapter, you will be made aware of the data delivery options that need to be considered when you design your solution. We begin with an overview of the topics that will be discussed. The goal of the overview is to level-set you on some effective approaches to deliver curated data as a product to consumers. Later, we will dive into the impacts of the selected delivery method since some consumers require different capabilities than others. Although one ...