Implementing Data Mesh

Chapter 8. Meshing Your Data Products

Now that you have several data products, let’s discover how we can use them.

Registering your data product is a crucial first step to ensuring its availability and usability within your data ecosystem. This process involves formalizing and publishing your data product so that it can be discovered and used by others. Central to this task are data contracts, which are text files based on the ODCS and ODPS, as we discussed in Chapter 5.

Once the necessary data contracts are built and stored in source control, the DPO assembles the data product and initiates its registration to a data marketplace. This process, often automated through a continuous integration and continuous delivery (CI/CD) pipeline, involves several collaborative steps. Data engineers and architects create initial data contracts based on existing assets, refine them with input from the DPO, and push the finalized contracts to source control. The DPO then compiles these contracts into a complete data product and triggers its registration. This workflow ensures that the data product meets quality standards and is ready for consumption by data users, with thorough documentation and governance in place to support its lifecycle.

Let’s dive into this exciting part of the process!

Registering Your Data Product

Once your data product is ready, you must register it to make it available. Let’s examine how this process works.

Your data product relies on data contracts. All those artifacts ...