Chapter 9: Testing Workflows and Outputs
In the data pipeline that we have created, we have focused on acquiring datasets and extracting some value from them. Therefore, this part of the book will now focus on managing the Alteryx data pipeline created in Chapter 5, Data Processing and Transformations, as well as managing the DataOps process.
This chapter will be applying workflow tests and methods to monitor the data outputs that we created. The following topics will be covered:
- Strategies for adding tests and messages to your workflows
- How to validate your data outputs in the context of a regularly run workflow
- Methods for centralizing your monitoring with Insights
Each method allows you to establish confidence in your datasets and monitor ...
Get Data Engineering with Alteryx now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
