Building Solutions with the Microsoft Power Platform

Chapter 11. Using AI Builder Models

In Chapter 8, we learned about models in AI Builder and the different kinds of models available to us. We also created our own form processing model, which extracted key information from invoices. In this chapter, we’re going to build on that model by creating solutions in Power Apps and Power Automate that leverage it. First, we’ll look at how we can use the form processor to analyze a PDF using Power Apps. After that, we will see how we can use the model in a cloud flow to extract text from files and update their SharePoint metadata to allow us to use filters to find the files that we’re looking for, rather than simply relying on filenames and naming conventions.

Integrating AI Builder and Power Apps

It’s time to build a canvas app that makes use of the work we did with AI Builder back in Chapter 8. Since this is a follow-up to the work we did in previous chapters, we won’t walk through the basics of setting up a canvas app. Instead, I’ll assume that you are comfortable creating canvas apps, but refer to Chapter 3 if you need a refresher.

Before we dive right in, let’s describe what it is that we plan to create. We’re going to be creating an app that allows us to analyze a file from our devices. After we select the file and the form processor analyzes the file, we will fill in a form with some of the data that the form processor extracts. We’re also going to display each value’s confidence score right next to the values. The idea is to see ...