Chapter 7
Compare Models and Score New
Data
About the Tasks That You Will Perform . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
Compare Models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
Score New Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
Create a Sorted List of Potential Donors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
About the Tasks That You Will Perform
Now that you have five candidate models to use to predict the best target individuals for
your mail solicitation, you can compare them to determine a champion model that you
will use to score new data. You perform the following tasks in order to determine which
of the individuals in your organization's database to solicit:
1. You compare models and select a champion model that, according to an evaluation
criterion, performs best in the validation data.
2. You create a new data source for a data set that contains scoring data that has not
been used to build any of the models thus far in the process flow and that does not
include values of the target variable. You score this data using the champion model.
3. You write SAS code to output, based on the scored data, a list of the top potential
donors according to the probability of donating and the profitability matrix that you
defined in “Create a Data Source” on page 11.
Compare Models
To use the Model Comparison node to compare the models that you have built in this
example and to select one as the champion model:
1. Select the Utility tab on the Toolbar.
2. Select the Control Point node icon. Drag the node into the Diagram Workspace.
3. Connect all five model nodes to the Control Point node.
41
T I P Control Point nodes enable you to better organize your process flow diagram.
These nodes do not perform calculations; they simply pass data from preceding
nodes to subsequent nodes.
4. Select the Assess tab on the Toolbar.
5. Select the Model Comparison node icon. Drag the node into the Diagram
Workspace.
6. Connect the Control Point node to the Model Comparison node.
7. In the Diagram Workspace, right-click the Model Comparison node, and select Run
from the resulting menu. Click Yes in the Confirmation window that opens.
8. In the window that appears when processing completes, click Results. The Results
window appears.
9. In the Fit Statistics window, notice that the regression model was selected as the
champion model. The champion model has the value Y in the Selected Model
column in the
Fit Statistics window.
In the model selection node, SAS Enterprise Miner selects the champion model
based on the value of a single statistic. You can specify which statistic to use for
selection in the node Properties Panel. Because you did not change the value of this
property, the default statistic was used, which (because a profit matrix is defined) is
the average profit in the validation data.
42 Chapter 7 Compare Models and Score New Data

Get Getting Started with SAS Enterprise Miner 14.1 now with the O’Reilly learning platform.

O’Reilly members experience live online training, plus books, videos, and digital content from nearly 200 publishers.