Assessing and Improving Prediction and Classification: Theory and Algorithms in C++

© Timothy Masters 2018

Timothy MastersAssessing and Improving Prediction and Classificationhttps://doi.org/10.1007/978-1-4842-3336-8_1

1. Assessment of Numeric Predictions

Timothy Masters¹ 

(1)

Ithaca, New York, USA

 

• Notation

• Overview of Performance Measures

• Selection Bias and the Need for Three Datasets

• Cross Validation and Walk-Forward Testing

• Common Performance Measures

• Stratification for Consistency

• Confidence Intervals

• Empirical Quantiles as Confidence Intervals

Most people divide prediction into two families: classification and numeric prediction . In classification, the goal is to assign an unknown case into one of several competing categories (benign versus malignant, tank versus truck versus rock, and so forth). In numeric prediction, the goal is ...