Conformal Prediction for Reliable Machine Learning

Chapter 3

Active Learning

Vineeth N. Balasubramanian^a, Shayok Chakraborty^b, Shen-Shyang Ho^c, Harry Wechsler^d and Sethuraman Panchanathan^b,    ^aDepartment of Computer Science and Engineering, Indian Institute of Technology, Hyderabad, India,    ^bCenter for Cognitive Ubiquitous Computing, Arizona State University, AZ, USA,    ^cSchool of Computer Engineering, Nanyang Technological University, Singapore,    ^dDepartment of Computer Science, George Mason University, VA, USA

Abstract

In this chapter, we describe how the p-values derived from the conformal predictions framework can be used for active learning; that is, to select the informative examples from a data collection that can be used to train a classifier for best performance. We show the connection ...