Timezone: »

 
Poster
Understanding the Role of Adaptivity in Machine Teaching: The Case of Version Space Learners
Yuxin Chen · Adish Singla · Oisin Mac Aodha · Pietro Perona · Yisong Yue

Thu Dec 06 02:00 PM -- 04:00 PM (PST) @ Room 517 AB #128
in Thu Poster Session B »

In real-world applications of education, an effective teacher adaptively chooses the next example to teach based on the learner’s current state. However, most existing work in algorithmic machine teaching focuses on the batch setting, where adaptivity plays no role. In this paper, we study the case of teaching consistent, version space learners in an interactive setting. At any time step, the teacher provides an example, the learner performs an update, and the teacher observes the learner’s new state. We highlight that adaptivity does not speed up the teaching process when considering existing models of version space learners, such as the “worst-case” model (the learner picks the next hypothesis randomly from the version space) and the “preference-based” model (the learner picks hypothesis according to some global preference). Inspired by human teaching, we propose a new model where the learner picks hypotheses according to some local preference defined by the current hypothesis. We show that our model exhibits several desirable properties, e.g., adaptivity plays a key role, and the learner’s transitions over hypotheses are smooth/interpretable. We develop adaptive teaching algorithms, and demonstrate our results via simulation and user studies.

Keywords: Active Learning · Human or Animal Learning
[ Paper] 

Author Information

Yuxin Chen (Caltech)
Adish Singla (MPI-SWS)
Oisin Mac Aodha (California Institute of Technology)
Pietro Perona (California Institute of Technology)
Yisong Yue (Caltech)

More from the Same Authors