Question Asking to Inform Preference Learning: a Case Study

Abstract

The prospect of teaching a computer how to perform a task through demonstration rather than programming has tremendous appeal. However, learning purely from demonstration trace is a difficult challenge. One way to ease the learning problem is to supplement the demonstration with information provided by asking questions of the demonstrator. This paper presents a case study that explores how to instantiate a question asking framework to select questions for a particular type of learner used within learning by demonstration systems, namely a lexographic preference learner. Experimental results show that, generally speaking, judicious question asking can improve learning performance. However, the study makes clear the importance of understanding the value of different types of information to learning and different contexts.