Abstract:

The goal of this work is to classify the focus of attention of a subject who is switching his or her attention between a number of surrounding objects. The specific application is to classify the focus of attention of a car driver as straight-ahead, towards the rear-view mirror, towards the dashboard etc. An explicit quantitative approach to this problem requires (a) a priori information about the interior geometry of the car and the calibration of the camera, and (b) accurate computation of the subject\'s location and eye direction. This paper describes a qualitative approach. The subject is observed over an extended period of time, and a \"pose-space histogram\" is used to record the frequency with which particular head poses occur. For observation of a car driver, peaks will appear in the histogram corresponding to the most frequently viewed directions--straight-ahead and toward the mirrors. Each peak is labelled, and the head pose of the driver in all subsequent images is then classified by use of the histogram. The head pose classification is refined by a qualitative measurement of the eye pose.