TR#500: Attentional Objects for Visual Context Understanding

Bernt Schiele and Alex Pentland

Submitted to: ISWC'99

This paper exploits wearable computers' unique opportunity to record and index the visual environment of the user from the ``first-person'' perspective. We propose to use a hat-mounted wearable camera to record what the user sees during the day with a wearable computer. This camera can be used to make the computer more contextually aware of the user and their actions. Furthermore, the camera can be used to record, analyze and index the visual environment of the user. By keeping track of the actions of the user upon and within the environment the system can be more aware of the interactions of the user within the environment. An important aspect of the system is to automatically extract objects of user interest, and their motion within the environment and relative to the user.