IEEE Project Abstract

Identifying and localizing the user’s visual attention can enable various of intelligent service computing paradigms in mobile environment. However, existing solutions can only compute the gaze direction, but without the distance to the intended target. In addition, most of them rely on eye tracker or similar infrastructure support. This paper explores the possibility of using portal mobile devices, e.g.,smartphone, to detect the visual attention of a user. i-VALS only requires user to do one simple action to localize the intended object: gazing at the intended object and holding up the smartphone so that the object as well as the user’s face can be simultaneously captured by the front and rear cameras.We develop efficient algorithms to obtain both the distance between the camera and user, the user’s gaze direction, and the object’s direction from the camera. The object’s location can then be computed by solving a trigonometric problem. i-VALS has been proto typed on commercial off-the-shelf (COTS) devices. Extensive experiment results show that i-VALS achieves high accuracy as well as small latency, effectively supporting a large variety of applications in smart environments.