[INTERACT’15] Gaze+touch vs. touch: what’s the trade-off when using gaze to extend touch to remote displays?

An early study I’ve conducted to better understand how gaze and touch compare. The old system made it a bit difficult to compare, but overall got some good indications on user performance. For dragging, gaze+touch is bad, but its quite comparable for scaling and rotation tasks.

gaze mt.jpg
Interaction concept using gaze to point to a distant large screen, coupled with indirect multi touch gestures on a close touchscreen.

Direct touch input is employed on many devices, but it is inherently restricted to displays that are reachable by the user. Gaze input as a mediator can extend touch to remote displays – using gaze for remote selection, and touch for local manipulation – but at what cost and benefit? In this paper, we investigate the potential trade-off with four experiments that empirically compare remote Gaze+touch to standard touch.

Our experiments investigate dragging, rotation, and scaling tasks. Results indicate that Gaze+touch is, compared to touch, (1) equally fast and more accurate for rotation and scaling, (2) slower and less accurate for dragging, and (3) enables selection of smaller targets. Our participants confirm this trend, and are positive about the relaxed finger placement of Gaze+touch. Our experiments provide detailed performance characteristics to consider for the design of Gaze+touch interaction of remote displays. We further discuss insights into strengths and drawbacks in contrast to direct touch.

Gaze+touch vs. touch: what’s the trade-off when using gaze to extend touch to remote displays?
Pfeuffer, K., Alexander, J. and Gellersen, H.  In 15th IFIP TC.13 International Conference on Human-Computer Interaction (INTERACT ’15): 2015. 349-367. videodoi

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s