Grab 'n' Drop: User Configurable Toolglasses

James R Eagan (1)

1 LTCI - Laboratoire Traitement et Communication de l'Information

We introduce the grab 'n' drop toolglass, an extension of the toolglass bi-manual interaction technique. It enables users to create and configure their own toolglasses from existing user interfaces that were not designed for toolglasses. Users compose their own toolglass interactions at runtime from an application's user interface elements, bringing interaction closer to the objects of interest in a workspace. Through a proof-of-concept implementation for Mac OS X, we show how grab 'n' drop capabilities could be added to existing applications at the toolkit level, without modifying application source code or UI design. Finally, we evaluate the power and flexibility of this approach by applying it to a variety of applications. We further identify limitations and risks associated with this approach and propose changes to existing toolkits to foster such user-reconfigurable interaction.

Mots clés: polymorphism; user interfaces; toolglasses; instrumental interaction

Domaines: Interface homme-machine [cs.HC]

James R Eagan. Grab 'n' Drop: User Configurable Toolglasses. 16th IFIP Conference on Human-Computer Interaction (INTERACT), Sep 2017, Mumbai, India. pp.315-334, ⟨10.1007/978-3-319-67687-6_21⟩. ⟨hal-01693001⟩