Skip to content

Cuenesics: Using Mid-Air Gestures to Select Items on Interactive Public Displays

Author: Walter, R., Valkanova, N., Bailly, G., & Müller, J.
Published in: ACM MobileHCI '14
Year: 2014
Type: Academic articles

Most of todays public displays only show predefined content and do not allow users to change it. We argue that interactive public displays would benefit from immediately usable mid-air techniques for choosing options, expressing opinions or more generally selecting one among several items. We propose a design space for hand-gesture based mid-air selection techniques on interactive public displays, along with four specific techniques that we evaluated at three different locations in the the field. Our findings include: 1) if no hint is provided, people successfully use Point+Dwell for selecting items, 2) the user representation could be switched from Mirror to Cursor after registration without causing confusion, 3) people tend to explore items before confirming one, 4) in a public context, people frequently interact inadvertently (without looking at the screen). We conclude by providing recommendations for designers of interactive public displays to support immediate usability for mid-air selection.

Download Publication


Connected HIIG researchers

Jörg Müller, Prof. Dr.

Former Associate Researcher

    Explore current HIIG Activities

    Research issues in focus

    HIIG is currently working on exciting topics. Learn more about our interdisciplinary pioneering work in public discourse.