Tanay Singhal
ABSTRACT
Mid-air interfaces enable rich 3D interactions and are inherently hygienic, but the technology is not yet ready for real-world public interfaces such as elevators, ATMs, and kiosks – one barrier to their adoption is the limited work on the accessibility of mid-air systems. To this end, we designed an interactive simulation of a contactless elevator simulation with mid-air touch feedback and comprehensive accessibility considerations. Despite being fully contactless, the controls are tactile and closely resemble the mental model of ordinary elevator buttons. Moreover, our demo features 1) mid-air haptics for conveying Braille information, 2) responsive button magnification to assist people with low vision, 3) intuitive gestures for opening or closing doors, and 4) audio feedback. Because many of the ideas and interactions in this demo can apply to other mid-air public interfaces, we hope to inspire more work on improving the accessibility of mid-air interfaces.
Supplemental Material
Available for Download
- AK Al-Ghamdi, SMA Abdelmalek AM Ashshi, H Faidah, H Shukri, and AA Jiman-Fatani. 2011. Bacterial contamination of computer keyboards and mice, elevator buttons and shopping carts. African Journal of Microbiology Research 5, 23 (2011), 3998–4003. https://doi.org/10.5897/AJMR11.770Google Scholar
Cross Ref
- Cynthia Susan Bachofer. 2013. Long-term optical device use by young adults with low vision. Ph.D. Dissertation. Vanderbilt University, Nashville, TN, USA. https://eric.ed.gov/?id=ED554976Google Scholar
- Tom Carter, Sue Ann Seah, Benjamin Long, Bruce Drinkwater, and Sriram Subramanian. 2013. UltraHaptics: Multi-Point Mid-Air Haptic Feedback for Touch Surfaces. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST ’13). Association for Computing Machinery, New York, NY, USA, 505–514. https://doi.org/10.1145/2501988.2502018Google ScholarDigital Library
- Brendan Cassidy, Gilbert Cockton, and Lynne Coventry. 2013. A Haptic ATM Interface to Assist Visually Impaired Users. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (Bellevue, Washington) (ASSETS ’13). Association for Computing Machinery, New York, NY, USA, Article 1, 8 pages. https://doi.org/10.1145/2513383.2513433Google ScholarDigital Library
- Albert Cook and Susan M. Hussey. 2002. Assistive Technologies: Principles and Practice, 2nd edition. Mosby, St. Louis, MO, USA.Google Scholar
- Loic Corenthy, Marcello Giordano, Richard Hayden, Daniel Griffiths, Craig Jeffrey, Hannah Limerick, Orestis Georgiou, Tom Carter, Jörg Müller, and Sriram Subramanian. 2018. Touchless Tactile Displays for Digital Signage: Mid-Air Haptics Meets Large Screens. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems(Montreal QC, Canada) (CHI EA ’18). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3170427.3186533Google ScholarDigital Library
- Iñaki Díaz, Josune Hernantes, Ignacio Mansa, Alberto Lozano, Diego Borro, Jorge Juan Gil, and Emilio Sánchez. 2006. Influence of Multisensory Feedback on Haptic Accessibility Tasks. Virtual Real. 10, 1 (May 2006), 31–40. https://doi.org/10.1007/s10055-006-0028-4Google ScholarDigital Library
- Kyle Harrington, David R. Large, Gary Burnett, and Orestis Georgiou. 2018. Exploring the Use of Mid-Air Ultrasonic Feedback to Enhance Automotive User Interfaces. In Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Toronto, ON, Canada) (AutomotiveUI ’18). Association for Computing Machinery, New York, NY, USA, 11–20. https://doi.org/10.1145/3239060.3239089Google ScholarDigital Library
- Shaun K. Kane, Meredith Ringel Morris, Annuska Z. Perkins, Daniel Wigdor, Richard E. Ladner, and Jacob O. Wobbrock. 2011. Access Overlays: Improving Non-Visual Access to Large Touch Screens for Blind Users. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST ’11). Association for Computing Machinery, New York, NY, USA, 273–282. https://doi.org/10.1145/2047196.2047232Google ScholarDigital Library
- Brian Kappus and Ben Long. 2018. Spatiotemporal modulation for mid-air haptic feedback from an ultrasonic phased array. The Journal of the Acoustical Society of America 143, 3 (2018), 1836–1836. https://doi.org/10.1121/1.5036027Google ScholarCross Ref
- Jin Ryong Kim, Stephanie Chan, Xiangchao Huang, Kenneth Ng, Limin Paul Fu, and Chen Zhao. 2019. Demonstration of Refinity: An Interactive Holographic Signage for New Retail Shopping Experience. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3290607.3313269Google ScholarDigital Library
- Jonathan Lazar, J. Bern Jordan, and Gregg Vanderheiden. 2019. Toward Unified Guidelines for Kiosk Accessibility. Interactions 26, 4 (June 2019), 74–77. https://doi.org/10.1145/3337779Google ScholarDigital Library
- Michael J. McGuffin and Ravin Balakrishnan. 2005. Fitts’ Law and Expanding Targets: Experimental Studies and Designs for User Interfaces. ACM Trans. Comput.-Hum. Interact. 12, 4 (Dec. 2005), 388–422. https://doi.org/10.1145/1121112.1121115Google ScholarDigital Library
- Viktorija Paneva, Sofia Seinfeld, Michael Kraiczi, and Jörg Müller. 2020. HaptiRead: Reading Braille as Mid-Air Haptic Information. In Proceedings of the 2020 ACM Designing Interactive Systems Conference (Eindhoven, Netherlands) (DIS ’20). Association for Computing Machinery, New York, NY, USA, 13–20. https://doi.org/10.1145/3357236.3395515Google ScholarDigital Library
- Tara Parker-Pope. 2020. Can I Get Coronavirus From Riding an Elevator?The New York Times. https://www.nytimes.com/2020/05/13/well/live/can-i-get-coronavirus-from-riding-an-elevator.htmlGoogle Scholar
- Yu-Cheng Pei and Sliman J. Bensmaia. 2014. The neural basis of tactile motion perception. Journal of Neurophysiology 112, 12 (2014), 3023–3032. https://doi.org/10.1152/jn.00391.2014Google ScholarCross Ref
- Frode Eika Sandnes, Tek Beng Tan, Anders Johansen, Edvin Sulic, Eirik Vesterhus, and Eirik Rud Iversen. 2012. Making touch-based kiosks accessible to blind users through simple gestures. Universal Access in the Information Society 11, 4 (2012), 421–431.Google ScholarDigital Library
- Gözel Shakeri, John H. Williamson, and Stephen Brewster. 2018. May the Force Be with You: Ultrasound Haptic Feedback for Mid-Air Gesture Interaction in Cars. In Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Toronto, ON, Canada) (AutomotiveUI ’18). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3239060.3239081Google ScholarDigital Library
- Kristen Shinohara and Jacob O. Wobbrock. 2016. Self-Conscious or Self-Confident? A Diary Study Conceptualizing the Social Accessibility of Assistive Technology. ACM Trans. Access. Comput. 8, 2, Article 5 (Jan. 2016), 31 pages. https://doi.org/10.1145/2827857Google ScholarDigital Library
- Gregg C Vanderheiden. 2002. Touch screen for the vision-impaired. US Patent 6,384,743.Google Scholar
Index Terms
- Elevating Haptics: An Accessible and Contactless Elevator Concept with Tactile Mid-Air Controls
Index terms have been assigned to the content through auto-classification.
Recommendations
Exploring the Use of Mid-Air Ultrasonic Feedback to Enhance Automotive User Interfaces
AutomotiveUI '18: Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular ApplicationsEmploying a 2x2 within-subjects design, forty-eight experienced drivers (28 male, 20 female) undertook repeated button selection and 'slider-bar' manipulation tasks, to compare a traditional touchscreen with a virtual mid-air gesture interface in a ...
Using Mid-Air Haptics to Guide Mid-Air Interactions
Human-Computer Interaction – INTERACT 2023AbstractWhen users interact with mid-air gesture-based interfaces, it is not always clear what interactions are available, or how they might be executed. Mid-air interfaces offer no tactile affordances, pushing systems to rely on other modalities (e.g. ...
Mid-Air Haptics for Control Interfaces
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing SystemsControl interfaces and interactions based on touch-less gesture tracking devices have become a prevalent research topic in both industry and academia. Touch-less devices offer a unique interaction immediateness that makes them ideal for applications ...
Comments