Linda Di Geronimo
ABSTRACT
The number of smart devices that people own or share with family and friends has increased dramatically. As a result, users often want to copy data among devices such as smart-phones, tablets and desktop computers. While various chat and cloud services support the sharing of data, they require users to interrupt their workflow to copy resources. We present MyoShare, a system that allows content to be shared among devices using mid-air gestures that can be used at any time, independent of the current task and location of devices. We report on an elicitation study where participants designed a set of gestures for sharing content. In a second user study, we compared mid-air gestures with alternative interaction modes using keyboard or touch Shortcuts, Speech, and Menu Selection. We discuss the results of the study in terms of both the strengths and weaknesses of mid-air gestures, along with suggestions for future work.
- Md Tanvir Islam Aumi, Sidhant Gupta, Mayank Goel, Eric Larson, and Shwetak Patel. 2013. DopLink: using the doppler effect for multi-device interaction. In Procedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '13). ACM, New York, NY, USA, 583--586. Google Scholar
Digital Library
- Sriram Karthik Badam and Niklas Elmqvist. 2014. PolyChrome: A cross-device framework for collaborative web visualization. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '14). ACM, New York, NY, USA, 109--118. Google ScholarDigital Library
- Ke-Yu Chen, Daniel Ashbrook, Mayank Goel, Sung-Hyuck Lee, and Shwetak Patel. 2014a. AirLink: sharing files between multiple devices using in-air gestures. In Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '14). ACM, New York, NY, USA, 565--569. Google ScholarDigital Library
- Xiang'Anthony' Chen, Tovi Grossman, Daniel J. Wigdor, and George Fitzmaurice. 2014b. Duet: exploring joint interactions on a smart phone and a smart watch. In Proceedings of the SIGCHI International Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 159--168. Google ScholarDigital Library
- Linda Di Geronimo, Maria Husmann, and Moira C. Norrie. 2015. Surveying Personal Device Ecosystems with Cross-Device Applications in Mind. In Proceedings of the ACM International Symposium on Pervasive Displays (PerDis '16). ACM, New York, NY, USA, 199--206. Google ScholarDigital Library
- Facebook for Business. 2014. Finding Simplicity in a Multi-device World. (2014). Retrieved September 18, 2016 from https://www.facebook.com/business/news/Finding-simplicity-in-a-multi-device-world.Google Scholar
- Euan Freeman, Stephen Brewster, and Vuokko Lantz. 2016. Do That, There: An Interaction Technique for Addressing In-Air Gesture Systems. In Proceedings of the ACM International Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA. Google ScholarDigital Library
- Mayank Goel, Brendan Lee, Md Tanvir Islam Aumi, Shwetak Patel, Gaetano Borriello, Stacie Hibino, and Bo Begole. 2014. SurfaceLink: using inertial and acoustic sensing to enable multi-device interaction on a surface. In Proceedings of the SIGCHI International Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 1387--1396. Google ScholarDigital Library
- Google. 2016. Project Soli. (2016). Retrieved September 18, 2016 from https://atap.google.com/soli/.Google Scholar
- Peter Hamilton and Daniel J. Wigdor. 2014. Conductor: enabling and understanding cross-device interaction. In Proceedings of the SIGCHI International Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 2773--2782. Google ScholarDigital Library
- Faizan Haque, Mathieu Nancel, and Daniel Vogel. 2015. Myopoint: Pointing and clicking using forearm mounted electromyography and inertial motion sensors. In Proceedings of the SIGCHI International Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 3653--3656. Google ScholarDigital Library
- Juan David Hincapié-Ramos, Xiang Guo, Paymahn Moghadasian, and Pourang Irani. 2014. Consumed endurance: a metric to quantify arm fatigue of mid-air interactions. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems (CHI '14). ACM, New York, NY, USA, 1063--1072. Google ScholarDigital Library
- Maria Karam and others. 2005. A taxonomy of gestures in human computer interactions. Technical report, Electronics and Computer Science (2005).Google Scholar
- Yoon Sang Kim, Byung Seok Soh, and Sang-Goog Lee. 2005. A new wearable input device: SCURRY. IEEE Transactions on Industrial Electronics 52, 6 (Dec 2005), 1490--1499.Google ScholarCross Ref
- Christian Kray, Daniel Nesbitt, John Dawson, and Michael Rohs. 2010. User-defined gestures for connecting mobile phones, public displays, and tabletops. In Proceedings of the ACM International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '10). ACM, New York, NY, USA, 239--248. Google ScholarDigital Library
- Takuro Kuribara, Buntarou Shizuki, and Jiro Tanaka. 2015. HoverLink: Joint Interactions using Hover Sensing Capability. In Proceedings of the SIGCHI International Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). ACM, New York, NY, USA, 1651--1656. Google ScholarDigital Library
- Andrés Lucero, Jussi Holopainen, and Tero Jokela. 2011. Pass-them-around: collaborative use of mobile phones for photo sharing. In Proceedings of the ACM International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '15). ACM, New York, NY, USA, 1787--1796. Google ScholarDigital Library
- Nicolai Marquardt, Till Ballendat, Sebastian Boring, Saul Greenberg, and Ken Hinckley. 2012a. Gradual engagement: facilitating information exchange between digital devices as a function of proximity. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '12). ACM, New York, NY, USA, 31--40. Google ScholarDigital Library
- Nicolai Marquardt, Ken Hinckley, and Saul Greenberg. 2012b. Cross-device interaction via micro-mobility and f-formations. In Proceedings of the ACM International Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 13--22. Google ScholarDigital Library
- Meredith Ringel Morris. 2012. Web on the wall: insights from a multimodal interaction elicitation study. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '12). ACM, New York, NY, USA, 95--104. Google ScholarDigital Library
- Miguel A Nacenta, Yemliha Kamber, Yizhou Qiang, and P. Kristensson. 2013. Memorability of pre-designed and user-defined gesture sets. In Proceedings of the SIGCHI International Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 1099--1108. Google ScholarDigital Library
- Michael Nebeling, Alexander Huber, David Ott, and Moira C. Norrie. 2014. Web on the Wall Reloaded: Implementation, Replication and Refinement of User-Defined Interaction Sets. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '14). ACM, New York, NY, USA, 15--24. Google ScholarDigital Library
- Michael Nielsen, Moritz Störring, Thomas B Moeslund, and Erik Granum. 2003. A procedure for developing intuitive and ergonomic gesture interfaces for HCI. In International Workshop on Gesture-Based Communication in Human-Computer Interaction. Springer, Berlin, Heidelberg, 409--420.Google Scholar
- Kristian Nymoen, Mari Romarheim Haugen, and Alexander Refsum Jensenius. 2015. Mumyo-Evaluating and Exploring the MYO Armband for Musical Interaction. In Proceedings of the International Conference on New Interfaces For Musical Expression. Louisiana State University. Google ScholarDigital Library
- Jerome Pasquero, Scott J. Stobbe, and Noel Stonehouse. 2011. A haptic wristwatch for eyes-free interactions. In Proceedings of the SIGCHI International Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 3257--3266. Google ScholarDigital Library
- Prajwal Paudyal, Ayan Banerjee, and Sandeep KS Gupta. 2016. SCEPTRE: a Pervasive, Non-Invasive, and Programmable Gesture Recognition Technology. In Proceedings of the ACM International Conference on Intelligent User Interfaces (IUI '16). ACM, New York, NY, USA, 282--293. Google ScholarDigital Library
- Roman Rädle, Hans-Christian Jetter, Mario Schreiner, Zhihao Lu, Harald Reiterer, and Yvonne Rogers. 2015. Spatially-aware or spatially-agnostic?: Elicitation and evaluation of user-defined cross-device interactions. In Proceedings of the SIGCHI International Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 3913--3922. Google ScholarDigital Library
- Jun Rekimoto. 2001. Gesturewrist and gesturepad: Unobtrusive wearable interaction devices. In Procedings of the IEEE Symposium on Wearable Computers (ISWC '01). IEEE, 21--27. Google ScholarDigital Library
- Julie Rico and Stephen Brewster. 2010. Usable gestures for mobile interfaces: evaluating social acceptability. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 887--896. Google ScholarDigital Library
- Stephanie Santosa and Daniel Wigdor. 2013. A field study of multi-device workflows in distributed workspaces. In Procedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '13). ACM, New York, NY, USA, 63--72. Google ScholarDigital Library
- T. Scott Saponas, Desney S. Tan, Dan Morris, Ravin Balakrishnan, Jim Turner, and James A. Landay. 2009. Enabling always-available input with muscle-computer interfaces. In Proceedings of the ACM International Symposium on User Interface Software and Technology (UIST '09). ACM, New York, NY, USA, 167--176. Google ScholarDigital Library
- Teddy Seyed, Chris Burns, Mario Costa Sousa, Frank Maurer, and Anthony Tang. 2012. Eliciting usable gestures for multi-display environments. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '12). ACM, New York, NY, USA, 41--50. Google ScholarDigital Library
- Martin Weigel, Vikram Mehta, and Jürgen Steimle. 2014. More than touch: understanding how people use skin as an input surface for mobile computing. In Proceedings of the SIGCHI International Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 179--188. Google ScholarDigital Library
- Mark Weiser. 1991. The computer for the 21st century. Scientific american 265 (1991), 94--104.Google Scholar
- Jacob O Wobbrock, Meredith Ringel Morris, and Andrew D Wilson. 2009. User-defined gestures for surface computing. In Proceedings of the SIGCHI International Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 1083--1092. Google ScholarDigital Library
- Koji Yatani, Koiti Tamura, Keiichi Hiroki, Masanori Sugimoto, and Hiromichi Hashizume. 2005. Toss-it: intuitive information transfer techniques for mobile devices. In Proceedings of the SIGCHI International Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). ACM, New York, NY, USA, 1881--1884. Google ScholarDigital Library
Index Terms
- Exploiting mid-air gestures to share data among devices
Recommendations
Eliciting Mid-Air Gestures for Wall-Display Interaction
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer InteractionFreehand mid-air gestures are a promising input method for interacting with wall displays. However, work on mid-air gestures for wall-display interaction has mainly explored what is technically possible, which might not result in gestures that users ...
Pen + Mid-Air: An Exploration of Mid-Air Gestures to Complement Pen Input on Tablets
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer InteractionIn this paper, we report on a series of studies, exploring the potential of pen and mid-air input on tablets. We describe a field study with an early prototype of a drawing application and follow-up inquiries, such as the development and comparison of ...
Investigating mid-air gestures and handhelds in motion tracked environments
PerDis '16: Proceedings of the 5th ACM International Symposium on Pervasive DisplaysSmart spaces with multiple interactive devices and motion tracking capabilities are becoming more common. However, there is little research on how interaction with one device affects the usage of other devices in the space. We investigate the effects of ...
Comments