Sven Mayer
Lars Lischke
Paweł W. Woźniak
Niels Henze
ABSTRACT
While the proliferation of mobile devices has rendered mobile notifications ubiquitous, researchers are only slowly beginning to understand how these technologies affect everyday social interactions. In particular, the negative social influence of mobile interruptions remains unexplored from a methodological perspective. This paper contributes a mixed-method evaluation procedure for assessing the disruptive impact of mobile interruptions in conversation. The approach combines quantitative eye tracking, qualitative analysis, and a simulated conversation environment to enable fast assessment of disruptiveness. It is intended to be used as a part of an iterative interaction design process. We describe our approach in detail, present an example of its use to study a new call declining technique, and reflect upon the pros and cons of our approach.
Supplemental Material
- Roman Bednarik, Shahram Eivazi, and Michal Hradis. 2012. Gaze and Conversational Engagement in Multiparty Video Conversation: An Annotation Scheme and Classification of High and Low Levels of Engagement. In Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction (Gaze-In '12). ACM, New York, NY, USA, Article 10, 6 pages. Google Scholar
Digital Library
- Sven Bertel, Thomas Dressel, Tom Kohlberg, and Vanessa von Jan. 2017. Spatial Knowledge Acquired from Pedestrian Urban Navigation Systems. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '17). ACM, New York, NY, USA, Article 32, 6 pages. Google ScholarDigital Library
- Peter Bogunovich and Dario Salvucci. 2011. The Effects of Time Constraints on User Behavior for Deferrable Interruptions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 3123--3126. Google ScholarDigital Library
- Jelmer P. Borst, Niels A. Taatgen, and Hedderik van Rijn. 2015. What Makes Interruptions Disruptive?: A Process-Model Account of the Effects of the Problem State Bottleneck on Task Interruption and Resumption. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2971--2980. Google ScholarDigital Library
- LouAnne E. Boyd, Alejandro Rangel, Helen Tomimbang, Andrea Conejo-Toledo, Kanika Patel, Monica Tentori, and Gillian R. Hayes. 2016. SayWAT: Augmenting Face-to-Face Conversations for Adults with Autism. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 4872--4883. Google ScholarDigital Library
- Barry Brown, Moira McGregor, and Donald McMillan. 2015. Searchable Objects: Search in Everyday Conversation. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15). ACM, New York, NY, USA, 508--517. Google ScholarDigital Library
- Debaleena Chattopadhyay, Kenton O'Hara, Sean Rintel, and Roman Rädle. 2016. Office Social: Presentation Interactivity for Nearby Devices. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2487--2491. Google ScholarDigital Library
- Daniel Chen and Roel Vertegaal. 2004. Using Mental Load for Managing Interruptions in Physiologically Attentive User Interfaces. In CHI '04 Extended Abstracts on Human Factors in Computing Systems (CHI EA '04). ACM, New York, NY, USA, 1513--1516. Google ScholarDigital Library
- Jay Chen and Azza Abouzied. 2016. One LED is Enough: Catalyzing Face-to-face Interactions at Conferences with a Gentle Nudge. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 172--183. Google ScholarDigital Library
- Laura Dabbish and Robert E. Kraut. 2004. Controlling Interruptions: Awareness Displays and Social Motivation for Coordination. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW '04). ACM, New York, NY, USA, 182--191. Google ScholarDigital Library
- Anind K. Dey, Katarzyna Wac, Denzil Ferreira, Kevin Tassini, Jin-Hyuk Hong, and Julian Ramos. 2011. Getting Closer: An Empirical Investigation of the Proximity of User to Their Smart Phones. In Proceedings of the 13th International Conference on Ubiquitous Computing (UbiComp '11). ACM, New York, NY, USA, 163--172. Google ScholarDigital Library
- Mica R. Endsley and Debra G. Jones. 2001. Disruptions, Interruptions and Information Attack: Impact on Situation Awareness and Decision Making. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 45, 2 (2001), 63--67.Google Scholar
- Cambridge ESOL. 2008. Speaking Test Preparation Pack for CAE Paperback with DVD. Cambridge University Press.Google Scholar
- Marc Exposito, Vicky Zeamer, and Pattie Maes. 2017. Unobtrusive Note Taking: Enriching Digital Interpersonal Interactions Using Gestures. In Companion of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17 Companion). ACM, New York, NY, USA, 167--170. Google ScholarDigital Library
- Joel E. Fischer, Stuart Reeves, Stuart Moran, Chris Greenhalgh, Steve Benford, and Stefan Rennick-Egglestone. 2013. Understanding Mobile Notification Management in Collocated Groups. In Proceedings of the 13th European Conference on Computer Supported Cooperative Work (ECSCW 2013). Springer London, London, 21--44.Google ScholarCross Ref
- Morten Fjeld, Paweł Wo´ zniak, Josh Cowls, and Bonnie Nardi. 2015. Ad hoc encounters with big data: Engaging citizens in conversations around tabletops. First Monday 20, 2 (2015).Google Scholar
- Charles Goodwin. 1980. Restarts, Pauses, and the Achievement of a State of Mutual Gaze at Turn-Beginning. Sociological Inquiry 50, 3--4 (1980), 272--302.Google ScholarCross Ref
- Nanna Gorm and Irina Shklovski. 2017. Participant Driven Photo Elicitation for Understanding Activity Tracking: Benefits and Limitations. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 1350--1361. Google ScholarDigital Library
- Nitesh Goyal and Susan R. Fussell. 2016. Effects of Sensemaking Translucence on Distributed Collaborative Analysis. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 288--302. Google ScholarDigital Library
- Nitesh Goyal and Susan R. Fussell. 2017. Intelligent Interruption Management using Galvanic Skin Response based Physiological Sensor for Collaborative Sensemaking. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3 (Sept. 2017). Google ScholarDigital Library
- Nitesh Goyal, Gilly Leshed, Dan Cosley, and Susan R. Fussell. 2014. Effects of Implicit Sharing in Collaborative Analysis. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 129--138. Google ScholarDigital Library
- Jonathan Grudin. 2017. From Tool to Partner: The Evolution of Human-Computer Interaction. Synthesis Lectures on Human-Centered Interaction 10, 1 (2017), i--183. Google ScholarCross Ref
- Gunnar Harboe and Elaine M. Huang. 2015. Real-World Affinity Diagramming Practices: Bridging the Paper-Digital Gap. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 95--104. Google ScholarDigital Library
- Helen M. Hodgetts and Dylan M. Jones. 2003. Interruptions in the Tower of London Task: Can Preparation Minimise Disruption? Proceedings of the Human Factors and Ergonomics Society Annual Meeting 47, 8 (2003), 1000--1004.Google Scholar
- Scott E. Hudson and Ian Smith. 1996. Techniques for Addressing Fundamental Privacy and Disruption Tradeoffs in Awareness Support Systems. In Proceedings of the 1996 ACM Conference on Computer Supported Cooperative Work (CSCW '96). ACM, New York, NY, USA, 248--257. Google ScholarDigital Library
- Shamsi T. Iqbal and Eric Horvitz. 2010. Notifications and Awareness: A Field Study of Alert Usage and Preferences. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (CSCW '10). ACM, New York, NY, USA, 27--30. Google ScholarDigital Library
- Pradthana Jarusriboonchai, Sus Lundgren, Thomas Olsson, Joel Fischer, Nemanja Memarovic, Stuart Reeves, Paweł Wo´ zniak, and Olof Torgersson. 2014. Personal or Social?: Designing Mobile Interactions for Co-located Interaction. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI '14). ACM, New York, NY, USA, 829--832. Google ScholarDigital Library
- Pradthana Jarusriboonchai, Aris Malapaschas, and Thomas Olsson. 2016a. Design and Evaluation of a Multi-Player Mobile Game for Icebreaking Activity. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 4366--4377. Google ScholarDigital Library
- Pradthana Jarusriboonchai, Aris Malapaschas, Thomas Olsson, and Kaisa Väänänen. 2016b. Increasing Collocated People's Awareness of the Mobile User's Activities: A Field Trial of Social Displays. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 1691--1702. Google ScholarDigital Library
- Kristiina Jokinen, Hirohisa Furukawa, Masafumi Nishida, and Seiichi Yamamoto. 2013. Gaze and Turn-taking Behavior in Casual Conversational Interactions. ACM Trans. Interact. Intell. Syst. 3, 2, Article 12 (Aug. 2013), 30 pages. Google ScholarDigital Library
- Arvid Karsvall. 2011. Intercreativity in Surgical Practice : A Dialogical Approach to Interaction & Technology. Ph.D. Dissertation. Linköping University, The Tema Institute, Faculty of Arts and Sciences.Google Scholar
- Adam Kendon. 1967. Some functions of gaze-direction in social interaction. Acta Psychologica 26 (1967), 22--63.Google ScholarCross Ref
- Kostadin Kushlev, Jason Proulx, and Elizabeth W. Dunn. 2016. "Silence Your Phones": Smartphone Notifications Increase Inattention and Hyperactivity Symptoms. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1011--1020. Google ScholarDigital Library
- Luis Leiva, Matthias Böhmer, Sven Gehring, and Antonio Krüger. 2012. Back to the App: The Costs of Mobile Application Interruptions. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '12). ACM, New York, NY, USA, 291--294. Google ScholarDigital Library
- Andrés Lucero, Jussi Holopainen, and Tero Jokela. 2011. Pass-them-around: Collaborative Use of Mobile Phones for Photo Sharing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 1787--1796. Google ScholarDigital Library
- Sus Lundgren and Olof Torgersson. 2013. Bursting the Mobile Bubble. In First International Workshop on Designing Mobile Face-to-Face Group Interactions, European Conference on Computer Supported Cooperative Work, ECSCW.Google Scholar
- Donald McMillan, Barry Brown, Airi Lampinen, Moira McGregor, Eve Hoggan, and Stefania Pizza. 2017. Situating Wearables: Smartwatch Use in Context. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3582--3594. Google ScholarDigital Library
- Abhinav Mehrotra, Veljko Pejovic, Jo Vermeulen, Robert Hendley, and Mirco Musolesi. 2016. My Phone and Me: Understanding People's Receptivity to Mobile Notifications. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1021--1032. Google ScholarDigital Library
- William Newman and Ethan L. Smith. 2006. Disruption of Meetings by Laptop Use: Is There a 10-second Solution?. In CHI '06 Extended Abstracts on Human Factors in Computing Systems (CHI EA '06). ACM, New York, NY, USA, 1145--1150. Google ScholarDigital Library
- Eyal Ofek, Shamsi T. Iqbal, and Karin Strauss. 2013. Reducing Disruption from Subtle Information Delivery During a Conversation: Mode and Bandwidth Investigation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 3111--3120. Google ScholarDigital Library
- Dina G Okamoto, Lisa Slattery Rashotte, and Lynn Smith-Lovin. 2002. Measuring interruption: Syntactic and contextual methods of coding conversation. Social Psychology Quarterly 65, 1 (2002), 38--55.Google ScholarCross Ref
- Jeni Paay and Jesper Kjeldskov. 2008. Understanding Situated Social Interactions: A Case Study of Public Places in the City. Computer Supported Cooperative Work 17, 2 (2008), 275--290. Google ScholarDigital Library
- Shwetak N. Patel, Julie A. Kientz, Gillian R. Hayes, Sooraj Bhat, and Gregory D. Abowd. 2006. Farther Than You May Think: An Empirical Investigation of the Proximity of Users to Their Mobile Phones. Springer Berlin Heidelberg, Berlin, Heidelberg, 123--140. Google ScholarDigital Library
- Jennifer Pearson, Simon Robinson, and Matt Jones. 2015. It's About Time: Smartwatches As Public Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1257--1266. Google ScholarDigital Library
- Martin Pielot. 2014. Large-scale Evaluation of Call-availability Prediction. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '14). ACM, New York, NY, USA, 933--937. Google ScholarDigital Library
- Martin Pielot, Karen Church, and Rodrigo de Oliveira. 2014. An In-situ Study of Mobile Phone Notifications. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services (MobileHCI '14). ACM, New York, NY, USA, 233--242. Google ScholarDigital Library
- Martin Porcheron, Joel E. Fischer, and Sarah Sharples. 2016. Using Mobile Phones in Pub Talk. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 1649--1661. Google ScholarDigital Library
- Julie Rico and Stephen Brewster. 2010. Usable Gestures for Mobile Interfaces: Evaluating Social Acceptability. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 887--896. Google ScholarDigital Library
- Alireza Sahami Shirazi, Niels Henze, Tilman Dingler, Martin Pielot, Dominik Weber, and Albrecht Schmidt. 2014. Large-scale Assessment of Mobile Notifications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3055--3064. Google ScholarDigital Library
- Jeffrey S. Shell, Roel Vertegaal, and Alexander W. Skaburskis. 2003. EyePliances: Attention-seeking Devices That Respond to Visual Attention. In CHI '03 Extended Abstracts on Human Factors in Computing Systems (CHI EA '03). ACM, New York, NY, USA, 770--771. Google ScholarDigital Library
- Norman Makoto Su and Lulu Wang. 2015. From Third to Surveilled Place: The Mobile in Irish Pubs. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1659--1668. Google ScholarDigital Library
- Dag Svanaes and Gry Seland. 2004. Putting the Users Center Stage: Role Playing and Low-fi Prototyping Enable End Users to Design Mobile Systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, New York, NY, USA, 479--486. Google ScholarDigital Library
- Peter Tolmie, Andy Crabtree, Tom Rodden, and Steve Benford. 2008. "Are You Watching This Film or What?": Interruption and the Juggling of Cohorts. In Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work (CSCW '08). ACM, New York, NY, USA, 257--266. Google ScholarDigital Library
- Patricia Trbovich and Joanne L. Harbluk. 2003. Cell Phone Communication and Driver Visual Behavior: The Impact of Cognitive Distraction. In CHI '03 Extended Abstracts on Human Factors in Computing Systems (CHI EA '03). ACM, New York, NY, USA, 728--729. Google ScholarDigital Library
- Roel Vertegaal, Robert Slagter, Gerrit van der Veer, and Anton Nijholt. 2001. Eye Gaze Patterns in Conversations: There is More to Conversational Agents Than Meets the Eyes. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '01). ACM, New York, NY, USA, 301--308. Google ScholarDigital Library
- Shari P. Walsh, Katherine M. White, and Ross McD. Young. 2009. The phone connection: A qualitative exploration of how belongingness and social identification relate to mobile phone use amongst Australian youth. Journal of Community & Applied Social Psychology 19, 3 (2009), 225--240.Google ScholarCross Ref
- Hao-Chuan Wang, Dan Cosley, and Susan R. Fussell. 2010. Idea Expander: Supporting Group Brainstorming with Conversationally Triggered Visual Thinking Stimuli. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (CSCW '10). ACM, New York, NY, USA, 103--106. Google ScholarDigital Library
- Jason Wiese, T. Scott Saponas, and A.J. Bernheim Brush. 2013. Phoneprioception: Enabling Mobile Phones to Infer Where They Are Kept. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2157--2166. Google ScholarDigital Library
- Paweł Wo´ zniak, Kristina Knaving, Staffan Björk, and Morten Fjeld. 2015. RUFUS: Remote Supporter Feedback for Long-Distance Runners. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '15). ACM, New York, NY, USA, 115--124. Google ScholarDigital Library
Index Terms
- Evaluating the Disruptiveness of Mobile Interactions: A Mixed-Method Approach
Recommendations
Extending a mobile device's interaction space through body-centric interaction
MobileHCI '12: Proceedings of the 14th international conference on Human-computer interaction with mobile devices and servicesModern mobile devices rely on the screen as a primary input modality. Yet the small screen real-estate limits interaction possibilities, motivating researchers to explore alternate input techniques. Within this arena, our goal is to develop Body-Centric ...
Design issues encountered in the development of a mobile multimedia augmentative communication service
Augmentative and alternative communication (AAC) systems can be mounted on a range of different hardware platforms, from custom-designed units to desktop or laptop personal computers and hand-held and palmtop systems. Palmtop devices such as personal ...
Multimodal mobile interactions: usability studies in real world settings
ICMI '11: Proceedings of the 13th international conference on multimodal interfacesThis paper presents a study that explores the issues of mobile multimodal interactions while on the move in the real world. Because multimodal interfaces allow new kinds of eyes and hands free interactions, usability issues while moving through ...
Comments