Grete Helena Kütt
Teerapaun Tanprasert
Alexandra Papoutsaki
Abstract
Remote collaborations are becoming ubiquitous, but, despite their many advantages, face unique challenges compared to collocated collaborations. Visualizing the collaborator's point of gaze on a shared screen has been explored as a promising way to alleviate some of these limitations by increasing shared awareness. However, prior studies on shared gaze have not considered the medium of communication and have only studied its effect on audio. This paper presents a study that compares the effects of shared gaze on collaboration performance during audio- and text-based communication. We find that for text, shared gaze improved task correctness and led collaborators to look at and talk more about shared content. Similar trends are found for gaze-augmented voice communication, but contrary to the slower performance in text, it also saw improvements in completion time as well as in cognitive workload. Our findings demonstrate the differences in how shared gaze impacts audio- versus text-based communication and highlight the need to further understand the nuances of the medium of communication when designing novel tools to support remote collaborators.
- Deepak Akkil, Jobin Mathew James, Poika Isokoski, and Jari Kangas. 2016. GazeTorch: Enabling Gaze Awareness in Collaborative Physical Tasks. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 1151--1158. https://doi.org/10.1145/2851581.2892459Google Scholar
Digital Library
- Sean Andrist, Michael Gleicher, and Bilge Mutlu. 2017. Looking Coordinated: Bidirectional Gaze Mechanisms for Collaborative Interaction with Virtual Characters. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). Association for Computing Machinery, New York, NY, USA, 2571--2582. https://doi.org/10.1145/3025453.3026033Google ScholarDigital Library
- Francisco Jonathan Araújo de Oliveira, Ligia Samara Abrantes de Lima, Pedro Ivo Martins Cidade, Camila Bezerra Nobre, and Modesto Leite Rolim Neto. 2020. Impact Of Sars-Cov-2 And Its Reverberation In Global Higher Education And Mental Health. Psychiatry Research, Vol. 288 (2020), 112977. https://doi.org/10.1016/j.psychres.2020.112977Google ScholarCross Ref
- Frank Biocca, Chad Harms, and Judee K. Burgoon. 2003. Toward a More Robust Theory and Measure of Social Presence: Review and Suggested Criteria. Presence: Teleoperators and Virtual Environments, Vol. 12, 5 (2003), 456--480. https://doi.org/10.1162/105474603322761270 https://doi.org/10.1007/s11412-006--9005-xGoogle ScholarDigital Library
- Stefan Münzer and Torsten Holmer. 2009. Bridging the Gap Between Media Synchronicity and Task Performance: Effects of Media Characteristics on Process Variables and Task Performance Indicators in an Information Pooling Task. Communication Research, Vol. 36, 1 (2009), 76--103. https://doi.org/10.1177/0093650208326464 showeprinthttps://doi.org/10.1177/0093650208326464Google ScholarCross Ref
- Bonnie A. Nardi, Steve Whittaker, and Erin Bradner. 2000. Interaction and Outeraction: Instant Messaging in Action. (2000), 79--88. https://doi.org/10.1145/358916.358975Google Scholar
- Joshua Newn, Fraser Allison, Eduardo Velloso, and Frank Vetere. 2018. Looks Can Be Deceiving: Using Gaze Visualisation to Predict and Mislead Opponents in Strategic Gameplay. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 261, bibinfonumpages12 pages. https://doi.org/10.1145/3173574.3173835Google ScholarDigital Library
- Joshua Newn, Eduardo Velloso, Fraser Allison, Yomna Abdelrahman, and Frank Vetere. 2017. Evaluating Real-Time Gaze Representations to Infer Intentions in Competitive Turn-Based Strategy Games. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '17). ACM, New York, NY, USA, 541--552. https://doi.org/10.1145/3116595.3116624Google ScholarDigital Library
- Frank Newport. 2014. The New Era of Communication Among Americans. https://news.gallup.com/poll/179288/new-era-communication-americans.aspxGoogle Scholar
- Marc-Antoine Nüssli. 2011. Dual Eye-Tracking Methods for the Study of Remote Collaborative Problem Solving. (2011), 229.Google Scholar
- Marc-Antoine Nüssli, Patrick Jermann, Mirweis Sangin, and Pierre Dillenbourg. 2009. Collaboration and abstract representations: towards predictive models based on raw speech and eye-tracking data. In Proceedings of the 9th international conference on Computer supported collaborative learning-Volume 1. International Society of the Learning Sciences, 78--82.Google ScholarDigital Library
- Gary M. Olson and Judith S. Olson. 2000. Distance Matters. Hum.-Comput. Interact., Vol. 15, 2 (Sept. 2000), 139--178. https://doi.org/10.1207/S15327051HCI1523_4Google ScholarDigital Library
- Thammathip Piumsomboon, Arindam Dey, Barrett Ens, Gun Lee, and Mark Billinghurst. 2019. The effects of sharing awareness cues in collaborative mixed reality. Frontiers in Robotics and AI, Vol. 6, 5 (2019), 02.Google ScholarCross Ref
- Michael Prilla. 2019. “I Simply Watched Where She Was Looking at”: Coordination in Short-Term Synchronous Cooperative Mixed Reality. Proc. ACM Hum.-Comput. Interact., Vol. 3, GROUP, Article 246 (Dec. 2019), bibinfonumpages21 pages. https://doi.org/10.1145/3361127Google ScholarDigital Library
- Ronald E. Rice. 1993. Media Appropriateness: Using social presence theory to compare traditional and new organizational media. Human Communication Research, Vol. 19, 4 (1993), 451--484. https://doi.org/10.1111/j.1468--2958.1993.tb00309.x showeprinthttps://onlinelibrary.wiley.com/doi/pdf/10.1111/j.1468--2958.1993.tb00309.xGoogle ScholarCross Ref
- Christian Schlösser. 2018. Towards Concise Gaze Sharing. In Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications (ETRA '18). ACM, New York, NY, USA, Article 78, bibinfonumpages3 pages. https://doi.org/10.1145/3204493.3207416Google ScholarDigital Library
- Bertrand Schneider and Roy Pea. 2013. Real-time mutual gaze perception enhances collaborative learning and collaboration quality. International Journal of Computer-Supported Collaborative Learning, Vol. 8, 4 (01 Dec 2013), 375--397. https://doi.org/10.1007/s11412-013--9181--4Google ScholarCross Ref
- Ulrike Schultz and Betty Vandenbosch. 1998. Information Overload in a Groupware Environment: Now you see it, now you don't. Journal of Organizational Computing and Electronic Commerce, Vol. 8, 2 (1998), 127--148.Google ScholarCross Ref
- John Short, Ederyn Williams, and Bruce Christie. 1976. The Social Psychology of Telecommunications .John Wiley & Sons.Google Scholar
- Harri Siirtola, Oleg vS pakov, Howell Istance, and Kari-Jouko R"aih"a. 2019. Shared gaze in collaborative visual search. International Journal of Human-Computer Interaction (2019), 1--13.Google Scholar
- Garold Stasser and Dennis Stewart. 1992. Discovery of hidden profiles by decision-making groups: Solving a problem versus making a judgment. Journal of Personality and Social Psychology Quarterly (1992), 67--78.Google Scholar
- Oleg vSpakov, Howell Istance, Kari-Jouko R"aih"a, Tiia Viitanen, and Harri Siirtola. 2019. Eye Gaze and Head Gaze in Collaborative Games. In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications (ETRA '19). ACM, New York, NY, USA, Article 85, bibinfonumpages9 pages. https://doi.org/10.1145/3317959.3321489Google ScholarDigital Library
- Joseph Tao-yi Wang, Michael Spezio, and Colin F. Camerer. 2010. Pinocchio's Pupil: Using Eyetracking and Pupil Dilation to Understand Truth Telling and Deception in Sender-Receiver Games. American Economic Review, Vol. 100, 3 (June 2010), 984--1007. https://doi.org/10.1257/aer.100.3.984Google ScholarCross Ref
- Nancy Yao, Jeff Brewer, Sarah D'Angelo, Mike Horn, and Darren Gergle. 2018. Visualizing Gaze Information from Multiple Students to Support Remote Instruction. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18). ACM, New York, NY, USA, Article LBW051, bibinfonumpages6 pages. https://doi.org/10.1145/3170427.3188453Google ScholarDigital Library
Index Terms
- Effects of Shared Gaze on Audio- Versus Text-Based Remote Collaborations
Recommendations
Eye-Write: Gaze Sharing for Collaborative Writing
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing SystemsOnline collaborative writing is an increasingly common practice. Despite its positive effect on productivity and quality of work, it poses challenges to co-authors in remote settings because of limitations in conversational grounding and activity ...
GlassBoARd: A Gaze-Enabled AR Interface for Collaborative Work
CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing SystemsRecent research on remote collaboration focuses on improving the sense of co-presence and mutual understanding among the collaborators, whereas there is limited research on using non-verbal cues such as gaze or head direction alongside their main ...
Shared gaze in remote spoken hri during distributed military operation
HRI '12: Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot InteractionCollaboration between distributed human and robot partners during military operations is becoming more necessary. In order to enable efficient real-time communication, it is important to develop user interfaces that support robust spoken language ...
Comments