Tim Weißker
Florian Echtler
ABSTRACT
In this paper, we present the Massive Mobile Multiuser (M3) framework, a software platform designed to enable setup-free, real-time, concurrent interaction with shared public displays through large numbers of personal mobile devices. This work is motivated by the fact that simultaneous interaction of multiple persons with public displays requires either dedicated tracking hardware to detect gestures or touch, or a way for users to interact through their personal mobile devices. The latter option provides more flexibility but also presents a heightened entry barrier as it often requires installation of custom software.
To address these issues, M3 enables immediate interaction through the mobile browser without requiring prior setup on the user side, and real-time interaction suitable for fast multiplayer games. We present a detailed analysis of latency sources and findings from two real-world deployments of our framework in public settings with up to 17 concurrent users. Despite a resource-constrained environment and an unpredictable selection of client devices, M3 consistently delivers performance suitable for real-time interaction.
- Florian Alt, Thomas Kubitza, Dominik Bial, Firas Zaidan, Markus Ortel, Björn Zurmaar, Tim Lewen, Alireza Sahami Shirazi, and Albrecht Schmidt. 2011. Digifieds: insights into deploying digital public notice areas in the wild. In Proceedings of the 10th International Conference on Mobile and Ubiquitous Multimedia (MUM '11). ACM, 165--174. http://dl.acm.org/citation.cfm?id=2107618 Google Scholar
Digital Library
- Florian Alt, Alireza Sahami Shirazi, Thomas Kubitza, and Albrecht Schmidt. 2013. Interaction techniques for creating and exchanging content with public displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, 1709--1718. http://dl.acm.org/citation.cfm?id=2466226 Google ScholarDigital Library
- Rafael Ballagas, Michael Rohs, and Jennifer G. Sheridan. 2005. Sweep and Point and Shoot: Phonecam-based Interactions for Large Public Displays. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). ACM, New York, NY, USA, 1200--1203. DOI:http://dx.doi.org/10.1145/1056808.1056876 Google ScholarDigital Library
- Sebastian Boring, Dominikus Baur, Andreas Butz, Sean Gustafson, and Patrick Baudisch. 2010. Touch Projector: Mobile Interaction Through Video. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 2287--2296. DOI:http://dx.doi.org/10.1145/1753326.1753671 Google ScholarDigital Library
- Mason Chang. 2014. Android Touch Resampling Algorithm. (2014). Retrieved April 15, 2016 from http://www.masonchang.com/blog/2014/8/25/androids-touch-resampling-algorithm.Google Scholar
- Sarah Clinch, Jan Harkes, Adrian Friday, Nigel Davies, and Mahadev Satyanarayanan. 2012. How close is close enough? Understanding the role of cloudlets in supporting display appropriation by mobile users. In Pervasive Computing and Communications (PerCom), 2012 IEEE International Conference on. IEEE, 122--127.Google ScholarCross Ref
- Tilman Dingler, Tobias Bagg, Yves Grau, Niels Henze, and Albrecht Schmidt. 2015. uCanvas: A Web Framework for Spontaneous Smartphone Interaction with Ubiquitous Displays. In Human-Computer Interaction INTERACT 2015, Julio Abascal, Simone Barbosa, Mirko Fetter, Tom Gross, Philippe Palanque, and Marco Winckler (Eds.). Number 9298 in Lecture Notes in Computer Science. Springer International Publishing, 402--409. http://link.springer.com/chapter/10.1007/978-3-319-22698-927Google ScholarDigital Library
- Ivan Elhart, Federico Scacchi, Evangelos Niforatos, and Marc Langheinrich. 2015. ShadowTouch: A Multi-user Application Selection Interface for Interactive Public Displays. In Proceedings of the 4th International Symposium on Pervasive Displays (PerDis '15). ACM, New York, NY, USA, 209--216. DOI:http://dx.doi.org/10.1145/2757710.2757735 Google ScholarDigital Library
- Ian Fette and Alexey Melnikov. 2011. The WebSocket Protocol (RFC6455). (2011). Retrieved September 25, 2015 from https://tools.ietf.org/html/rfc6455.Google Scholar
- Matthias Geel, Daniel Huguenin, and Moira C. Norrie. 2013. PresiShare: Opportunistic Sharing and Presentation of Content Using Public Displays and QR Codes. In Proceedings of the 2Nd ACM International Symposium on Pervasive Displays (PerDis '13). ACM, New York, NY, USA, 103--108. DOI:http://dx.doi.org/10.1145/2491568.2491591 Google ScholarDigital Library
- Google, Inc. 2015. Nearby. (2015). Retrieved September 25, 2015 from https://developers.google.com/nearby/.Google Scholar
- Zenja Ivkovic, Ian Stavness, Carl Gutwin, and Steven Sutcliffe. 2015. Quantifying and Mitigating the Negative Effects of Local Latencies on Aiming in 3D Shooter Games. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 135--144. DOI:http://dx.doi.org/10.1145/2702123.2702432 Google ScholarDigital Library
- Thomas Kubitza, Sarah Clinch, Nigel Davies, and Marc Langheinrich. 2013. Using mobile devices to personalize pervasive displays. ACM SIGMOBILE Mobile Computing and Communications Review 16, 4 (2013), 26--27. http://dl.acm.org/citation.cfm?id=2436211 Google ScholarDigital Library
- Thomas Kubitza, Sascha Thullner, and Albrecht Schmidt. 2015. VEII: A Toolkit for Editing Multimedia Content of Interactive Installations On-site. In Proceedings of the 4th International Symposium on Pervasive Displays (PerDis '15). ACM, New York, NY, USA, 249--250. DOI:http://dx.doi.org/10.1145/2757710.2776806 Google ScholarDigital Library
- Jörg Müller, Florian Alt, Daniel Michelis, and Albrecht Schmidt. 2010. Requirements and Design Space for Interactive Public Displays. In Proceedings of the International Conference on Multimedia (MM '10). ACM, New York, NY, USA, 1285--1294. DOI:http://dx.doi.org/10.1145/1873951.1874203 Google ScholarDigital Library
- Jörg Müller, Dieter Eberle, and Konrad Tollmar. 2014. Communiplay: A Field Study of a Public Display Mediaspace. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 1415--1424. DOI:http://dx.doi.org/10.1145/2556288.2557001 Google ScholarDigital Library
- Jörg Müller, Robert Walter, Gilles Bailly, Michael Nischt, and Florian Alt. 2012. Looking Glass: A Field Study on Noticing Interactivity of a Shop Window. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 297--306. DOI:http://dx.doi.org/10.1145/2207676.2207718 Google ScholarDigital Library
- Albert Ng, Julian Lepinski, Daniel Wigdor, Steven Sanders, and Paul Dietz. 2012. Designing for Low-latency Direct-touch Input. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 453--464. DOI:http://dx.doi.org/10.1145/2380116.2380174 Google ScholarDigital Library
- E. Oat, M. Di Francesco, and T. Aura. 2014. MoCHA: Augmenting pervasive displays through mobile devices and web-based technologies. In Pervasive Computing and Communications Workshops (PERCOM Workshops), 2014 IEEE International Conference on. 506--511. DOI:http://dx.doi.org/10.1109/PerComW.2014.6815258Google ScholarCross Ref
- Joe Padre. 2014. Understanding touch responsiveness - Touchscreen technology series 2. (2014). Retrieved April 15, 2016 from http://developer.sonymobile.com/2014/07/02/understanding-touch-responsiveness-touchscreen-technology-series-2/.Google Scholar
- Umar Rashid, Miguel A. Nacenta, and Aaron Quigley. 2012. The Cost of Display Switching: A Comparison of Mobile, Large Display and Hybrid UI Configurations. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI '12). ACM, New York, NY, USA, 99--106. DOI:http://dx.doi.org/10.1145/2254556.2254577 Google ScholarDigital Library
- Keith Vertanen, Justin Emge, Haythem Memmi, and Per Ola Kristensson. 2014. Text Blaster: A Multi-player Touchscreen Typing Game. In CHI '14 Extended Abstracts on Human Factors in Computing Systems (CHI EA '14). ACM, New York, NY, USA, 379--382. DOI:http://dx.doi.org/10.1145/2559206.2574802 Google ScholarDigital Library
- Nathan Weitzner, Jason Freeman, Yan-Ling Chen, and Stephen Garrett. 2013. massMobile: towards a flexible framework for large-scale participatory collaborations in live performances. Organised Sound 18, Special Issue 01 (April 2013), 30--42. DOI:http://dx.doi.org/10.1017/S1355771812000222Google Scholar
- Christopher D. Wickens, Justin G. Hollands, and Raja Parasuraman. 2012. Engineering Psychology & Human Performance (4th ed.). CRC Press, Boston.Google Scholar
- Shumin Zhai. 1995. Human performance in six degree of freedom input control. Ph.D. Dissertation. University of Toronto.Google Scholar
Index Terms
- The massive mobile multiuser framework: enabling ad-hoc realtime interaction on public displays with mobile devices
Recommendations
MMM Ball: Showcasing the Massive Mobile Multiuser Framework
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing SystemsWe present the Massive Mobile Multiuser (M³) framework, a platform designed to enable setup-free, real-time, concurrent interaction with shared public displays through large numbers of mobile devices. Simultaneous interaction of multiple persons with ...
Mobile-based tangible interaction techniques for shared displays
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & servicesThis tutorial explores the possibility of using touchscreen-based mobile devices as active tangibles on an interactive tabletop surface. The tutorial starts with an open discussion about various aspects of tangible interaction, including an overview of ...
Evaluating reading and analysis tasks on mobile devices: a case study of tilt and flick scrolling
OZCHI '09: Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7Flick scrolling is a natural scrolling method for mobile touch devices such as the iPhone™. It is useful not only for its performance but perhaps even more so for its ease of use and user experience. Tilt scrolling instead uses the device's tilt to ...
Comments