Pedro Albuquerque Santos
ABSTRACT
We currently live surrounded by many different computing devices. Therefore, it is important to take better advantage of those devices by coming up with smart ways of integrating and combining them. We have been exploring the possibility of building applications that present user interfaces pervasively distributed across different co-located devices. We designed the YanuX framework, which generalizes and supports the development of this new type of applications. A key issue is the automatic distribution of user interface (UI) components among co-located devices. We created the tools set needed to describe the capabilities of each of the devices present in the environment and the requirements of each of the applications' components as configured by the developers. Restrictions of the components should match the capabilities of the devices leading to a UI component distribution decision that should reflect developers' intentions and expectations of the users. Besides detailing YanuX's components, the paper also presents YouTube Viewer as a proof-of-concept application based on YanuX. The application was also used in a user study to evaluate the concept and the experience supported by the framework. The results presented here are positive and very promising.
- Abdulrahman Alarifi, AbdulMalik Al-Salman, Mansour Alsaleh, Ahmad Alnafessah, Suheer Al-Hadhrami, Mai Al-Ammar, and Hend Al-Khalifa. 2016. Ultra Wideband Indoor Positioning Technologies: Analysis and Recent Advances. Sensors 16, 5 (may 2016), 707. Google Scholar
Cross Ref
- Apple Inc. [n.d.]. Handoff for Developers. https://developer.apple.com/handoff/Google Scholar
- Apple Inc. 2018. iBeacon. https://developer.apple.com/ibeacon/Google Scholar
- P. Bahl and V.N. Padmanabhan. 2000. RADAR: an in-building RF-based user location and tracking system. In Proc. IEEE INFOCOM 2000. Conf. Comput. Commun. Ninet. Annu. Jt. Conf. IEEE Comput. Commun. Soc. (Cat. No.00CH37064), Vol. 2. IEEE, 775--784. Google ScholarCross Ref
- Aaron Bangor, Philip Kortum, and James Miller. 2009. Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale. J. Usability Stud. 4 (2009), 114--123. http://uxpajournal.org/wp-content/uploads/sites/8/pdf/JUS{_}Bangor{_}May2009.pdfGoogle ScholarDigital Library
- Ramon F. Brena, Juan Pablo García-Vázquez, Carlos E. Galván-Tejada, David Muñoz-Rodriguez, Cesar Vargas-Rosales, and James Fangmeyer. 2017. Evolution of Indoor Positioning Technologies: A Survey. Journal of Sensors 2017 (mar 2017), 1--21. Google ScholarCross Ref
- John Brooke. 1996. SUS - A quick and dirty usability scale. In Usability Eval. Ind. (1st ed.), Patrick W. Jordan, B. Thomas, Ian Lyall McClelland, and Bernard Weerdmeester (Eds.). CRC Press, Chapter 21, 189--194.Google Scholar
- Pedro Centieiro, Rui Neves Madeira, Teresa Romão, A. Eduardo Dias, and Nuno Correia. 2015. In sync with fair play!: delivering a synchronized and cheat-preventing second screen gaming experience. In Proceedings of the 12th International Conference on Advances in Computer Entertainment Technology - ACE '15. ACM Press, New York, New York, USA, 1--11. Google ScholarDigital Library
- Marco Cruz, Teresa Romão, Pedro Centieiro, and A. Eduardo Dias. 2017. Exploring the use of second screen devices during live sports broadcasts to promote social interaction. In Proceedings of the 14th Conference on Advances in Computer Entertainment Technology - ACE '17, Vol. 10714 LNCS. Springer, Cham, 318--338. Google ScholarCross Ref
- Ed. D. Hardt. 2012. The OAuth 2.0 Authorization Framework. arXiv:arXiv:1011.1669v3 Google ScholarCross Ref
- David Dearman and Jeffery S. Pierce. 2008. It's on my other computer!: computing with multiple devices. In Proceeding twenty-sixth Annu. CHI Conf. Hum. factors Comput. Syst. - CHI '08. ACM Press, New York, New York, USA, 767. Google ScholarDigital Library
- Robert Diaz-Marino and Saul Greenberg. 2010. The proximity toolkit and ViconFace: the video. In Proc. 28th Int. Conf. Ext. Abstr. Hum. factors Comput. Syst. - CHI EA '10. ACM Press, New York, New York, USA, 4793. Google ScholarDigital Library
- Estimote Inc. 2018. Estimote Products. https://estimote.eom/products/{#}productsGoogle Scholar
- Andrea Gallidabino and Cesare Pautasso. 2016. The Liquid.js Framework for Migrating and Cloning Stateful Web Components across Multiple Devices. In Proc. 25th Int. Conf. Companion World Wide Web - WWW '16 Companion. ACM Press, New York, New York, USA, 183--186. Google ScholarDigital Library
- Andrea Gallidabino, Cesare Pautasso, Ville Ilvonen, Tommi Mikkonen, Kari Systa, Jari-Pekka Voutilainen, and Antero Taivalsaari. 2016. On the Architecture of Liquid Software: Technology Alternatives and Design Space. In 2016 13th Work. IEEE/IFIP Conf. Softw. Archit. IEEE, 122--127. Google ScholarCross Ref
- Hans Gellersen, Carl Fischer, Dominique Guinard, Roswitha Gostner, Gerd Kortuem, Christian Kray, Enrico Rukzio, and Sara Streng. 2008. Supporting device discovery and spontaneous interaction with spatial references. Pers. Ubiquitous Comput. 13, 4 (jul 2008), 255--264. Google ScholarDigital Library
- Fabio Giglietto and Donatella Selva. 2014. Second Screen and Participation: A Content Analysis on a Full Season Dataset of Tweets. J. Commun. 64, 2 (apr 2014), 260--277. Google ScholarCross Ref
- Google. 2017. Consumer Barometer. https://www.consumerbarometer.com/en/Google Scholar
- Saul Greenberg and Hideaki Kuzuoka. 1999. Using digital but physical surrogates to mediate awareness, communication and privacy in media spaces. Pers. Technol. 3, 4 (dec 1999), 182--198. Google ScholarCross Ref
- Saul Greenberg, Nicolai Marquardt, Till Ballendat, Rob Diaz-Marino, and Miaosen Wang. 2011. Proxemic interactions: the new ubicomp? interactions 18, 1 (jan 2011), 42. Google ScholarDigital Library
- Yanying Gu, Anthony Lo, and Ignas Niemegeers. 2009. A survey of indoor positioning systems for wireless personal networks. IEEE Commun. Surv. Tutorials 11, 1 (2009), 13--32. Google ScholarDigital Library
- Edward Twitchell Hall. 1990. The Hidden Dimension (27 ed.). Anchor Books. 217 pages. https://books.google.com/books?id=HlmqAAAACAAJ{&}pgis=1Google Scholar
- John Hartman, Udi Manber, and L Peterson. 1996. Liquid software: A new paradigm for networked systems. Technical Report. Tucson, AZ, USA.Google Scholar
- Simon Hay and Robert Harle. 2009. Bluetooth Tracking without Discoverability. In Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics). Vol. 5561 LNCS. 120--137. Google ScholarDigital Library
- Suining He and S.-H. Gary Chan. 2016. Wi-Fi Fingerprint-Based Indoor Positioning: Recent Advances and Comparisons. IEEE Communications Surveys & Tutorials 18, 1 (2016), 466--490. Google ScholarDigital Library
- Tom Horak, Andreas Mathisen, Clemens N. Klokmose, Raimund Dachselt, and Niklas Elmqvist. 2019. Vistribute: Distributing Interactive Visualizations in Dynamic Multi-Device Setups. In Proc. 2019 CHI Conf. Hum. Factors Comput. Syst. - CHI '19. ACM Press, New York, New York, USA, 1--13. Google ScholarDigital Library
- Kantar TNS Germany. 2019. The Connected Consumer. https://www.google.com/publicdata/explore?ds=dg8d1eetcqsb1{_}Google Scholar
- Ali Khalajmehrabadi, Nikolaos Gatsis, and David Akopian. 2017. Modern WLAN Fingerprinting Indoor Positioning Methods and Deployment Challenges. IEEE Communications Surveys & Tutorials 19, 3 (2017), 1974--2002. Google ScholarDigital Library
- Clemens N. Klokmose, James R. Eagan, Siemen Baader, Wendy Mackay, and Michel Beaudouin-Lafon. 2015. Webstrates: Shareable Dynamic Media. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST '15. ACM Press, New York, New York, USA, 280--290. Google ScholarDigital Library
- Hui Liu, Houshang Darabi, Pat Banerjee, and Jing Liu. 2007. Survey of Wireless Indoor Positioning Techniques and Systems. IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) 37, 6 (nov 2007), 1067--1080. Google ScholarDigital Library
- Luca Mainetti, Luigi Patrono, and Ilaria Sergi. 2014. A survey on indoor positioning systems. In 2014 22nd International Conference on Software, Telecommunications and Computer Networks (SoftCOM). IEEE, 111--120. Google ScholarCross Ref
- Ethan Marcotte and Jeremy Keith. 2011. Responsive web design. A Book Apart. 153 pages. https://abookapart.com/products/responsive-web-designGoogle Scholar
- Nicolai Marquardt, Till Ballendat, Sebastian Boring, Saul Greenberg, and Ken Hinckley. 2012. Gradual engagement: facilitating information exchange between digital devices as a function of proximity. In Proc. 2012 ACM Int. Conf. Interact. tabletops surfaces - ITS '12. ACM Press, New York, New York, USA, 31. Google ScholarDigital Library
- Nicolai Marquardt, Robert Diaz-Marino, Sebastian Boring, and Saul Greenberg. 2011. The Proximity Toolkit: Prototyping Proxemic Interactions in Ubiquitous Computing Ecologies. In Proc. 24th Annu. ACM Symp. User interface Softw. Technol. - UIST '11. ACM Press, New York, New York, USA, 315. Google ScholarDigital Library
- Nicolai Marquardt, Ken Hinckley, and Saul Greenberg. 2012. Cross-device interaction via micro-mobility and f-formations. In Proc. 25th Annu. ACM Symp. User interface Softw. Technol. - UIST '12. ACM Press, New York, New York, USA, 13. Google ScholarDigital Library
- Tommi Mikkonen, Kari Systä, and Cesare Pautasso. 2015. Towards Liquid Web Applications. In 15th Int. Conf. Web Eng. ICWE 2015, Vol. 9114. Springer, Cham, Rotterdam, the Netherlands, 134--143. Google ScholarDigital Library
- Partha Mukherjee and Bernard J. Jansen. 2015. Correlation of Brand Mentions in Social Media and Web Searching Before and After Real Life Events: Phase Analysis of Social Media and Search Data for Super Bowl 2015 Commercials. In 2015 IEEE Int. Conf. Data Min. Work. IEEE, 21--26. Google ScholarDigital Library
- Miguel A. Nacenta, Dzmitry Aliakseyeu, Sriram Subramanian, and Carl Gutwin. 2005. A comparison of techniques for multi-display reaching. In Proc. SIGCHI Conf. Hum. factors Comput. Syst. - CHI '05. ACM Press, New York, New York, USA, 371. Google ScholarDigital Library
- Michael Nebeling. 2017. XDBrowser 2.0: Semi-Automatic Generation of Cross-Device Interfaces. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17. ACM Press, New York, New York, USA, 4574--4584. Google ScholarDigital Library
- Jae-Oh Oh, Myong-Soo Lee, and SangKeun Lee. 2009. An Acoustic-Based Relative Positioning System for Multiple Mobile Devices. In 2009 Fourth Int. Conf. Comput. Sci. Converg. Inf. Technol. IEEE, 1565--1570. Google ScholarDigital Library
- Tim Paek, Maneesh Agrawala, Sumit Basu, Steve Drucker, Trausti Kristjansson, Ron Logan, Kentaro Toyama, and Andy Wilson. 2004. Toward universal mobile interaction for shared displays. In Proc. 2004 ACM Conf. Comput. Support. Coop. Work - CSCW '04. ACM Press, New York, New York, USA, 266. Google ScholarDigital Library
- Seonwook Park, Christoph Gebhardt, Roman Rädle, Anna Feit, Hana Vrzakova, Niraj Dayama, Hui-Shyong Yeo, Clemens Klokmose, Aaron Quigley, Antti Oulasvirta, and Otmar Hilliges. 2018. AdaM: Adapting Multi-User Interfaces for Collaborative Environments in Real-Time. In Proc. 2018 CHI Conf. Hum. Factors Comput. Syst. - CHI '18. ACM Press, New York, New York, USA, 1--14. arXiv:1803.01166 Google ScholarDigital Library
- Chunyi Peng, Guobin Shen, Yongguang Zhang, Yanlin Li, and Kun Tan. 2007. BeepBeep: a high accuracy acoustic ranging system using COTS mobile devices. In Proc. 5th Int. Conf. Embed. networked Sens. Syst. - SenSys '07. ACM Press, New York, New York, USA, 1. Google ScholarDigital Library
- F. Reichheld, Frederick. 2003. The one number you need to grow. Harv. Bus. Rev. December, 4 (dec 2003), 46--54. https://hbr.org/2003/12/the-one-number-you-need-to-growGoogle Scholar
- Mohamed Er Rida, Fuqiang Liu, Yassine Jadi, Amgad Ali Abdullah Algawhari, and Ahmed Askourih. 2015. Indoor Location Position Based on Bluetooth Signal Strength. In 2015 2nd International Conference on Information Science and Control Engineering. IEEE, 769--773. Google ScholarDigital Library
- Pedro Albuquerque Santos, Rui Neves Madeira, and Nuno Correia. 2013. FCT4U - When Private Mobile Displays Meet Public Situated Displays to Enhance the User Experience. In 2013 IEEE 10th Int. Conf. Ubiquitous Intell. Comput. 2013 IEEE 10th Int. Conf. Auton. Trust. Comput. IEEE, 186--193. Google ScholarDigital Library
- Pedro Albuquerque Santos, Rui Neves Madeira, and Nuno Correia. 2018. Designing a Framework to Support the Development of Smart Cross-device Applications. In Proc. 17th Int. Conf. Mob. Ubiquitous Multimed. - MUM 2018. ACM Press, New York, New York, USA, 367--374. Google ScholarDigital Library
- Stephanie Santosa and Daniel Wigdor. 2013. A field study of multi-device workflows in distributed workspaces. In Proc. 2013 ACM Int. Jt. Conf. Pervasive ubiquitous Comput. - UbiComp '13. ACM Press, New York, New York, USA, 63. Google ScholarDigital Library
- Antero Taivalsaari, Tommi Mikkonen, and Kari Systa. 2014. Liquid Software Manifesto: The Era of Multiple Device Ownership and Its Implications for Software Architecture. In 2014 IEEE 38th Annu. Comput. Softw. Appl. Conf. IEEE, 338--343. Google ScholarDigital Library
- David Thevenin and Joëlle Coutaz. 1999. Plasticity of User Interfaces: Framework and Research Agenda. In Human-Computer Interact. INTERACT '99 IFIP TC. 13, M. Angela Sasse and Chris Johnson (Eds.). IOS Press, Amsterdam, The Netherlands, 110--116. htttp://iihm.imag.fr/publs/1999/interaet99{_}plasticite.pdfGoogle Scholar
- Mark Weiser. 1991. The Computer for the 21st Century. Sci. Am. 265 (1991), 94--105. Google ScholarCross Ref
- Martin Werner. 2014. Indoor Location-Based Services. Springer International Publishing, Cham. 1--233 pages. Google ScholarCross Ref
- Jishuo Yang and Daniel Wigdor. 2014. Panelrama: enabling easy specification of cross-device web applications. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI '14. ACM Press, New York, New York, USA, 2783--2792. Google ScholarDigital Library
- Moustafa Youssef and Ashok Agrawala. 2005. The Horus WLAN location determination system. In Proc. 3rd Int. Conf. Mob. Syst. Appl. Serv. - MobiSys '05. ACM Press, New York, New York, USA, 205. Google ScholarDigital Library
Index Terms
- YanuX: pervasive distribution of the user interface by co-located devices
Recommendations
Designing a Framework to Support the Development of Smart Cross-device Applications
MUM '18: Proceedings of the 17th International Conference on Mobile and Ubiquitous MultimediaWe live surrounded by computing devices, but applications are mostly confined to run on a single device. It should be possible to make better use of the multiple devices around us by coming up with ways of integrating and combining them, while ...
Computational Framework to Support Development of Applications Running on Multiple Co-located Devices
EICS '21: Companion of the 2021 ACM SIGCHI Symposium on Engineering Interactive Computing SystemsWe designed a framework to generalize the development of applications with UI elements distributed across co-located devices. The framework is comprised of diverse components in order to deal with the complexity of such a task, including: ...
Applications across Co-located Devices: User Interface Distribution, State Management and Collaboration
iiWAS2021: The 23rd International Conference on Information Integration and Web IntelligenceWe live surrounded by computing devices, but we are not yet combining them into a natural unified user experience. Therefore, we have designed and implemented a framework to generalize and support the development of multi-device applications, which ...
Comments