Nico Castelli
Corinna Ogonowski
ABSTRACT
Smart home systems change the way we experience the home. While there are established research fields within HCI for visualizing specific use cases of a smart home, studies targeting user demands on visualizations spanning across multiple use cases are rare. Especially, individual data-related demands pose a challenge for usable visualizations. To investigate potentials of an end-user development (EUD) approach for flexibly supporting such demands, we developed a smart home system featuring both pre-defined visualizations and a visualization creation tool. To evaluate our concept, we installed our prototype in 12 households as part of a Living Lab study. Results are based on three interview studies, a design workshop and system log data. We identified eight overarching interests in home data and show how participants used pre-defined visualizations to get an overview and the creation tool to not only address specific use cases but also to answer questions by creating temporary visualizations.
Supplemental Material
- Wolfgang Aigner, Silvia Miksch, Heidrun Schumann, and Christian Tominski. 2011. Visualization of TimeOriented Data. Springer London, London. Google Scholar
Cross Ref
- Abdullah Al Mahmud, Omar Mubin, Suleman Shahid, James F. Juola, and Boris de Ruyter. 2008. EZ phone: persuading mobile users to conserve energy. In Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, InteractionVolume 2, 7--10.Google ScholarCross Ref
- Frances K. Aldrich. 2003. Smart Homes: Past, Present and Future. In Inside the Smart Home, Richard Harper (ed.). Springer London, 17--39. https://doi.org/10.1007/185233--854--7_2Google Scholar
- M. Balestrini, T. Diez, P. Marshall, A. Gluhak, and Y. Rogers. 2015. IoT Community Technologies: Leaving Users to Their Own Devices or Orchestration of Engagement? EAI Endorsed Transactions on Internet of Things 1, 1: 150601. https://doi.org/10.4108/eai.26--102015.150601Google ScholarCross Ref
- Victoria Bellotti and Keith Edwards. 2001. Intelligibility and Accountability: Human Considerations in Contextaware Systems. Hum.-Comput. Interact. 16, 2: 193--212. https://doi.org/10.1207/S15327051HCI16234_05 Google ScholarDigital Library
- Regina Bernhaupt, Marianna Obrist, Astrid Weiss, Elke Beck, and Manfred Tscheligi. 2008. Trends in the living room and beyond: results from ethnographic studies using creative and playful probing. Computers in Entertainment (CIE) 6, 1: 5.Google ScholarDigital Library
- Christoffer Björkskog, Giulio Jacucci, Topi Mikkola, Massimo Bertoncini, Luciano Gamberini, Carin Torstensson, Tatu Nieminen, Luigi Briguglio, Pasquale Andriani, and Giampaolo Fiorentino. 2010. Beaware: A framework for residential services on energy awareness. In UBICOMM 2010, The Fourth International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies, 294--300.Google Scholar
- K. Borner, Unkown, and Unknown. InfoVis CyberInfrastructure- Spring Embedding Algorithm. Retrieved September 5, 2016 from http://iv.slis.indiana.edu/sw/toolkit.htmlGoogle Scholar
- L. Borodulkin, H. Ruser, and H. R. Trankler. 2002. 3D virtual "smart home" user interface. In 2002 IEEE International Symposium on Virtual and Intelligent Measurement Systems, 2002. VIMS '02, 111--115. https://doi.org/10.1109/VIMS.2002.1009367Google Scholar
- Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2: 77--101. Google ScholarCross Ref
- A.J. Bernheim Brush, Bongshin Lee, Ratul Mahajan, Sharad Agarwal, Stefan Saroiu, and Colin Dixon. 2011. Home Automation in the Wild: Challenges and Opportunities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11), 2115-- 2124. https://doi.org/10.1145/1978942.1979249Google ScholarDigital Library
- Leah Buechley, Mike Eisenberg, Jaime Catchen, and Ali Crockett. 2008. The LilyPad Arduino: Using Computational Textiles to Investigate Engagement, Aesthetics, and Diversity in Computer Science Education. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08), 423--432. https://doi.org/10.1145/1357054.1357123Google ScholarDigital Library
- Stuart K. Card, Jock D. Mackinlay, and Ben Shneiderman. 1999. Readings in Information Visualization: Using Vision to Think. Morgan Kaufmann.Google Scholar
- Nico Castelli, Gunnar Stevens, Timo Jakobi, and Niko Schönau. 2016. Beyond Eco-feedback: Using Room as a Context to Design New Eco-support Features at Home. In Advances and New Trends in Environmental and Energy Informatics, Jorge Marx Gomez, Michael Sonnenschein, Ute Vogel, Andreas Winter, Barbara Rapp and Nils Giesen (eds.). Springer International Publishing, 177--195. https://doi.org/10.1007/978--3--319--23455--7_10Google Scholar
- Marshini Chetty, Ja-Young Sung, and Rebecca E. Grinter. 2007. How Smart Homes Learn: The Evolution of the Networked Home and Household. In Proceedings of the 9th International Conference on Ubiquitous Computing (UbiComp '07), 127--144. Google ScholarCross Ref
- Ricardo Costa, Davide Carneiro, Paulo Novais, Luís Lima, José Machado, Alberto Marques, and José Neves. 2009. Ambient assisted living. In 3rd Symposium of Ubiquitous Computing and Ambient Intelligence 2008, 86-- 94. Google ScholarCross Ref
- Enrico Costanza, Sarvapali D. Ramchurn, and Nicholas R. Jennings. 2012. Understanding domestic energy consumption through interactive visualisation: a field study. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing, 216--225. Google ScholarDigital Library
- Sarah Darby. 2006. The effectiveness of feedback on energy consumption. A Review for DEFRA of the Literature on Metering, Billing and direct Displays 486: 2006.Google Scholar
- Luigi De Russis and Fulvio Corno. 2015. HomeRules: A Tangible End-User Programming Interface for Smart Homes. 2109--2114. https://doi.org/10.1145/2702613.2732795Google ScholarDigital Library
- Anind K. Dey, Timothy Sohn, Sara Streng, and Justin Kodama. 2006. iCAP: Interactive Prototyping of ContextAware Applications. In Pervasive Computing, Kenneth P. Fishkin, Bernt Schiele, Paddy Nixon and Aaron Quigley (eds.). Springer Berlin Heidelberg, 254--271. https://doi.org/10.1007/11748625_16Google ScholarDigital Library
- Sebastian Draxler, Gunnar Stevens, Martin Stein, Alexander Boden, and David Randall. 2012. Supporting the social context of technology appropriation: on a synthesis of sharing tools and tool knowledge. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2835--2844. Google ScholarDigital Library
- W. Keith Edwards and Rebecca E. Grinter. 2001. At Home with Ubiquitous Computing: Seven Challenges. In Proceedings of the 3rd International Conference on Ubiquitous Computing (UbiComp '01), 256--272. Google ScholarCross Ref
- Mats Eriksson and Seija Kulkki. 2005. State-of-the-Art in Utilizing Living Labs Approach to User-centric ICT innovation -- a European approach. ResearchGate 15.Google Scholar
- Jean-Daniel Fekete. 2004. The InfoVis Toolkit. In Proceedings of the IEEE Symposium on Information Visualization (INFOVIS '04), 167--174. https://doi.org/10.1109/INFOVIS.2004.64Google ScholarCross Ref
- Stephen Few. 2006. Information Dashboard Design: The Effective Visual Communication of Data. O'Reilly Media, Beijing?; Cambride MA.Google ScholarDigital Library
- Joel E. Fischer, Andy Crabtree, Tom Rodden, James A. Colley, Enrico Costanza, Michael O. Jewell, and Sarvapali D. Ramchurn. 2016. "Just Whack It on Until It Gets Hot": Working with IoT Data in the Home. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 5933--5944. https://doi.org/10.1145/2858036.2858518Google ScholarDigital Library
- Geraldine Fitzpatrick and Greg Smith. 2009. Technology-enabled feedback on domestic energy consumption: Articulating a set of design concerns. Pervasive Computing, IEEE 8, 1: 37--44. Google ScholarDigital Library
- Asbjørn Følstad, Petter Bae Brandtzæg, Jan Gulliksen, Mikael Börjeson, and Pirjo Näkki. 2009. Towards a Manifesto for Living Lab Co-creation. In Human-Computer Interaction -- INTERACT 2009, Tom Gross, Jan Gulliksen, Paula Kotzé, Lars Oestreicher, Philippe Palanque, Raquel Oliveira Prates and Marco Winckler (eds.). Springer Berlin Heidelberg, 979--980. https://doi.org/10.1007/978--3--64203658--3_140Google Scholar
- Jon Froehlich. 2011. Sensing and Feedback of Everyday Activities to Promote Environmental Behaviors. University of Washington.Google Scholar
- Jon Froehlich, Leah Findlater, and James Landay. 2010. The Design of Eco-feedback Technology. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10), 1999--2008. https://doi.org/10.1145/1753326.1753629Google ScholarDigital Library
- Catherine Grevet, Jennifer Mankoff, and Scott D. Anderson. 2010. Design and evaluation of a social visualization aimed at encouraging sustainable behavior. In System Sciences (HICSS), 2010 43rd Hawaii International Conference on, 1--8. Google ScholarDigital Library
- Rebecca E. Grinter, W. Keith Edwards, Mark W. Newman, and Nicolas Ducheneaut. 2005. The Work to Make a Home Network Work. In Proceedings of the Ninth Conference on European Conference on Computer Supported Cooperative Work (ECSCW'05), 469--488. Google ScholarCross Ref
- Yukang Guo, Matt Jones, Benjamin Cowan, and Russell Beale. 2013. Take it personally: personal accountability and energy consumption in domestic households. In CHI'13 Extended Abstracts on Human Factors in Computing Systems, 1467--1472. Google ScholarDigital Library
- Helen Ai He, Saul Greenberg, and Elaine M. Huang. 2010. One size does not fit all: applying the transtheoretical model to energy feedback technology design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 927--936. Google ScholarDigital Library
- Jeffrey Heer, Stuart K. Card, and James A. Landay. 2005. Prefuse: A Toolkit for Interactive Information Visualization. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05), 421--430. https://doi.org/10.1145/1054972.1055031Google ScholarDigital Library
- Steven Houben, Connie Golsteijn, Sarah Gallacher, Rose Johnson, Saskia Bakker, Nicolai Marquardt, Licia Capra, and Yvonne Rogers. 2016. Physikit: Data Engagement Through Physical Ambient Visualizations in the Home. 1608--1619. https://doi.org/10.1145/2858036.2858059Google ScholarDigital Library
- Jan Humble, Andy Crabtree, Terry Hemmings, KarlPetter Åkesson, Boriana Koleva, Tom Rodden, and Pär Hansson. 2003. "Playing with the Bits" User-Configuration of Ubiquitous Domestic Environments. In UbiComp 2003: Ubiquitous Computing, Anind K. Dey, Albrecht Schmidt and Joseph F. McCarthy (eds.). Springer Berlin Heidelberg, 256--263. https://doi.org/10.1007/978--3--540--39653--6_20Google Scholar
- IFTTT. IFTTT. IFTTT / Connect the apps you love. Retrieved September 18, 2016 from https://ifttt.com/recipesGoogle Scholar
- T. Jakobi and T. Schwartz. 2012. Putting the user in charge: End user development for eco-feedback technologies. In Sustainable Internet and ICT for Sustainability (SustainIT), 2012, 1--4.Google Scholar
- Li Jönsson, Loove Broms, and Cecilia Katzeff. 2010. Watt-Lite: Energy Statistics Made Tangible. In Proceedings of the 8th ACM Conference on Designing Interactive Systems (DIS '10), 240--243. https://doi.org/10.1145/1858171.1858214Google ScholarDigital Library
- Ben Kirman, Conor Linehan, Shaun Lawson, Derek Foster, and Mark Doughty. 2010. There's a monster in my kitchen: using aversive feedback to motivate behaviour change. In CHI'10 Extended Abstracts on Human Factors in Computing Systems, 2685--2694. Google ScholarDigital Library
- Jesper Kjeldskov, Mikael B. Skov, Jeni Paay, and Rahuvaran Pathmanathan. 2012. Using mobile phones to support sustainability: a field study of residential electricity consumption. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems, 2347--2356. Google ScholarDigital Library
- Henry Lieberman, Fabio Paternò, Markus Klann, and Volker Wulf. 2006. End-User Development: An Emerging Paradigm. In End User Development, Henry Lieberman, Fabio Paternò and Volker Wulf (eds.). Springer Netherlands, 1--8. https://doi.org/10.1007/1--4020--5386-X_1 Google ScholarCross Ref
- Brian Y. Lim, Anind K. Dey, and Daniel Avrahami. 2009. Why and Why Not Explanations Improve the Intelligibility of Context-aware Intelligent Systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09), 2119--2128. https://doi.org/10.1145/1518701.1519023Google ScholarDigital Library
- Jörn Loviscach. 2011. The design space of personal energy conservation assistants. PsychNology Journal 9, 1: 29--41.Google Scholar
- Sarah Mennicken and Elaine M. Huang. 2012. Hacking the Natural Habitat: An In-the-wild Study of Smart Homes, Their Development, and the People Who Live in Them. In Proceedings of the 10th International Conference on Pervasive Computing (Pervasive'12), 143--160. https://doi.org/10.1007/978--3--642--31205--2_10Google Scholar
- Sarah Mennicken, David Kim, and Elaine May Huang. 2016. Integrating the Smart Home into the Digital Calendar. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 5958--5969. https://doi.org/10.1145/2858036.2858168Google ScholarDigital Library
- Sarah Mennicken, Jo Vermeulen, and Elaine M. Huang. 2014. From Today's Augmented Houses to Tomorrow's Smart Homes: New Directions for Home Automation Research. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '14), 105--115. https://doi.org/10.1145/2632048.2636076Google ScholarDigital Library
- Maurice Mulvenna, William Carswell, Paul Mccullagh, Juan Augusto, Huiru Zheng, Paul Jeffers, Haiying Wang, and Suzanne Martin. 2011. Visualization of data for ambient assisted living services. IEEE Communications Magazine 49, 1: 110--117. https://doi.org/10.1109/MCOM.2011.5681023 Google ScholarDigital Library
- Mark W. Newman. Now We're Cooking: Recipes for End-User Service Composition in the Digital Home. ResearchGate.Google Scholar
- Jakob Nielsen. 1994. Usability engineering. Morgan Kaufmann Publishers, San Francisco, Calif.Google ScholarDigital Library
- Torkel Ödegaard. The leading graph and dashboard builder for visualizing time series metrics. Grafana.org. Retrieved September 18, 2016 from http://grafana.org/Google Scholar
- Corinna Ogonowski, Benedikt Ley, and Jan Hess. 2013. Designing for the living room: long-term user involvement in a living lab. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Google ScholarDigital Library
- Petromil Petkov, Felix Köbler, Marcus Foth, and Helmut Krcmar. 2011. Motivating domestic energy conservation through comparative, community-based feedback in mobile and social media. In Proceedings of the 5th International Conference on Communities and Technologies, 21--30. Google ScholarDigital Library
- James Pierce, William Odom, and Eli Blevis. 2008. Energy Aware Dwelling: A Critical Survey of Interaction Design for Eco-visualizations. In Proceedings of the 20th Australasian Conference on Computer-Human Interaction: Designing for Habitus and Habitat (OZCHI '08), 1--8. https://doi.org/10.1145/1517744.1517746Google ScholarDigital Library
- J. Rodgers and L. Bartram. 2011. Exploring Ambient and Artistic Visualization for Residential Energy Use Feedback. IEEE Transactions on Visualization and Computer Graphics 17, 12: 2489--2497. https://doi.org/10.1109/TVCG.2011.196 Google ScholarDigital Library
- Ana Rosselló-Busquet and José Soler. Towards Efficient Energy Management: Defining HEMS and Smart Grid Objectives. ResearchGate.Google Scholar
- Tobias Schwartz, Sebastian Denef, Gunnar Stevens, Timo Jakobi, Volker Wulf, and Leonardo Ramirez. 2014. What People Do with Consumption Feedback: A LongTerm Living Lab Study of a Home Energy Management System, in: Interacting with Computers, 27 (6), 2015, 551-Google ScholarCross Ref
- Tobias Schwartz, Sebastian Denef, Gunnar Stevens, Leonardo Ramirez, and Volker Wulf. 2013. Cultivating energy literacy: results from a longitudinal living lab study of a home energy management system. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), 1193--1202. https://doi.org/10.1145/2470654.2466154Google ScholarDigital Library
- Anneli Selvefors, M. Karlsson, and Ulrike Rahe. 2013. Use and Adoption of Interactive Energy Feedback Systems. Proceedings of IASDR: 1771--1782. Google ScholarCross Ref
- Ben Shneiderman. 1996. The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations. In Proceedings of the 1996 IEEE Symposium on Visual Languages (VL '96), 336--.Google ScholarDigital Library
- Ben Shneiderman. 2004. Designing the User Interface: Strategies for Effective Human-Computer Interaction. Addison Wesley, Boston.Google ScholarDigital Library
- Martin Stein, Alexander Boden, Dominik Hornung, and Volker Wulf. 2016. Third Spaces in the Age of IoT: A Study on Participatory Design of Complex Systems. In Symposium on Challenges and experiences in designing for an ageing society, 12th International Conference on Designing Interactive Systems (COOP).Google Scholar
- Gunnar Stevens, Volkmar Pipek, and Volker Wulf. 2009. Appropriation Infrastructure: Supporting the Design of Usages. . Springer Berlin Heidelberg, 50--69. Google ScholarDigital Library
- Hong Sun, Vincenzo De Florio, Ning Gui, and Chris Blondia. 2009. Promises and challenges of ambient assisted living systems. In Information Technology: New Generations, 2009. ITNG'09. Sixth International Conference on, 1201--1207.Google ScholarDigital Library
- Vasughi Sundramoorthy, Qi Liu, Grahame Cooper, Nigel Linge, and Joshua Cooper. 2010. DEHEMS: A userdriven domestic energy monitoring system. In Internet of Things (IOT), 2010, 1--8.Google Scholar
- Barnabás Takács and Dávid Hanák. 2006. A mobile system for assisted living with ambient facial interfaces. ResearchGate 2: 33--50.Google Scholar
- Peter Tolmie, Andy Crabtree, Tom Rodden, James Colley, and Ewa Luger. 2016. "This Has to Be the Cats": Personal Data Legibility in Networked Sensing Systems. In Proceedings of the 19th ACM Conference on ComputerSupported Cooperative Work & Social Computing (CSCW '16), 491--502. https://doi.org/10.1145/2818048.2819992Google ScholarDigital Library
- C. Tominski, G. Fuchs, and H. Schumann. 2008. TaskDriven Color Coding. In Information Visualisation, 2008. IV '08. 12th International Conference, 373--380. https://doi.org/10.1109/IV.2008.24Google ScholarDigital Library
- Khai N. Truong, Elaine M. Huang, and Gregory D. Abowd. 2004. CAMP: A Magnetic Poetry Interface for End-User Programming of Capture Applications for the Home. In UbiComp 2004: Ubiquitous Computing, Nigel Davies, Elizabeth D. Mynatt and Itiro Siio (eds.). Springer Berlin Heidelberg, 143--160. https://doi.org/10.1007/978--3540--30119--6_9 Google ScholarCross Ref
- Michael B. Twidale. 2005. Over the Shoulder Learning: Supporting Brief Informal Learning. Computer Supported Cooperative Work (CSCW) 14, 6: 505--547. https://doi.org/10.1007/s10606-005--9007--7Google ScholarCross Ref
- Jong-bum Woo and Youn-kyung Lim. 2015. User Experience in Do-it-yourself-style Smart Homes. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15), 779--790. https://doi.org/10.1145/2750858.2806063Google ScholarDigital Library
- Volker Wulf, Claudia Müller, Volkmar Pipek, David Randall, Markus Rohde, and Gunnar Stevens. 2015. Practice-Based Computing: Empirically Grounded Conceptualizations Derived from Design Case Studies. In Designing Socially Embedded Technologies in the RealWorld. Springer London, 111--150.Google Scholar
- Volker Wulf, Markus Rohde, V Pipek, and G Stevens. 2011. Engaging with practices: design case studies as a research framework in CSCW. Proceedings of the ACM 2011 conference on Computer supported cooperative work: 505--512. Google ScholarDigital Library
- Tae-Jung Yun. 2009. Investigating the impact of a minimalist in-home energy consumption display. In CHI'09 Extended Abstracts on Human Factors in Computing Systems, 4417--4422. Google ScholarDigital Library
- Bin Zhang, Pei-Luen Patrick Rau, and Gavriel Salvendy. 2009. Design and evaluation of smart home user interface: effects of age, tasks and intelligence level. Behaviour & Information Technology 28, 3: 239--249. https://doi.org/10.1080/01449290701573978Google ScholarDigital Library
- openHAB. Retrieved January 1, 2017 from http://www.openhab.org/Google Scholar
Index Terms
- What Happened in my Home?: An End-User Development Approach for Smart Home Data Visualization
Recommendations
The Catch(es) with Smart Home: Experiences of a Living Lab Field Study
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing SystemsSmart home systems are becoming an integral feature of the emerging home IT market. Under this general term, products mainly address issues of security, energy savings and comfort. Comprehensive systems that cover several use cases are typically ...
Who's In Control?: Interactions In Multi-User Smart Homes
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing SystemsAdoption of commercial smart home devices is rapidly increasing, allowing in-situ research in people's homes. As these technologies are deployed in shared spaces, we seek to understand interactions among multiple people and devices in a smart home. We ...
Evolving Needs in IoT Control and Accountability: A Longitudinal Study on Smart Home Intelligibility
A key issue for smart home systems is supporting non-expert users in their management. Whereas feedback design on use cases (such as energy feedback) have gained attention, current approaches to providing awareness on the system state typically provide a ...
Comments