Abstract
Along with the improvement of the key technologies for pervasive computing, the design of applications itself has emerged as a notable research area. A design should decide which features go into the application of supporting its context-awareness and ascertaining how well those features add value for users with an acceptable user experience. This paper initially identifies the challenges in designing and evaluating pervasive applications. It then presents a condensed survey of prototyping techniques and existing toolkits with the aim of understanding how the design issues have been addressed by research prototypes. At the end, we describe various open issues with suggestions of possible ways to extend the capabilities of current prototyping toolkits.
Similar content being viewed by others
Notes
PerCom2010 http://www.percom.org/, Pervasive2010 http://www.pervasive2010.org/, Ubicomp2009 http://www.ubicomp.org/ubicomp2009/.
References
Satyanarayanan M (2001) Pervasive computing: vision and challenges. IEEE Pers Commun 6(8):10–17
Garlan D, Siewiorek DP, Smailagic A, Steenkiste P (2002) Project Aura: toward distraction-free pervasive computing. IEEE Pervas Comput 1(2):22–31
Dertouzos ML (1999) The future of computing. Sci Am 281(2):52–55
Shafer S, Krumm J, Brumitt B, Meyers B, Czerwinski M, Robbins D (1998) The new Easyliving project at Microsoft Research. In: Proceedings of the joint DARPA/NIST smart spaces workshop, pp 127–130
Jones A, Hopper A (2001) The prototype embedded network (PEN). Comput Netw 35:377–390
Edwards WK, Bellotti V, Dey AK, Newman MW (2003) Stuck in the middle: the challenges of user-centered design and evaluation for infrastructure. In: Proceedings of CHI 2003, pp 297–304
Li Y, Landay JA (2008) Activity-based prototyping of ubicomp applications for long-lived, everyday human activities. In: Proceedings of CHI 2008, pp 1303–1312
Li Y, Hong JI, Landay JA (2004) Topiary: a tool for prototyping location-enhanced applications. In: Proceedings of 17th annual ACM symposium user interface software and technology, pp 217–2268
Weis T, Knoll M, Ulbrich A, Mühl G, Brändle A (2007) Rapid prototyping for pervasive applications. IEEE Pervasive Comput 6(2):76–84
Weiser M (1991) The computer for the 21st century. Sci Am 265(3):94–104
Davies N, Landay J, Hudson S, Schmidt A (2005) Guest editors’ introduction: rapid prototyping for ubiquitous computing. IEEE Pervasive Comput 4(4):15–17
Norman DA, Draper SW (1986) User-centered system design: new perspectives on human-computer interaction. Erlbaum, Hillsdale
Miller R (2004) User interface design and implementation. Lecture notes. Massachusetts institute of technology
John BE, Salvucci DD (2005) Multipurpose prototypes for assessing user interfaces in pervasive computing systems. IEEE Pervasive Comput 4(4):27–34
Barton JJ, Vijayaraghavan V (2003) UBIWISE, a simulator for ubiquitous computing systems design. Technical report HPL-2003-93, HP Laboratories
Abowd GD, Hayes GR, Iachello G, Kientz JA, Patel SN, Steven MM, Truong KN (2005) Prototypes and paratypes: mixed methods for designing mobile and ubiquitous computing applications. IEEE Pervasive Comput 4(4):67–73
Lim Y-K, Pangam A, Periyasami S, Aneja S (2006) Comparative analysis of high- and low fidelity prototypes for more valid usability evaluations of mobile devices. In: Proceedings of the 4th Nordic conference on human-computer interaction: changing roles, pp 291–300
Consolvo S, Harrison B, Smith I, Mike Chen, Everitt K, Froehlich J, Landay JA (2006) Conducting in situ evaluations for and with ubiquitous computing technologies. Int J Hum Comput Interact 22(1):107–122
Holleis P (2008) Integrating usability models into pervasive application development. Doctoral thesis, Ludwig Maximilian Muenchen Unitversitaet, Munich, Germany
MacIntyre B, Gandy M, Dow S, Bolter JD (2004) DART: a toolkit for rapid design exploration of augmented reality experiences. In: Proceedings of UIST 2004, pp 197–206
Bannach D, Lukowicz P, Amft O (2008) Rapid prototyping of activity recognition applications. IEEE Pervasive Comput 7(2):22–31
Guo B, Zhang DQ, Imai M (2010) Towards a cooperative programming framework for context-aware applications. Personal and ubiquitous computing. Springer (to appear)
Cao XH, Chen JM, Zhang Y, Su YX (2008) Development of an integrated wireless sensor network micro-environment monitoring system. ISA Trans 47(3):247–255
Grimm R, Davis J, Lemar E, Macbeth A, Swanson S, Anderson T, Bershad B, Borriello G, Gribble S, Wethrall D (2004) System support for pervasive applications. ACM Trans Comput Syst 22(4):421–486
Houde S, Hill C (1997) What do prototypes prototype? In: Helander M, Landauer T, Prabhu P (eds) Handbook of human–computer interaction, 2nd edn. Elsevier, Amsterdam
Stringer M, Rode JA, Toye EF, Blackwell AF, Simpson AR (2005) The Webkit tangible user interface: a case study of iterative prototyping. IEEE Pervasive Comput 4(4):35–41
Fitton D, Cheverst K, Kray C, Dix A, Rouncefield M, Saslis-Lagoudakis G (2005) Rapid prototyping and user-centered design of interactive display based systems. IEEE Pervasive Comput 4(4):58–66
Carter S, Mankoff J, Klemmer SR, Matthews T (2008) Exiting the cleanroom: on ecological validity and ubiquitous computing. Hum Comput Interact 23(1):47–99
Lim Y-K, Stolterman E, Tenenberg J (2008) The anatomy of prototypes: prototypes as filters, prototypes as manifestations of design ideas. ACM Trans Comput Hum Interact 15(2):1–27
Tang L, Yu ZW, Zhou XS, Schiele G, Becker C (2010) PerDE: towards a rapid design and evaluation environment for pervasive application. In: Proceedings of The 7th ACM international conference on pervasive services (ICPS2010), Berlin, Germany, July, 13–15 (to appear)
Bossen C, Jørgensen JB (2004) Context-descriptive prototypes and their application to medicine administration. In: Proceedings of the conference on designing interactive systems: processes, practices, methods, and techniques (DIS2004). ACM Press, pp 297–306
Liu L, Khooshabeh P (2003) Paper or interactive? A study of prototyping techniques for ubiquitous computing environments. In: Proceedings of CHI 2003, pp 1030–1031
Carter S, Mankoff J (2005) Prototypes in the wild: lessons learned from evaluating three ubicomp systems. IEEE Pervasive Comput 4(4):51–57
Mankoff J, Schilit B (1997) Supporting knowledge workers beyond the desktop with PALplates. In: Proceedings of CHI 1997, pp 550–551
Buchenau M, Suri JF (2000) Experience prototyping. In: Proceedings of DIS2000 ACM conference on designing interactive systems, pp 424–433
Curtis G, Vertelney L (1990) Storyboards and sketch prototypes for rapid interface visualization. CHI Tutorial, ACM Press, Reading
John BE, Prevas K, Salvucci DD, Koedinger K (2004) Predictive human performance modeling made easy. In: Proceedings of CHI 2004, pp 455–462
Sohn TY, Dey AK (2003) iCAP: an informal tool for interactive prototyping of context-aware applications. In: Proceedings of CHI 2003, pp 974–975
Sohn T, Dey AK (2004) iCAP: rapid prototyping of context-aware applications. In: Proceedings of CHI 2004, pp 103–129
Dey AK, Abowd GD, Salber D (2001) A conceptual framework and a toolkit for supporting the rapid prototyping of contextaware applications. Hum Comput Interact 16(2–4):97–166
Hong JI, Landay JA (2001) An infrastructure approach to context-aware computing. Cont Aw Comput HCI J 16:287–303
Consolvo S, Amstein L, Franza BR (2002) User study techniques in the design and evaluation of a ubicomp environment. In: Proceedings of the 4th international conference on ubiquitous computing, pp 73–90
Gong RJ, Elkerton J (1990) Designing minimal documentation using a GOMS Model: a usability evaluation of an engineering approach. In: Proceedings of CHI 1990, pp 99–106
Hartmann B, Klemmer SR, Bernstein M, Abdulla L, Burr B, Robinson-Mosher A, Gee J (2006) Reflective physical prototyping through integrated design, test, and analysis. In: Proceedings of UIST 2006: ACM symposium on user interface software and technology, pp 299–308
Anderson JR, Bothell D, Byrne MD, Douglass S, Lebiere C, Qin YL (2004) An integrated theory of the mind. Psychol Rev 111(4):1036–1060
Salvucci DD, Lee FJ (2003) Simple cognitive modeling in a complex cognitive architecture. In: Proceedings of CHI 2003, pp 265–272
Arnstein L, Hung C-Y, Franza R, Zhou QH, Borriello G, Consolvo S, Su J (2002) Labscape: a smart environment for the cell biology laboratory. IEEE Pervasive Comput 1(3):13–21
Sousa JP, Garlan D (2002) Aura: an architectural framework for user mobility in ubiquitous computing environments. In: Proceeding of the 3rd working IEEE/IFIP conference on software architecture, pp 25–31
Henricksen K, Indulska J (2006) Developing context-aware pervasive computing applications: models and approach. J Pervasive Mobile Comput 2(1):37–64
Bihler P, Brunie L, Scuturici VM (2005) Modeling user intention in pervasive service environments. In: Proceedings of the IFIP-EUC 2005, LNCS, vol 3824, pp 977–986
Cypher A (1993) Watch what I do: programming by demonstration. MIT, Cambridge
Dey AK, Hamid R, Beckmann C, Li I, Hsu D (2004) a CAPpella: programming by demonstration of context-aware applications. In: Proceedings of CHI 2004, pp 24–29
Holleis P, Schmidt A (2008) MakeIt: itegrate user interaction times in the design process of mobile applications. In: Proceedings of PERVASIVE 2008, pp 56–74
Ballagas R, Memon F, Reiners R, Borchers J (2007) iStuff mobile: rapidly prototyping new mobile phone interfaces for ubiquitous computing. In: Proceedings of CHI 2007, pp 1107–1116
Ballagas R, Ringel M, Stone M, Borchers J (2003) iStuff: a physical user interface toolkit for ubiquitous computing environments. In: Proceedings of CHI 2003, pp 537–544
Humble J, Crabtree A, Hemmings T, Akesson K, Koleva B, Rodden T, Hansson P (2003) “Playing with the bits” user-configuration of ubiquitous domestic environments. In: Proceedings of UBICOMP 2003, pp 256–263
Truong KN, Huang EM, Abowd GD (2004) CAMP: a magnetic poetry interface for end-user programming of capture applications for the home. In: Proceedings of 6th conference on ubiquitous computing (Ubicomp 2004), pp 143–160
Truong KN, Abowd GD (2004) INCA: a software infrastructure to facilitate the construction and evolution of ubiquitous capture and access applications. In: Proceedings of 2nd international conference on pervasive computing (pervasive 2004), pp 140–157
Truong KN, Abowd GD, Brotherton JA (2001) Who, what, when, where, how: design issues of capture and access applications. In: Proceedings of Ubicomp 2001, pp 209–224
Messer A, Kunjithapatham A, Sheshagiri M, Song H, Kumar P, Nguyen P, Yi KH (2006) InterPlay: a middleware for seamless device integration and task orchestration in a networked home. In: Proceedings of 4th annual ieee international conference on pervasive computing and communications (PerCOM 2006), pp 296–307
Beckmann C, Dey AK (2003) SiteView: tangibly programming active environments with predictive visualization. Technical report IRB-TR-03-025, Intel Research, 2003
Neely S, Stevenson G, Kray C, Mulder I, Connelly K, Siek KA (2008) Evaluating pervasive and ubiquitous systems. IEEE Pervasive Comput 7(3):85–88
O’Neill E, Klepal M, Lewis D, O’Donnell T, O’Sullivan D, Pesch D (2005) A testbed for evaluating human interaction with ubiquitous computing environments. In: Proceedings of 1st international conference on testbeds and research infrastructures for the development of networks and communities, pp 60–69
Nishikawa H, Yamamoto S, Tamai M, Nishigaki K, Kitani T, Shibata N, Yasumoto K, Ito M (2006) UbiREAL: realistic smartspace simulator for systematic testing. In: Proceedings of the 8th international conference on ubiquitous computing (UbiComp 2006), pp 459–467
Morla R, Davies N (2004) Evaluating a location-based application: a hybrid test and simulation environment. IEEE Pervasive Comput 3(3):48–56
Li Y, Landay JA (2008) Into the wild: low-cost ubicomp prototype testing. IEEE Pervasive Comput 41(6):94–97
McFadden T, Henricksen K, Indulska J (2004) Automating context-aware application development. In: Proceedings of ubicomp 1st international workshop on advanced context modelling, reasoning and management, pp 90–95
Dey AK (2000) Providing architectural support for building context-aware applications. Doctoral thesis, Georgia Institute of Technology
Davies N, Gellersen HW (2002) Beyond prototypes: challenges in deploying ubiquitous systems. IEEE Pervasive Comput 1(1):26–35
Anastassova M, Mégard C, Burkhardt JM (2007) Prototype evaluation and user needs analysis in the early design of emerging technologies. In: HCI 2007, LNCS, vol 4550, pp 383–392
Reilly D, Dearman D, Welsman-Dinelle M, Inkpen KM (2005) Evaluating early prototypes in context: trade-offs, challenges, and successes. IEEE Pervasive Comput 4(4):10–18
Acknowledgments
This work is funded by National Natural Science Foundation of China (No. 60903125, 60803044), National High Technology Research and Development Program of China (No. 2009AA011903), the Program for New Century Excellent Talents in University (No. NCET-09-0079) and the Natural Science Basic Research Plan in Shaanxi Province of China (No. 2010JM8033).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Tang, L., Yu, Z., Zhou, X. et al. Supporting rapid design and evaluation of pervasive applications: challenges and solutions. Pers Ubiquit Comput 15, 253–269 (2011). https://doi.org/10.1007/s00779-010-0332-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00779-010-0332-6