Roberto Martinez-Maldonado
Skip Abstract Section
Abstract
The fast-growing proliferation of multi-device systems has been reshaping the contexts in which collaborative activity takes place. The evolving materialisation of multi-device environments (MDEs) is likely to have an impact on foundational CSCW research, in ways that go beyond studying cross-device interaction. Designers, developers and researchers are reporting emerging challenges in understanding, supporting and designing for complex collaborative activity in MDEs. We argue that the theoretical perspective of Instrumental Genesis can help unveil the complex, dynamic relationships between design, people, tools, tasks and activities in technology-rich MDEs. In this paper, we use extracts from our research on collaborative work in an MDE to illustrate how ideas from the theory of Instrumental Genesis can help reveal important aspects of change and stability. We show how collaborative design-in-use contributes to the joint evolution of MDEs and the working practices unfolding within them.
- C. Anslow, P. Campos and J. Jorge. 2017. Collaboration Meets Interactive Spaces. Springer, Switzerland. Google Scholar
Digital Library
- L. J. Bannon and S. Bødker. 1991. Beyond the Interface: Encountering Artifacts in Use. In Designing Interaction, John M. Carroll (Ed.) Cambridge University Press, New York, NY, USA, 227--253 Google ScholarDigital Library
- P. Béguin. 2003. Design as a Mutual Learning Process between Users and Designers. Interacting with Computers 15, 5, 709--730.Google ScholarCross Ref
- P. Beguin and P. Rabardel. 2001. Designing for Instrument-Mediated Activity. Scandinavian Journal of Information Systems 12, 1, 173--190. Google ScholarDigital Library
- A. Belin and Y. Prié. 2012. Diam: Towards a Model for Describing Appropriation Processes through the Evolution of Digital Artifacts. In Proceedings of Designing Interactive Systems Conference (DIS'12). ACM, Newcastle Upon Tyne, UK, 645--654. Google ScholarDigital Library
- S. Bødker. 2006. When Second Wave Hci Meets Third Wave Challenges. In Proceedings of 4th Nordic Conference on Human-Computer Interaction (NordCHI'04). ACM, Oslo, Norway, 1--8. Google ScholarDigital Library
- J. S. Brown, A. Collins and P. Duguid. 1989. Situated Cognition and the Culture of Learning. Educational researcher 18, 1, 32--42.Google Scholar
- T. Cerratto Pargman. 2003. Collaborating with Writing Tools: An Instrumental Perspective on the Problem of Computer-Supported Collaborative Activities. Interacting with computers 15, 6, 737--757.Google Scholar
- T. Cerratto Pargman, J. Nouri and M. Milrad. 2018. Taking an Instrumental Genesis Lens: New Insights into Collaborative Mobile Learning. British Journal of Educational Technology 49, 2, 219--234.Google ScholarCross Ref
- E. Chan, C. Anslow, T. Seyed and F. Maurer. 2016. Envisioning the Emergency Operations Centre of the Future. In Collaboration Meets Interactive Spaces, Craig Anslow, Pedro Campos and Joaquim Jorge (Eds.) Springer Cham, 349--372.Google Scholar
- P. Collins, S. Shukla and D. Redmiles. 2002. Activity Theory and System Design: A View from the Trenches. Computer Supported Cooperative Work (CSCW) 11, 1--2, 55--80. Google ScholarDigital Library
- J. Creswell and V. Clark. 2006. Understanding Mixed Methods Research. In Designing and Conducting Mixed Methods Research.Google Scholar
- F. Decortis, A. Rizzo and B. Saudelli. 2003. Mediating Effects of Active and Distributed Instruments on Narrative Activities. Interacting with Computers 15, 6, 801--830.Google ScholarCross Ref
- N. Denzin and Y. Lincoln. 2000. The Handbook of Qualitative Research (2nd Ed.). Sage, Thousand Oaks.Google Scholar
- P. Dourish. 2003. The Appropriation of Interactive Technologies: Some Lessons from Placeless Documents. Computer Supported Cooperative Work (CSCW) 12, 4, 465--490. Google ScholarDigital Library
- S. Döweling, T. Tahiri, J. Riemann and M. Mühlhäuser. 2016. Collaborative Interaction with Geospatial Data-a Comparison of Paper Maps, Desktop Gis and Interactive Tabletops. In Collaboration Meets Interactive Spaces, Craig Anslow, Pedro Campos and Joaquim Jorge (Eds.) Springer, Cham, 319--348.Google Scholar
- M. Durand. 2013. Human Activity, Social Practices and Lifelong Education: An Introduction. International Journal of Lifelong Education 32, 1, 1--13.Google ScholarCross Ref
- Y. Engestrom. 1999. Innovative Learning in Work Teams: Analyzing Cycles of Knowledge Creation in Practice. Perspectives on activity theory, 377--404.Google Scholar
- Y. Engeström. 1990. Learning, Working and Imagining: Twelve Studies in Activity Theory. Orienta-konsultit Oy, Helsinki, Finland.Google Scholar
- G. Fischer, D. Fogli and A. Piccinno. 2017. Revisiting and Broadening the Meta-Design Framework for End-User Development. In New Perspectives in End-User Development, Fabio Paternò and Volker Wulf (Eds.) Springer, Cham, 61--97.Google Scholar
- V. Folcher. 2003. Appropriating Artifacts as Instruments: When Design-for-Use Meets Design-in-Use. Interacting with Computers 15, 5, 647--663.Google ScholarCross Ref
- J. Grubert, M. Kranz and A. Quigley. 2016. Challenges in Mobile Multi-Device Ecosystems. mUX: The Journal of Mobile User Experience 5, 1, 5.Google ScholarCross Ref
- J. Halloran, Y. Rogers and M. Scaife. 2002. Taking The'no'out of Lotus Notes: Activity Theory, Groupware, and Student Groupwork. In Proceedings of Conference on Computer Support for Collaborative Learning (CSCL'02). International Society of the Learning Sciences, Boulder, USA, 169--178. Google ScholarDigital Library
- C. A. Halverson. 2002. Activity Theory and Distributed Cognition: Or What Does Cscw Need to Do with Theories? Computer Supported Cooperative Work (CSCW) 11, 1--2, 243--267. Google ScholarDigital Library
- J. Hollan, E. Hutchins and D. Kirsh. 2000. Distributed Cognition: Toward a New Foundation for Human-Computer Interaction Research. ACM Transactions on Computer-Human Interaction (TOCHI) 7, 2, 174--196. Google ScholarDigital Library
- L. Homeaian, N. Goyal, J. R. Wallace and S. D. Scott. 2018. Group Vs Individual: Impact of Touch and Tilt Cross-Device Interactions on Mixed-Focus Collaboration. In Proceedings of ACM CHI Conference on Human Factors in Computing Systems (CHI'18). Montreal, QC, Canada, in press. Google ScholarDigital Library
- S. Houben, N. Marquardt, J. Vermeulen, C. Klokmose, J. Schöning, H. Reiterer and C. Holz. 2017. Opportunities and Challenges for Cross-Device Interactions in the Wild. Interactions 24, 5, 58--63. Google ScholarDigital Library
- V. Kaptelinin. 2003. Learning with Artefacts: Integrating Technologies into Activities. Interacting with Computers 15, 6, 831--836.Google ScholarCross Ref
- V. Kaptelinin. 2005. The Object of Activity: Making Sense of the Sense-Maker. Mind, culture, and activity 12, 1, 4--18.Google Scholar
- V. Kaptelinin and L. J. Bannon. 2012. Interaction Design Beyond the Product: Creating Technology-Enhanced Activity Spaces. Human--Computer Interaction 27, 3, 277--309.Google Scholar
- E. Katherine. 2006. Multispace: Enabling Electronic Document Micro-Mobility in Table-Centric, Multi-Device Environments. In Proceedings of Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP 2006). 27--34. Google ScholarDigital Library
- A. Kharrufa, R. Martinez-Maldonado, J. Kay and P. Olivier. 2013. Extending Tabletop Application Design to the Classroom. In Proceedings of International Conference on Interactive Tabletops and Surfaces (ITS'13). ACM, St Andrews, UK, 115--124. Google ScholarDigital Library
- A. N. Leontiev. 1978. Activity, Consciousness, and Personality. Prentice Hall, Englewood Cliffs, NJ.Google Scholar
- J. Lonchamp. 2012. An Instrumental Perspective on Cscl Systems. International Journal of Computer-Supported Collaborative Learning 7, 2, 211--237.Google ScholarCross Ref
- G. Lopez and L. A. Guerrero. 2017. Awareness Supporting Technologies Used in Collaborative Systems: A Systematic Literature Review. In Proceedings of ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW'17). ACM, Portland, Oregon, USA, 808--820. Google ScholarDigital Library
- R. Martinez-Maldonado and P. Goodyear. 2016. Cocodes: Multi-Device Support for Collocated Collaborative Learning Design. In Proceedings of 28th Australian Conference on Computer-Human Interaction. ACM, Launceston, Tasmania, Australia, 185--194. Google ScholarDigital Library
- R. Martinez-Maldonado, P. Goodyear, L. Carvalho, K. Thompson, D. Hernandez-Leo, Y. Dimitriadis, L. P. Prieto and D. Wardak. 2017. Supporting Collaborative Design Activity in a Multi-User Digital Design Ecology. Computers in Human Behavior 71, 327--342. Google ScholarDigital Library
- R. Martinez-Maldonado, P. Goodyear, J. Kay, K. Thompson and L. Carvalho. 2016. An Actionable Approach to Understand Group Experience in Complex, Multi-Surface Spaces. In Proceedings of ACM CHI Conference on Human Factors in Computing Systems (CHI'16). ACM, San Jose, California, USA, 2062--2074. Google ScholarDigital Library
- R. Martinez-Maldonado, J. Kay, S. Buckingham Shum and K. Yacef. 2017. Collocated Collaboration Analytics: Principles and Dilemmas for Mining Multimodal Interaction Data. Human--Computer Interaction, 1--50.Google Scholar
- R. Martinez-Maldonado, T. Power, C. Hayes, A. Abdipranoto, T. Vo, C. Axisa and S. Buckingham-Shum. 2017. Analytics Meet Patient Manikins: Challenges in an Authentic Small-Group Healthcare Simulation Classroom. In Proceedings of International Conference on Learning Analytics and Knowledge (LAK'17). ACM, Vancouver, Canada, 90--94. Google ScholarDigital Library
- A. I. Mørch, V. Caruso and M. D. Hartley. 2017. End-User Development and Learning in Second Life: The Evolving Artifacts Framework with Application. In New Perspectives in End-User Development, Fabio Paternò and Volker Wulf (Eds.) Springer, Cham, 333--358.Google Scholar
- B. A. Nardi. 1996. Context and Consciousness: Activity Theory and Human-Computer Interaction. MIT Press, Cambridge MA. Google ScholarDigital Library
- A. Nolte, R. Brown, C. Anslow, M. Wiechers, A. Polyvyanyy and T. Herrmann. 2016. Collaborative Business Process Modeling in Multi-Surface Environments. In Collaboration Meets Interactive Spaces, Craig Anslow, Pedro Campos and Joaquim Jorge (Eds.) Springer, Cham, 259--286.Google Scholar
- K. O'Leary, T. Dong, J. K. Haines, M. Gilbert, E. F. Churchill and J. Nichols. 2017. The Moving Context Kit: Designing for Context Shifts in Multi-Device Experiences. In Proceedings of Conference on Designing Interactive Systems (DIS'17). ACM, Edinburgh, UK, 309--320. Google ScholarDigital Library
- J. Paay, D. Raptis, J. Kjeldskov, M. B. Skov, E. V. Ruder and B. M. Lauridsen. 2017. Investigating Cross-Device Interaction between a Handheld Device and a Large Display. In Proceedings of ACM CHI Conference on Human Factors in Computing Systems (CHI'17). ACM, San Jose, California, USA, 6608--6619. Google ScholarDigital Library
- T. C. Pargman and Y. Wærn. 2003. Appropriating the Use of a Moo for Collaborative Learning. Interacting with Computers 15, 6, 759--781.Google ScholarCross Ref
- S. Park, C. Gebhardt, R. Rädle, A. Feit, H. Vrzakova, N. Dayama, H.-S. Yeo, C. Klokmose, A. Quigley and A. Oulasvirta. 2018. Adam: Adapting Multi-User Interfaces for Collaborative Environments in Real-Time. In Proceedings of ACM CHI Conference on Human Factors in Computing Systems (CHI'18). ACM, Montréal, Canada, In press. Google ScholarDigital Library
- J. Piaget. 1968. La Naissance De L'intelligence Chez L'enfant. Neuchâtel, Delachaux et Niestle.Google Scholar
- T. Plank, H.-C. Jetter, R. Rädle, C. N. Klokmose, T. Luger and H. Reiterer. 2017. Is Two Enough? Studying Benefits, Barriers, and Biases of Multi-Tablet Use for Collaborative Visualization. In Proceedings of ACM CHI Conference on Human Factors in Computing Systems (CHI'17). ACM, Denver, USA, 4548--4560. Google ScholarDigital Library
- P. Rabardel. 2001. Instrument Mediated Activity in Situations. In People and Computers Xv-Interaction without Frontiers, Springer, 17--30.Google Scholar
- P. Rabardel and P. Beguin. 2005. Instrument Mediated Activity: From Subject Development to Anthropocentric Design. Theoretical Issues in Ergonomics Science 6, 5, 429--461.Google ScholarCross Ref
- P. Rabardel and G. Bourmaud. 2003. From Computer to Instrument System: A Developmental Perspective. Interacting with Computers 15, 5, 665--691.Google ScholarCross Ref
- P. Rabardel and R. Samurçay. 2001. From Artifact to Instrument-Mediated Learning. In Proceedings of Symposium on New challenges to Research on Learning. 21--23.Google Scholar
- G. Ritella and K. Hakkarainen. 2012. Instrumental Genesis in Technology-Mediated Learning: From Double Stimulation to Expansive Knowledge Practices. International Journal of Computer-Supported Collaborative Learning 7, 2, 239--258.Google ScholarCross Ref
- Y. Rogers. 2012. Hci Theory: Classical, Modern, and Contemporary. Synthesis Lectures on Human-Centered Informatics 5, 2, 1--129. Google ScholarCross Ref
- J. Simonsen and T. Robertson. 2012. Routledge International Handbook of Participatory Design. Routledge,Google Scholar
- M. A. Spasser. 2002. Realist Activity Theory for Digital Library Evaluation: Conceptual Framework and Case Study. Computer Supported Cooperative Work (CSCW) 11, 1--2, 81--110. Google ScholarDigital Library
- N. A. Streitz, J. Geißler, T. Holmer, S. i. Konomi, C. Müller-Tomfelde, W. Reischl, P. Rexroth, P. Seitz and R. Steinmetz. 1999. I-Land: An Interactive Landscape for Creativity and Innovation. In Proceedings of ACM CHI Conference on Human Factors in Computing Systems (CHI'99). ACM, Pittsburgh, Pennsylvania, USA, 120--127. Google ScholarDigital Library
- N. A. Streitz, P. Tandler, C. Müller-Tomfelde and S. i. Konomi. 2001. Roomware: Towards the Next Generation of Human-Computer: Interaction Based on an Integrated Design of Real and Virtual Worlds. In Human-Computer Interaction in the New Millenium, John M. Carroll (Ed.) Addison Wesley, New York, NY, 553--578.Google Scholar
- L. Suchman. 1987. Plans and Situated Actions: The Problem of Human-Machine Communication. Cambridge University Press, Cambridge, UK. Google ScholarDigital Library
- L. A. Suchman. 1983. Office Procedure as Practical Action: Models of Work and System Design. ACM Transactions on Information Systems (TOIS) 1, 4, 320--328. Google ScholarDigital Library
- A. L. Tamborg. 2017. Origins, Transformations, and Key Foci in Instrumental Genesis. In Proceedings of Eighth Nordic Conference on Mathematics Education (Norma'17). Nordic Society for Research in Mathematics Education, Stockholm, Sweden, 1--9.Google Scholar
- S. Tausch, S. Ta and H. Hussmann. 2016. A Comparison of Cooperative and Competitive Visualizations for Co-Located Collaboration. In Proceedings of ACM CHI Conference on Human Factors in Computing Systems (CHI'16). ACM, San Jose, California, USA, 5034--5039. Google ScholarDigital Library
- P. Tchounikine. 2017. Designing for Appropriation: A Theoretical Account. Human--Computer Interaction 32, 4, 155--195. Google ScholarDigital Library
- L. Trouche. 2003. From Artifact to Instrument: Mathematics Teaching Mediated by Symbolic Calculators. Interacting with Computers 15, 6, 783--800.Google ScholarCross Ref
- L. Trouche. 2005. Instrumental Genesis, Individual and Social Aspects. In The Didactical Challenge of Symbolic Calculators: Turning a Computational Device into a Mathematical Instrument, Dominique Guin, Kenneth Ruthven and Luc Trouche (Eds.) Springer US, Boston, MA, 197--230.Google Scholar
- P. Verillon and P. Rabardel. 1995. Cognition and Artifacts: A Contribution to the Study of Though in Relation to Instrumented Activity. European Journal of Psychology of Education 10, 1, 77--101.Google ScholarCross Ref
- U. von Zadow, S. Buron, T. Harms, F. Behringer, K. Sostmann and R. Dachselt. 2013. Simmed: Combining Simulation and Interactive Tabletops for Medical Education. In Proceedings of ACM CHI Conference on Human Factors in Computing Systems (CHI'13). ACM, Paris, Frnce, 1469--1478. Google ScholarDigital Library
- J. R. Wallace, S. Oji and C. Anslow. 2017. Technologies, Methods, and Values: Changes in Empirical Research at Cscw 1990--2015. Proc. ACM Hum.-Comput. Interact. 1, 2. Google ScholarDigital Library
- T. White. 2008. Debugging an Artifact, Instrumenting a Bug: Dialectics of Instrumentation and Design in Technology-Rich Learning Environments. International Journal of Computers for Mathematical Learning 13, 1, 1--26.Google ScholarCross Ref
- T. Winograd and F. Flores. 1986. Understanding Computers and Cognition: A New Foundation for Design. Addison Wesley, Menlo Park, California. Google ScholarDigital Library
- J. Zagermann, U. Pfeil, C. Acevedo and H. Reiterer. 2017. Studying the Benefits and Challenges of Spatial Distribution and Physical Affordances in a Multi-Device Workspace. In Proceedings of 16th International Conference on Mobile and Ubiquitous Multimedia (MUM'17) ACM, Stuttgart, Germany, 249--259. Google ScholarDigital Library
- Z. Zhang, A. Sarcevic and C. Bossen. 2017. Constructing Common Information Spaces across Distributed Emergency Medical Teams. In Proceedings of 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, Portland, Oregon, USA, 934--947. Google ScholarDigital Library
Index Terms
- Collaborative Design-in-use: An Instrumental Genesis Lens in Multi-device Environments
Recommendations
Designing for Collaborative Infrastructuring: Supporting Resonance Activities
'Infrastructuring' as a concept draws attention to the way in which a designed artefact or system is not the end of the development process. Rather, technology development takes place up to, and including, its successful establishment in an associated ...
Collaborative Appropriation: How Couples, Teams, Groups and Communities Adapt and Adopt Technologies
CSCW '16 Companion: Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing CompanionPrevious workshops examined how individual users adopt and adapt technologies to meet local needs, “completing design through use.” However, there has been little systematic study of how groups engage collaboratively in these activities. This workshop ...
Designing mediation
ECCE '15: Proceedings of the European Conference on Cognitive Ergonomics 2015The aim of this paper is to analyze the concept of mediation in the context of current HCI research, with a special focus on the use of the concept to inform and guide the design of interactive artifacts and environments. The paper discusses the ...
Comments