Abstract
The field of human–robot interaction (HRI) is young and highly inter-disciplinary, and the approaches, standards and methods proper to it are still in the process of negotiation. This paper reviews the use of qualitative methods and approaches in the HRI literature in order to contribute to the development of a foundation of approaches and methodologies for these new research areas. In total, 73 papers that use qualitative methods were systematically reviewed. The review reveals that there is widespread use of qualitative methods in HRI, but very different approaches to reporting on it, and high variance in the rigour with which the approaches are applied. We also identify the key qualitative methods used. A major contribution of this paper is a taxonomy categorizing qualitative research in HRI in two dimensions: by ’study type’ and based on the specific qualitative method used.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
‘Observation’ as a method is often used interchangeably with ‘ethnography’. However, ‘ethnography’ refers to the descriptive output of a study of people and their social lives. This may involve a suite of methods, as well as qualitative observation.
References
Steinfeld A, Fong T, Kaber D, Lewis M, Scholtz J, Schultz A, Goodrich M (2006) Common metrics for human-robot interaction. In: Proceedings of the 1st ACM SIGCHI/SIGART conference on human–robot interaction, pp 33–40
Yanco HA, Drury JL (2002) A taxonomy for human–robot interaction. In: Proceedings of the AAAI fall symposium on human–robot interaction, sn, pp 111–119
Broekens J, Heerink M, Rosendal H et al (2009) Assistive social robots in elderly care: a review. Gerontechnology 8(2):94–103
Dautenhahn K (2007) Methodology & themes of human-robot interaction: a growing research field. Int J Adv Robot Syst 4(1):15
Bemelmans R, Gelderblom GJ, Jonker P, De Witte L (2012) Socially assistive robots in elderly care: a systematic review into effects and effectiveness. J Am Med Dir Assoc 13(2):114–120
Kachouie R, Sedighadeli S, Khosla R, Chu M-T (2014) Socially assistive robots in elderly care: a mixed-method systematic literature review. Int J Human–Comput Interact 30(5):369–393
Bartneck C, Kulić D, Croft E, Zoghbi S (2009) Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. Int J Soc Robot 1(1):71–81
Bethel CL, Murphy RR (2010) Review of human studies methods in hri and recommendations. Int J Soc Robot 2(4):347–359
Shah SK, Corley KG (2006) Building better theory by bridging the quantitative–qualitative divide. J Manag Stud 43(8):1821–1835
Lindblom J, Andreasson R (2016) Current challenges for ux evaluation of human–robot interaction. In: Advances in ergonomics of manufacturing: managing the enterprise of the future. Springer, pp 267–277
Patton MQ (1990) Qualitative evaluation and research methods. SAGE Publications, inc, London
Rehm M, Krummheuer AL, Rodil K, Nguyen M, Thorlacius B (2016) From social practices to social robots–user-driven robot development in elder care. In: International conference on social robotics. Springer, pp 692–701
Frennert S, Östlund B (2014) Seven matters of concern of social robots and older people. Int J Soc Robot 6(2):299–310
Petrie H, Darzentas J (2017) Older people and robotic technologies in the home: perspectives from recent research literature. In: Proceedings of the 10th international conference on pervasive technologies related to assistive environments. ACM, pp 29–36
Mordoch E, Osterreicher A, Guse L, Roger K, Thompson G (2013) Use of social commitment robots in the care of elderly people with dementia: a literature review. Maturitas 74(1):14–20
Kjeldskov J, Graham C (2003) A review of mobile HCI research methods. In: International conference on mobile human–computer interaction. Springer, pp 317–335
Davy D, Valecillos C (2009) Summary of a literature review of qualitative research in technical communication from 2003 to 2007. In: 2009 IEEE international professional communication conference. IEEE, pp 1–7
Coradeschi S, Kristoffersson A, Loutfi A, Von Rump S, Cesta A, Cortellessa G, Gonzalez J (2011) Towards a methodology for longitudinal evaluation of social robotic telepresence for elderly. In: Human robot interaction
Virnes M (2008) Robotics in special needs education. In: Proceedings of the 7th international conference on Interaction design and children, pp 29–32
Kraft K (2016) Robots against infectious diseases. In: 2016 11th ACM/IEEE international conference on human–robot interaction (HRI). IEEE, pp 627–628
Beer JM, Fisk AD, Rogers WA (2014) Toward a framework for levels of robot autonomy in human-robot interaction. J Human–Robot Interact 3(2):74–99
Bellotto N, Hanheide M, Van de Weghe N (2013) Qualitative design and implementation of human–robot spatial interactions. In: International conference on social robotics. Springer, pp 331–340
Fabbri C, Sattar J (2016) Smarttalk: a learning-based framework for natural human–robot interaction. In: 2016 13th conference on computer and robot vision (CRV). IEEE, pp 376–382
Frauenberger C, Makhaeva J, Spiel K (2017) Blending methods: developing participatory design sessions for autistic children. In: Proceedings of the 2017 conference on interaction design and children, pp 39–49
Forlizzi J, DiSalvo C, Gemperle F (2004) Assistive robotics and an ecology of elders living independently in their homes. Human–Comput Interact 19(1):25–59
Forlizzi J, DiSalvo C (2006) Service robots in the domestic environment: a study of the roomba vacuum in the home. In: Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction. ACM, pp 258–265
Sung J, Christensen HI, Grinter RE ((2009)) Robots in the wild: understanding long-term use. In: Proceedings of the 4th ACM/IEEE international conference on Human robot interaction. ACM, pp 45–52
Fink J, Bauwens V, Kaplan F, Dillenbourg P (2013) Living with a vacuum cleaning robot. Int J Soc Robot 5(3):389–408
Sabelli AM, Kanda T, Hagita N (2011) A conversational robot in an elderly care center: an ethnographic study. In: 2011 6th ACM/IEEE international conference on human–robot interaction (HRI). IEEE, pp 37–44
Chang W-L, Šabanovic S (2013) Potential use of robots in Taiwanese nursing homes. In: Proceedings of the 8th ACM/IEEE international conference on human–robot interaction. IEEE Press, pp 99–100
Welfare KS, Hallowell MR, Shah JA, Riek LD (2019) Consider the human work experience when integrating robotics in the workplace. In: 2019 14th ACM/IEEE international conference on human–robot interaction (HRI). IEEE, pp 75–84
Alami A, Dittrich Y, Wasowski A (2018) Influencers of quality assurance in an open source community. In: 2018 IEEE/ACM 11th international workshop on cooperative and human aspects of software engineering (CHASE). IEEE, pp 61–68
Frennert S, Eftring H, Östlund B (2013) What older people expect of robots: a mixed methods approach. In: International conference on social robotics. Springer, pp 19–29
Cheon E, Su NM (2018) Futuristic autobiographies: weaving participant narratives to elicit values around robots. In: Proceedings of the 2018 ACM/IEEE international conference on human–robot interaction. ACM, pp 388–397
Mutlu B, Forlizzi J (2008) Robots in organizations: the role of workflow, social, and environmental factors in human-robot interaction. In: Proceedings of the 3rd ACM/IEEE international conference on human robot interaction. ACM, pp 287–294
Robert D, Breazeal C (2012) Blended reality characters. In: Proceedings of the seventh annual ACM/IEEE international conference on human–robot interaction. ACM, pp 359–366
Forlizzi J (2007) How robotic products become social products: an ethnographic study of cleaning in the home. In: Proceedings of the ACM/IEEE international conference on human–robot interaction. ACM, pp 129–136
Forlizzi J (2008) The product ecology: understanding social product use and supporting design culture. Int J Des 2(1):11–20
Sung J, Grinter RE, Christensen HI (2010) Domestic robot ecology. Int J Soc Robot 2(4):417–429
Nielsen S, Bonnerup E, Hansen AK, Nilsson J, Nellemann LJ, Hansen KD, Hammcrshoi D (2018) Subjective experience of interacting with a social robot at a Danish airport. In: 2018 27th IEEE international symposium on robot and human interactive communication (RO-MAN). IEEE, pp 1163–1170
DiSalvo C, Louw M, Holstius D, Nourbakhsh I, Akin A (2012) Toward a public rhetoric through participatory design: critical engagements and creative expression in the neighborhood networks project. Des Issues 28(3):48–61
Neven L (2010) but obviously not for me’: robots, laboratories and the defiant identity of elder test users. Sociol Health Illn 32(2):335–347
Alenljung B, Andreasson R, Billing EA, Lindblom J, Lowe R (2017) User experience of conveying emotions by touch. In: 2017 26th IEEE international symposium on robot and human interactive communication (RO-MAN). IEEE, pp 1240–1247
Hebesberger D, Dondrup C, Koertner T, Gisinger C, Pripfl J (2016) Lessons learned from the deployment of a long-term autonomous robot as companion in physical therapy for older adults with dementia: a mixed methods study. In: The eleventh ACM/IEEE international conference on human robot interaction. IEEE Press, pp 27–34
Huang L (2017) Qualitative analysis of the application of self-determination theory in robotics tournaments. In: Proceedings of the companion of the 2017 ACM/IEEE international conference on human–robot interaction. ACM, pp 135–136
Lohan KS, Pitsch K, Rohlfing KJ, Fischer K, Saunders J, Lehmann H, Nehaniv C, Wrede B (2011) Contingency allows the robot to spot the tutor and to learn from interaction. In: 2011 IEEE international conference on development and learning (ICDL), vol 2. IEEE, pp 1–8
Girotto V, Lozano C, Muldner K, Burleson W, Walker E (2016) Lessons learned from in-school use of rtag: a robo-tangible learning environment. In: Proceedings of the 2016 CHI conference on human factors in computing systems. ACM, pp 919–930
Ogawa K, Chikaraishi T, Yoshikawa Y, Nishiguchi S, Hirata O, Ishiguro H (2014) Designing robot behavior in conversations based on contemporary colloquial theatre theory. In: The 23rd IEEE international symposium on robot and human interactive communication. IEEE, pp 168–173
Pino M, Boulay M, Jouen F, Rigaud AS (2015) “are we ready for robots that care for us?” attitudes and opinions of older adults toward socially assistive robots. Frontiers Aging Neurosci 7:141
Worthy P, Boden M, Karimi A, Weigel J, Matthews B, Hensby K, Heath S, Pounds P, Taufatofua J, Smith M et al (2015) Children’s expectations and strategies in interacting with a wizard of oz robot. In Proceedings of the annual meeting of the Australian special interest group for computer human interaction. ACM, pp 608–612
Wiles J, Worthy P, Hensby K, Boden M, Heath S, Pounds P, Rybak N, Smith M, Taufaofua J, Weigel J (2016) Social cardboard: pretotyping a social ethnodroid in the wild. In: The eleventh ACM/IEEE international conference on human robot interaction. IEEE Press, pp 531–532
Rose EJ, Björling EA (2017) Designing for engagement: using participatory design to develop a social robot to measure teen stress. In: Proceedings of the 35th ACM international conference on the design of communication. ACM, p 7
Threatt AL, Merino J, Brooks JO, Healy S, Truesdail C, Manganelli J, Walker I, Green KE (2017) The design, prototyping, and formative evaluation of an assistive robotic table (art) for stroke patients. HERD Health Environ Res Des J 10(3):152–169
Paauwe RA, Keyson DV, Hoorn JF, Konijn EA (2015) Minimal requirements of realism in social robots: designing for patients with acquired brain injury. In: Proceedings of the 33rd annual ACM conference extended abstracts on human factors in computing systems. ACM, pp 2139–2144
Azenkot S, Feng C, Cakmak M (2016) Enabling building service robots to guide blind people a participatory design approach. In: 2016 11th ACM/IEEE international conference on human–robot interaction (HRI). IEEE, pp 3–10
Förster F, Weiss A, Tscheligi M (2011) Anthropomorphic design for an interactive urban robot-the right design approach? In: 2011 6th ACM/IEEE international conference on human–robot interaction (HRI). IEEE, pp 137–138
Hirsch L, Björsell A, Laaksoharju M, Obaid M (2017) Investigating design implications towards a social robot as a memory trainer. In: Proceedings of the 5th international conference on human agent interaction. ACM, pp 5–10
Lee HR, Šabanović S, Chang W-L, Hakken D, Nagata S, Piatt J, Bennett C (2017) Steps toward participatory design of social robots: mutual learning with older adults with depression. In: 2017 12th ACM/IEEE international conference on human–robot interaction (HRI). IEEE, pp 244–253
Joshi S, Šabanović S (2019) Robots for inter-generational interactions: implications for nonfamilial community settings. In: 2019 14th ACM/IEEE international conference on human–robot interaction (HRI). IEEE, pp 478–486
Silvera-Tawil D, Bradford D, Roberts-Yates C (2018) Talk to me: The role of human–robot interaction in improving verbal communication skills in students with autism or intellectual disability. In: 2018 27th IEEE international symposium on robot and human interactive communication (RO-MAN). IEEE, pp 1–6
Winkle K, Caleb-Solly P, Turton A, Bremner P (2018) Social robots for engagement in rehabilitative therapies: Design implications from a study with therapists. In: Proceedings of the 2018 ACM/IEEE international conference on human–robot interaction. ACM, pp 289–297
Caleb-Solly P, Dogramadzi S, Ellender D, Fear T, Heuvel Hvd (2014) A mixed-method approach to evoke creative and holistic thinking about robots in a home environment. In: Proceedings of the 2014 ACM/IEEE international conference on human–robot interaction. ACM, pp 374–381
Bodker S, Pekkola S (2010) A short review to the past and present of participatory design. Scand J Inf Syst 22(1):45–48
Luria M, Forlizzi J, Hodgins J (2018) The effects of eye design on the perception of social robots. In: 2018 27th IEEE international symposium on robot and human interactive communication (RO-MAN), IEEE, pp 1032–1037
Dziergwa M, Frontkiewicz M, Kaczmarek P, Kedzierski J, Zagdańska M (2013) Study of a social robot’s appearance using interviews and a mobile eye-tracking device. In: International conference on social robotics. Springer, pp 170–179
Fischer K, Lohan K, Saunders J, Nehaniv C, Wrede B, Rohlfing K (2013) The impact of the contingency of robot feedback on HRI. In: 2013 international conference on collaboration technologies and systems (CTS). IEEE, pp 210–217
Lee MK, Forlizzi J, Kiesler S, Rybski P, Antanitis J, Savetsila S (2012) Personalization in HRI: a longitudinal field experiment. In: 2012 7th ACM/IEEE international conference on human–robot interaction (HRI). IEEE, pp 319–326
Leite I, Castellano G, Pereira A, Martinho C, Paiva A (2014) Empathic robots for long-term interaction. Int J Soc Robot 6(3):329–341
Robins B, Dautenhahn K, Dickerson P (2009) From isolation to communication: a case study evaluation of robot assisted play for children with autism with a minimally expressive humanoid robot. In: 2009 second international conferences on advances in computer–human interactions. IEEE, pp 205–211
Straub I, Nishio S, Ishiguro H (2010) Incorporated identity in interaction with a teleoperated android robot: a case study. In: 19th international symposium in robot and human interactive communication. IEEE, pp 119–124
Cha E, Forlizzi J, Srinivasa SS (2015) Robots in the home: qualitative and quantitative insights into kitchen organization. In: Proceedings of the tenth annual ACM/IEEE international conference on human–robot interaction. ACM, pp 319–326
Chang W-L, Šabanović S (2015) Studying socially assistive robots in their organizational context: Studies with paro in a nursing home. In: Proceedings of the tenth annual ACM/IEEE international conference on human–robot interaction extended abstracts. ACM, pp 227–228
Frennert S, Eftring H, Östlund B (2017) Case report: Implications of doing research on socially assistive robots in real homes. Int J Soc Robot 9(3):401–415
Khaksar SMS, Khosla R, Chu M-T (2015) Socially assistive robots in service innovation context to improve aged-care quality: a grounded theory approach. In: 2015 IEEE 7th international conference on cybernetics and intelligent systems (CIS) and IEEE conference on robotics, automation and mechatronics (RAM). IEEE, pp 161–166
Leite I, Castellano G, Pereira A, Martinho C, Paiva A (2012) Modelling empathic behaviour in a robotic game companion for children: an ethnographic study in real-world settings. In: Proceedings of the seventh annual ACM/IEEE international conference on human–robot interaction. ACM, pp 367–374
Robinson H, Broadbent E, MacDonald B (2016) Group sessions with p aro in a nursing home: structure, observations and interviews. Australas J Ageing 35(2):106–112
Wasén K (2005) Person-friendly robot interaction: social, psychological and technological impacts in health care work. In: ROMAN 2005. IEEE international workshop on robot and human interactive communication, 2005. IEEE, pp 643–648
Forlizzi J, Saensuksopa T, Salaets N, Shomin M, Mericli T, Hoffman G (2016) Let’s be honest: a controlled field study of ethical behavior in the presence of a robot. In: 2016 25th IEEE international symposium on robot and human interactive communication (RO-MAN). IEEE, pp 769–774
Melkas H, Hennala L, Pekkarinen S, Kyrki V (2016) Human impact assessment of robot implementation in finnish elderly care. In: International conference on serviceology, pp 202–206
Robins B, Dautenhahn K, Dickerson P (2012) Embodiment and cognitive learning—can a humanoid robot help children with autism to learn about tactile social behaviour? In: International conference on social robotics. Springer, pp 66–75
Kim ES, Paul R, Shic F, Scassellati B (2012) Bridging the research gap: making HRI useful to individuals with autism. J Human–Robot Interact 1(1):26–54
von der Pütten AM, Krämer NC, Becker-Asano C, Ishiguro H (2011) An android in the field. In: Proceedings of the 6th international conference on human–robot interaction. ACM, pp 283–284
Firestone JW, Quiñones R, Duncan BA (2019) Learning from users: an elicitation study and taxonomy for communicating small unmanned aerial system states through gestures. In: 2019 14th ACM/IEEE international conference on human–robot interaction (HRI). IEEE, pp 163–171
Hutson S, Lim SL, Bentley PJ, Bianchi-Berthouze N, Bowling A (2011) Investigating the suitability of social robots for the wellbeing of the elderly. In: International conference on affective computing and intelligent interaction. Springer, pp 578–587
Wu Y-H, Wrobel J, Cristancho-Lacroix V, Kamali L, Chetouani M, Duhaut D, Le Pévédic B, Jost C, Dupourque V, Ghrissi M et al (2013) Designing an assistive robot for older adults: the robadom project. IRBM 34(2):119–123
H. Lehmann, M. L. Walters, A. Dumitriu, A. May, K. L. Koay, J. Saez-Pons, D. S. Syrdal, L. Wood, J. Saunders, N. Burke, et al. (2013) Artists as HRI pioneers: a creative approach to developing novel interactions for living with robots. In: International conference on social robotics. Springer, pp 402–411
Kory Westlund J, Gordon G, Spaulding S, Lee JJ, Plummer L, Martinez M, Das M, Breazeal C (2016) Lessons from teachers on performing hri studies with young children in schools. In: The eleventh ACM/IEEE international conference on human robot interaction. IEEE Press, pp 383–390
Wu Y-H, Wrobel J, Cornuet M, Kerhervé H, Damnée S, Rigaud A-S (2014) Acceptance of an assistive robot in older adults: a mixed-method study of human-robot interaction over a 1-month period in the living lab setting. Clin Intervent Aging 9:801
Hyun E, Yoon H, Son S (2010) Relationships between user experiences and children’s perceptions of the education robot. In: Proceedings of the 5th ACM/IEEE international conference on human–robot interaction. IEEE Press, pp 199–200
Elprama SA, Jewell CI, Jacobs A, El Makrini I, Vanderborght B (2017) Attitudes of factory workers towards industrial and collaborative robots. In: Proceedings of the companion of the 2017 ACM/IEEE international conference on human–robot interaction. ACM, pp 113–114
Patton MQ (2015) Qualitative research & evaluation tools, 4th edn. Sage, Los Angeles
Suzuki D, Umemuro H (2012) Dimensions of people’s attitudes toward robots. In: Proceedings of the seventh annual ACM/IEEE international conference on human–robot interaction, ACM, pp 249–250
Bedaf S, Gelderblom GJ, de Witte L, Syrdal D, Lehmann H, Amirabdollahian F, Dautenhahn K, Hewson D (2013) Selecting services for a service robot: evaluating the problematic activities threatening the independence of elderly persons. In: 2013 IEEE 13th international conference on rehabilitation robotics (ICORR). IEEE, pp 1–6
Kim R, Kwak SS, Lim Y-K, Kim M-S (2009) Focus group interview for designing a growing robot. In: 2009 4th ACM/IEEE international conference on human–robot interaction (HRI). IEEE, pp 305–306
Stadler S, Weiss A, Mirnig N, Tscheligi M (2013) Anthropomorphism in the factory: a paradigm change? In: Proceedings of the 8th ACM/IEEE international conference on human–robot interaction. IEEE Press, pp 231–232
Weiss A, Wurhofer D, Lankes M, Tscheligi M (2009) Autonomous vs. tele-operated: how people perceive human-robot collaboration with hrp-2. In: 2009 4th ACM/IEEE international conference on human–robot interaction (HRI). IEEE, pp 257–258
Krupp MM, Rueben M, Grimm CM, Smart WD (2017) Privacy and telepresence robotics: what do non-scientists think?. In: Proceedings of the companion of the 2017 ACM/IEEE international conference on human–robot interaction. ACM, pp 175–176
Wu Y-H, Fassert C, Rigaud A-S (2012) Designing robots for the elderly: appearance issue and beyond. Arch Gerontol Geriatr 54(1):121–126
Syrdal DS, Dautenhahn K, Koay KL, Walters ML, Otero NR (2010) Exploring human mental models of robots through explicitation interviews. In: 19th international symposium in robot and human interactive communication. IEEE, pp 638–645
Joosse M, Lohse M, Evers V (2015) Crowdsourcing culture in HRI: lessons learned from quantitative and qualitative data collections. In: 3rd international workshop on culture aware robotics at ICSR, vol 15
Haynes A, Simons MF, Helps T, Nakamura Y, Rossiter J (2019) A wearable skin-stretching tactile interface for human–robot and human–human communication. IEEE Robot Autom Lett 4(2):1641–1646
Paetzel M, Hupont I, Varni G, Chetouani M, Peters C, Castellano G (2017) Exploring the link between self-assessed mimicry and embodiment in HRI. In: Proceedings of the companion of the 2017 ACM/IEEE international conference on human–robot interaction. ACM, pp 245–246
Feingold Polak R, Elishay A, Shachar Y, Stein M, Edan Y, Levy Tzedek S (2018) Differences between young and old users when interacting with a humanoid robot: a qualitative usability study. In: Companion of the 2018 ACM/IEEE international conference on human–robot interaction. ACM, pp 107–108
Funding
This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
List of Papers Excluded from Review
List of Papers Excluded from Review
Code:
-
NS - No study, or study not substantially described
-
NQ - No qualitative or a different meaning of ‘qualitative’
-
OQ - Other qualitative (not specifically, or primarily, related to robotics)
-
D - Exact duplicate or related to another study already included.
Author | Title | Stage | Code |
|---|---|---|---|
Al-Badry | Possibilities in Robot Stop-Motion | 2 | NS |
Alac | Social robots: Things or agents? | 2 | NS |
Morana et al. | When a robot is social: Spatial arrangements and multimodal semiotic engagement in the practice of social robotics | 2 | NS |
Anastassakis et al. | Design and Its Movements in Times of a Widespread Participation | 2 | OQ |
Anzalone et al. | Evaluating the Engagement with Social Robots | 2 | NQ |
Baba | Science, Technology and Society Revisited: What is Happening to Anthropology and Ethnography? | 2 | NS |
Barnett et al. | Investigating User Perceptions of HRI: A Marketing Approach, | 3 | NQ |
Beer et al. | The domesticated robot: design guidelines for assisting older adults to age in place | 2 | NQ |
Beer et al. | Toward a framework for levels of robot autonomy in human–robot interaction | 3 | NQ |
Beer et al. | Robot assisted music therapy a case study with children diagnosed with autism | 2 | NQ |
Beir and Vanderborght | Evolutionary method for robot morphology: Case study of social robot Probo | 2 | NQ |
Bellotto et al. | Qualitative design and implementation of human–robot spatial interactions | 3 | NQ |
Bemelmans et al. | Socially Assistive Robots in Elderly Care: A Systematic Review into Effects and Effectiveness | 2 | NS |
Beran and Ramirez-Serrano | Do children perceive robots as alive? Children’s attributions of human characteristics | 3 | NS |
Bethel and Murphy, | Review of human studies methods in HRI and recommendations,” | 2 | NS |
Bjorling et al. | Teen–Robot Interaction: A Pilot Study of Engagement with a Low-fidelity Prototype | 2 | NS |
Blond | Encountering robots in the field: How ethnographic studies of robots in practice benefit HRI | 2 | NS |
Bradshaw et al. | Human-agent-robot Teamwork | 2 | NQ |
Broekens et al. | Assistive social robots in elderly care: a review | 2 | NS |
Buchner et al. | User Experience of Industrial Robots over Time | 2 | NQ |
Carlmeyer et al. | The Hesitating Robot - Implementation and First Impressions | 2 | NS |
Casper and Murphy | Human–robot interactions during the robot-assisted urban search and rescue response at the World Trade Center | 3 | NS |
Chang and Šabanoviś | Exploring Taiwanese nursing homes as product ecologies for assistive robots | 3 | D |
Chen et al. | Pedestrian–Robot Interaction Experiments in an Exit Corridor | 2 | NQ |
Cheon and Su | Integrating Roboticist Values into a Value Sensitive Design Framework for Humanoid Robots | 2 | NS |
Choi et al. | Are You Embarrassed?: The Impact of Robot Types on Emotional Engagement with a Robot | 3 | NQ |
Chrysostomou et al. | Towards Reproducible HRI Experiments: Scientific Endeavors, Benchmarking and Standardization | 2 | NS |
Conti et al. | Kindergarten Children Attitude Towards Humanoid Robots: What is the Effect of the First Experience? | 2 | NS |
Coradeschi et al., | Towards a methodology for longitudinal evaluation of social robotic telepresence for elderly, | 3 | NS |
Cousins et al. | Development of a mixed reality based interface for human robot interaction | 2 | NQ |
Dautenhahn | Socially intelligent robots: dimensions of human–robot interaction | 3 | NS |
DiFranzo et al. | Linked Ethnographic Data: From Theory to Practice | 2 | OQ |
Dourish | Implications for Design | 2 | OQ |
Dragan et al. | Effects of Robot Motion on Human–Robot Collaboration | 3 | NQ |
Enz et al. | The social role of robots in the future–explorative measurement of hopes and fears | 2 | NQ |
Eyssel and Pfundmair | Predictors of psychological anthropomorphization, mind perception, and the fulfillment of social needs: A case study with a zoomorphic robot | 2 | NQ |
Fabbri and Sattar | SmartTalk: A Learning-Based Framework for Natural Human–Robot Interaction | 3 | NQ |
Farulla and Lamprecht | Model checking of security properties: A case study on Human–Robot Interaction processes | 2 | NQ |
Figueroa et al. | Learning Complex Sequential Tasks from Demonstration: A Pizza Dough Rolling Case Study | 2 | NQ |
Fink and Bauwens | People’s Perception of a Domestic Service Robot | 2 | D |
Fink et al. | People’s Perception of Domestic Service Robots: Same Household, Same Opinion? | 3 | NQ |
Fink et al. | HRI in the home: A Longitudinal Ethnographic Study with Roomba | 2 | D |
Fitter and Kuchenbecker | Qualitative User Reactions to a Hand-Clapping Humanoid Robot | 3 | NS |
Forlizzi | How robotic products become social products: An ethnographic study of cleaning in the home | 3 | D |
Frauenberger et al. | Blending Methods: Developing Participatory Design Sessions for Autistic Children | 3 | OQ |
Frennert and Ostlund | Seven matters of concern of social robots and older people | 2 | NS |
Fussell et al. | How people anthropomorphize robots | 3 | NQ |
Hakken and MatZ, | The Culture Question in Participatory Design | 2 | NS |
Hancock et al. | A meta-analysis of factors affecting trust in human–robot interaction | 2 | NQ |
Hannibal | Bringing the Notion of Everyday Life Back to the Center of Social Robotics and HRI | 2 | NS |
Hansen et al. | Identifying Stakeholder Perspectives in a Large Collaborative Project: An ICT4D Case Study | 2 | OQ |
Harvey et al. | HCI As a Means to Prosociality in the Economy | 2 | OQ |
Hasse | The Use of Ethnography to Identify and Address Ethical, Legal, and Societal (ELS) Issues | 2 | NS |
Henkel and Bethel | A Robot Forensic Interviewer: The BAD, the GOOD, and the Undiscovered | 2 | NS |
Hoa and Cabibihan | Cute and Soft: Baby Steps in Designing Robots for Children with Autism | 3 | NS |
Huber and Weiss | Developing Human–Robot Interaction for an Industry 4.0 Robot: How Industry Workers Helped to Improve Remote-HRI to Physical-HRI | 2 | NQ |
Hyrjak et al. | Utilising Online Qualitative Methods for Web Science | 2 | OQ |
Jack et al. | Four not six: Revealing culturally common facial expressions of emotion | 2 | NQ |
Jeong | Fribo: A Social Networking Robot for Increasing Social Connectedness through Sharing Daily Home Activities from Living Noise Data | 3 | NQ |
Jipson and Gelman | Robots and rodents: children’s inferences about living and nonliving kinds | 3 | NS |
Jorgenson | Appeal and Perceived Naturalness of a Soft Robotic Tentacle | 2 | NQ |
Jou et al. | Learning robotics in interactive Web-based environments by PBL | 2 | OQ |
Kashi et al. | Playing the Mirror Game with a Robot: Who Takes the Lead, and What Movements Are Most | 2 | NQ |
Kim | A Contextual Inquiry of AVEC: Power Assist Wheelchair Enhancing Communication | 2 | NS |
Kim et al., | Social robots as embedded reinforcers of social behavior in children with autism | 2 | NQ |
Kim et al. | Development and assessment of a hand assist device: GRIPIT | 2 | OQ |
Kim et al. | User-centered HRI: HRI research methodology for designers | 3 | NS |
Kim et al. | Exploring the User Experience for Autonomous Vehicle and the Role of Windshield Display: Based on Framework Approach | 2 | OQ |
Koay et al. | Living with Robots: Investigating the Habituation Effect in Participants’ Preferences During a Longitudinal Human–Robot Interaction Study | 3 | NS |
Kraft | Robots Against Infectious Diseases | 3 | NS |
Kriglstein et al. | Experiences and Challenges with Evaluation Methods in Practice: A Case Study | 2 | NS |
Kriz et al. | Robot-directed Speech As a Means of Exploring Conceptualizations of Robots, | 3 | NQ |
Lee et al. | Robots for Social Good: Exploring Critical Design for HRI | 2 | NS |
Lenz et al. | The BERT2 infrastructure: An integrated system for the study of human–robot interaction | 2 | NQ |
Li et al. | Robot in Charge: A Relational Study Investigating Human–Robot Dyads with Differences in Interpersonal Dominance | 2 | NQ |
Lindblom et al. | Current challenges for UX evaluation of human–robot interaction. | 3 | NS |
Llungblad | Critical robotics: exploring a new paradigm | 2 | NS |
Louie et al. | Playing a memory game with a socially assistive robot: A case study at a long-term care facility | 3 | NQ |
Lucking | Geographically Distributed Deployment of Reproducible HRI Experiments in an Interdisciplinary Research Context | 2 | NS |
Malmir et al. | Home Alone: Social Robots for Digital Ethnography of Toddler Behavior | 3 | NQ |
Manohar et al. | Expressing emotions through robots: A case study using off-the-shelf programming interfaces | 3 | NQ |
Martelaro et al. | Tell me more: Designing hri to encourage more trust, disclosure, and companionship | 2 | NQ |
Martini et al. | Seeing Minds in Others - Can Agents with Robotic Appearance Have Human-Like Preferences? | 2 | NQ |
McGinn et al. | Meeting Stevie: Perceptions of a Socially Assistive Robot by Residents and Staff in a Long-Term Care Facility | 2 | NS |
Mordoch et al. | Use of social commitment robots in the care of elderly people with dementia: A literature review | 2 | NS |
Morewedge et al. | Timescale bias in the attribution of mind | 2 | NQ |
Morrison et al. | Mixing Quantitative with Qualitative Methods: Current Practices in Designing Experiments, Gathering Data and Analysis with Mixed Methods Reporting, | 2 | OQ |
Mushiaki | Ethica ex machina: issues in roboethics | 2 | NS |
Nature editorial | Let’s talk about sex robots | 2 | NS |
Niculescu et al. | How Humans Behave and Evaluate a Social Robot in Real-environment Settings | 2 | NQ |
Nomura and Takagi | Exploring effects of educational backgrounds and gender in human–robot interaction | 2 | NQ |
Nomura et al. | Why Do Children Abuse Robots? | 2 | NS |
Nourbakhsh | On the study of human–robot collaboration | 3 | NS |
Oyedele et al. | Contextual factors in the appearance of consumer robots: exploratory assessment of perceived anxiety toward humanlike consumer robots | 3 | NQ |
Pennisi et al. | Autism and social robotics: A systematic review, | 2 | NS |
Polak | Differences between Young and Old Users when Interacting with a Humanoid Robot: A Qualitative Usability Study | 2 | NQ |
Pugliese et al. | Emergence of Leadership in a Group of Autonomous Robots | 3 | NQ |
Ragot | ADAPT: A EU transdisciplinary research project for assistive robotics rehabilitation | 2 | NS |
Rehm | Experimental designs for cross-cultural interactions: A case study on affective body movements for HRI | 3 | NQ |
Reig et al. | Leveraging Robot Embodiment to Facilitate Trust and Smoothness | 2 | NS |
Rijo | Diffusion of Culture Through Design | 2 | |
Robins and Dautenhahn | The Role of the Experimenter in HRI Research - A Case Study Evaluation of Children with Autism Interacting with a Robotic Toy | 3 | NS |
Robinson and Reinhard | Looking ahead in long-term care: the next 50 years, | 2 | NQ |
Rogers et al. | Discovering patterns of touch: A case study for visualization-driven analysis in Human–Robot Interaction | 3 | NS |
Rooksby | Can Plans and Situated Actions Be Replicated? | 2 | NS |
Ros et al. | Solving ambiguities with perspective taking | 2 | NQ |
Rosa et al. | Vocal Interaction with a 7-DOF Robotic Arm for Object Detection, Learning and Grasping | 2 | NQ |
Ruckert | Unity in multiplicity: Searching for complexity of persona in HRI | 3 | NS |
Saad | Welcoming Robot Behaviors for Drawing Attention | 2 | NS |
Sabanovic | Robots in Society, Society in Robots Mutual Shaping of Society and Technology as a Framework for Social Robot Design | 2 | NS |
Sabanovic | Inventing Japan’s ‘robotics culture’: the repeated assembly of science, technology, and culture in social robotics | 2 | NS |
Sabelli et al. | A conversational robot in an elderly care center: an ethnographic study | 2 | D |
Sakuma et al. | Positive and Negative Opinions About Living with Robots in Japanese University Students | 2 | NS |
Sato | Learning Ecosystem in Elementary School Using Modifiable Humanoid Robot | 2 | NS |
Scassellati et al. | Social development [robots] | 3 | NS |
Scassellati et al. | Robots for use in autism research | 2 | NS |
Schermerhorn et al. | Robot social presence and gender: Do females view robots differently than males? | 2 | NQ |
Schmidt-Rohr et al. | Òeasoning for a Multi-modal Service Robot Considering Uncertainty in Human–robot Interaction | 2 | NQ |
Sellner et al. | Attaining Situational Awareness for Sliding Autonomy | 2 | NQ |
Siegel et al. | Persuasive Robotics: The influence of robot gender on human behavior | 2 | NQ |
Slovak | Supporting Teaching and Learning of Situational Empathy by Technology | 2 | OQ |
Smith | Technologies of stage magic: Simulation and dissimulation | 2 | OQ |
Steinfeld et al. | Common Metrics for HRI | 3 | NS |
Stubbs et al. | Challenges to Grounding in Human–robot Interaction | 2 | NS |
Tapia et al. | Good Bones: Anthropological Scientific Collaboration Around Computed Tomography Data | 2 | OQ |
Thill and Ziemke, | The Role of Intentions in Human–Robot Interaction | 2 | NQ |
Torrey et al. | How a Robot Should Give Advice | 3 | NS |
Van Oost and Reed | Towards a sociological understanding of robots as companions | 2 | NS |
Van Turnhout et al. | Design Patterns for Mixed-method Research in HCI | 2 | OQ |
Veling | Becoming Real: An Anthropological Approach to Evaluating Robots in the Real World | 2 | NS |
Vertesi | Seeing Like a Rover: Team Work and Human–Robot Relations | 2 | NS |
Vicente and Bernardino | Wedding robotics: A case study | 3 | NS |
Virnes | Robotics in Special Needs Education | 3 | NS |
von der Putte | A Social Robot for Autonomous Health Data Acquisition Among Hospitalized Patients: An Exploratory Field Study | 2 | NS |
von der Putten et al. | An android in the field | 3 | NS |
Weiss | HRI research: the interdisciplinary challenge or the dawning of the discipline? | 2 | NS |
Weiss et al. | The USUS evaluation framework for human–robot interaction | 3 | NS |
Weiss et al. | A methodological adaptation for heuristic evaluation of HRI | 3 | NS |
Weiss et al. | The USUS evaluation framework for user-centered HRI | 2 | D |
Wilkinson et al. | Oh Yes, Robots! People Like Robots; the Robot People Should do Something’: Perspectives and Prospects in Public Engagement With Robotics | 2 | NS |
Williams | AIDA: A Social Co-Robot to Uplift Workers with Intellectual and Developmental Disabilities | 2 | NS |
Wilson and Haslam | Humanness beliefs about behavior: an index and comparative human-nonhuman behavior judgments | 2 | NQ |
Wolbring and Lashewicz | Home care technology through an ability expectation lens | 2 | NS |
Xu et al. | The role of social context in human–robot interaction | 2 | NQ |
Yang et al. | Robotic interaction via path planning - A viewpoint from functionalist sociology | 2 | NQ |
Yim and Shaw | CALLY: The cell-phone robot with affective expressions | 2 | NQ |
Young et al. | Evaluating Human–Robot Interaction, Focusing on the Holistic Interaction Experience | 3 | NS |
Yumakulov et al. | Imagery of disabled people within social robotics research | 2 | NS |
Zaga et al. | 2Nd Workshop on Evaluating Child Robot Interaction | 2 | NS |
Zhong et al. | A hierarchical emotion regulated sensorimotor model: Case studies | 2 | NQ |
Zubrycki and Granosik | A Robotized Environment for Improving Therapist Everyday Work with Children with Severe Mental Disabilities | 3 | NS |
Rights and permissions
About this article
Cite this article
Veling, L., McGinn, C. Qualitative Research in HRI: A Review and Taxonomy. Int J of Soc Robotics 13, 1689–1709 (2021). https://doi.org/10.1007/s12369-020-00723-z
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12369-020-00723-z