skip to main content
10.1145/3526114.3558704acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
poster

Sharing Heartbeat: Toward Conducting Heartrate and Speech Rhythm through Tactile Presentation of Pseudo-heartbeats

Authors Info & Claims
Published:28 October 2022Publication History

ABSTRACT

Currently, the ongoing COVID-19 pandemic makes physical contact, such as handshakes, difficult. However, physical contact is effective in strengthening the bonds between people. In this study, we aim to compensate for the physical contact lost during the COVID-19 pandemic by presenting a pseudo-heartbeat through a speaker to reproduce entrainment and the synchronized state of heartbeats induced by physiological synchronization. We evaluated the effects of the device in terms of speech rhythm and heart rate. The experimental results showed that a presentation of 80 BPM significantly reduced the difference in heart rate between the two participants, bringing them closer to a synchronized heart rate state. The heart rates of participants were significantly lower when 45 BPM and 80 BPM were presented than when no stimulus was given. Furthermore, when 45 BPM was presented, the silent periods between conversations were significantly more extended than when no stimulus was given. This result indicates that this device can intentionally create the entrainment phenomenon and a synchronized heart rate state, thereby producing the same effect of physical contact communication without contact.

References

  1. 2011. Association between interoception and empathy: Evidence from heartbeat-evoked brain potential. International Journal of Psychophysiology 79, 2 (2011), 259–265.Google ScholarGoogle ScholarCross RefCross Ref
  2. Rick Baaren, Rob Holland, Bregje Steenaert, and Ad Knippenberg. 2003. Mimicry for money: Behavioral consequences of imitation. Journal of Experimental Social Psychology 39 (07 2003), 393–398. https://doi.org/10.1016/S0022-1031(03)00014-3Google ScholarGoogle Scholar
  3. J. Bailenson and N. Yee. 2005. Digital chameleons: Automatic assimilation of nonverbal gestures in immersive virtual environments. Psychological Science 16 (01 2005), 814–819.Google ScholarGoogle Scholar
  4. Dale Barr and Boaz Keysar. 2006. Chapter 23. Perspective Taking and the Coordination of Meaning in Language Use. 901–938. https://doi.org/10.1016/B978-012369374-7/50024-9Google ScholarGoogle Scholar
  5. Sara Bögels, Marisa Casillas, and Stephen C. Levinson. 2018. Planning versus comprehension in turn-taking: Fast responders show reduced anticipatory processing of the question. Neuropsychologia 109(2018), 295–310.Google ScholarGoogle ScholarCross RefCross Ref
  6. Sara Bögels, Lilla Magyari, and Stephen C Levinson. 2015. Neural signatures of response planning occur midway through an incoming question in conversation. Scientific reports 5, 1 (2015), 1–11.Google ScholarGoogle Scholar
  7. Angela Chang, M. Sile O’Modhrain, Robert J. K. Jacob, Eric Gunther, and Hiroshi Ishii. 2002. ComTouch: design of a vibrotactile communication device. In DIS ’02.Google ScholarGoogle Scholar
  8. Tanya L Chartrand and John A Bargh. 1999. The chameleon effect: the perception–behavior link and social interaction.Journal of personality and social psychology 76, 6(1999), 893–910.Google ScholarGoogle Scholar
  9. Jonas Chatel-Goldman, Marco Congedo, Christian Jutten, and jean-luc Schwartz. 2014. Touch increases autonomic coupling between romantic partners. Frontiers in behavioral neuroscience 8 (03 2014), 95. https://doi.org/10.3389/fnbeh.2014.00095Google ScholarGoogle Scholar
  10. Jonas Chatel-Goldman, Marco Congedo, Christian Jutten, and jean-luc Schwartz. 2014. Touch increases autonomic coupling between romantic partners. Frontiers in behavioral neuroscience 8 (03 2014), 95. https://doi.org/10.3389/fnbeh.2014.00095Google ScholarGoogle Scholar
  11. Adrian David Cheok and Emma Yann Zhang. 2019. Kissenger: Transmitting Kiss Through the Internet. Human–Robot Intimate Relationships(2019).Google ScholarGoogle Scholar
  12. Kyung Yun Choi and Hiroshi Ishii. 2020. ambienBeat: Wrist-worn Mobile Tactile Biofeedback for Heart Rate Rhythmic Regulation. 17–30. https://doi.org/10.1145/3374920.3374938Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Martin Clayton. 2012. What is Entrainment? Definition and applications in musical research. Empirical Musicology Review 7 (2012), 49–56.Google ScholarGoogle ScholarCross RefCross Ref
  14. Martin Clayton, Rebecca Darlene Sager, and Udo Will. 2004. The concept of entrainment and its significance for ethnomusicology.Google ScholarGoogle Scholar
  15. Jason R. Franz, Carrie A. Francis, Matthew S. Allen, and Darryl G. Thelen. 2017. Visuomotor Entrainment and the Frequency-Dependent Response of Walking Balance to Perturbations. IEEE Transactions on Neural Systems and Rehabilitation Engineering 25, 8(2017), 1135–1142. https://doi.org/10.1109/TNSRE.2016.2603340Google ScholarGoogle ScholarCross RefCross Ref
  16. Gijs Huisman. 2017. Social Touch Technology: A Survey of Haptic Technology for Social Touch. IEEE Transactions on Haptics PP (01 2017), 1–1. https://doi.org/10.1109/TOH.2017.2650221Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Masahiro Kawasaki, Yohei Yamada, Yosuke Ushiku, Eri Miyauchi, and Yoko Yamaguchi. 2013. Inter-brain synchronization during coordination of speech rhythm in human-to-human social interaction. Scientific reports 3 (04 2013), 1692. https://doi.org/10.1038/srep01692Google ScholarGoogle Scholar
  18. Kaiko Kuwamura, Kurima Sakai, Takashi Minato, Shuichi Nishio, and Hiroshi Ishiguro. 2013. Hugvie: A medium that fosters love. 2013 IEEE RO-MAN (2013), 70–75.Google ScholarGoogle Scholar
  19. Stephen C Levinson. 2016. Turn-taking in human communication–origins and implications for language processing. Trends in cognitive sciences 20, 1 (2016), 6–14.Google ScholarGoogle Scholar
  20. Lilla Magyari, Marcel CM Bastiaansen, Jan P De Ruiter, and Stephen C Levinson. 2014. Early anticipation lies behind the speed of response in conversation. Journal of Cognitive Neuroscience 26, 11 (2014), 2530–2539.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Therese Connell Meehan. 1998. Therapeutic touch as a nursing intervention.Journal of advanced nursing 28 1 (1998), 117–25.Google ScholarGoogle Scholar
  22. Panagiotis Mitkidis, John McGraw, Andreas Roepstorff, and Sebastian Wallot. 2015. Building Trust: Heart Rate Synchrony and Arousal During Joint Action Increased by Public Goods Game. Physiology & Behavior (06 2015), 101–106. https://doi.org/10.1016/j.physbeh.2015.05.033Google ScholarGoogle Scholar
  23. Toshio Mori and Shoichi Kai. 2002. Noise-induced entrainment and stochastic resonance in human brain waves.Physical review letters 88 21 (2002), 218101.Google ScholarGoogle Scholar
  24. Narihiro Nishimura, Asuka Ishi, Michi Sato, Shogo Fukushima, and Hiroyuki Kajimoto. 2012. Facilitation of Affection by Tactile Feedback of False Heratbeat. In CHI ’12 Extended Abstracts on Human Factors in Computing Systems (Austin, Texas, USA) (CHI EA ’12). Association for Computing Machinery, New York, NY, USA, 2321–2326. https://doi.org/10.1145/2212776.2223796Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Jessica Phillips-Silver, C. Athena Aktipis, and Gregory A. Bryant. 2010. The ecology of entrainment: Foundations of coordinated rhythmic movement.Music perception 28 1(2010), 3–14.Google ScholarGoogle Scholar
  26. Jessica Phillips-Silver and Peter E. Keller. 2012. Searching for Roots of Entrainment and Joint Action in Early Musical Interactions. Frontiers in Human Neuroscience 6 (2012).Google ScholarGoogle Scholar
  27. Michael J. Richardson, Kerry L. Marsh, Robert W. Isenhower, Justin R L Goodman, and Richard C. Schmidt. 2007. Rocking together: dynamics of intentional and unintentional interpersonal coordination.Human movement science 26 6 (2007), 867–91.Google ScholarGoogle Scholar
  28. Maya Rossignac-Milon, Niall Bolger, Katherine S. Zee, Erica J. Boothby, and Edward Tory Higgins. 2020. Merged minds: Generalized shared reality in dyadic relationships.Journal of personality and social psychology (2020).Google ScholarGoogle Scholar
  29. Carsten Schäfer, Michael Rosenblum, Jürgen Kurths, and H H Abel. 1998. Heartbeat synchronized with ventilation. Nature 392(1998), 239–240.Google ScholarGoogle ScholarCross RefCross Ref
  30. H. Seidel and H. herzel. 1998. Analyzing entrainment of heartbeat and respiration with surrogates. IEEE Engineering in Medicine and Biology Magazine 17, 6 (1998), 54–57. https://doi.org/10.1109/51.731321Google ScholarGoogle ScholarCross RefCross Ref
  31. Michihiro Shimada, Kazunori Yamauchi, Takashi Minato, Hiroshi Ishiguro, and Shoji Itakura. 2008. Studying the influence of the chameleon effect on humans using an android. 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems (2008), 767–772.Google ScholarGoogle ScholarCross RefCross Ref
  32. Heather Stokes, Jessica Thompson, and Jason Franz. 2017. The Neuromuscular Origins of Kinematic Variability during Perturbed Walking. Nature: Scientific Reports 7 (11 2017). https://doi.org/10.1038/s41598-017-00942-xGoogle ScholarGoogle Scholar
  33. Emma M. Templeton, Luke J. Chang, Elizabeth A. Reynolds, Marie D. Cone LeBeaumont, and Thalia Wheatley. 2022. Fast response times signal social connection in conversation. Proceedings of the National Academy of Sciences of the United States of America 119(2022).Google ScholarGoogle ScholarCross RefCross Ref
  34. Alexander Toet. 2015. Social Touch in Human–Computer Interaction. Frontiers in Digital Humanities 2 (05 2015), 1–13. https://doi.org/10.3389/fdigh.2015.00002Google ScholarGoogle Scholar
  35. Stuart Valins. 1966. Cognitive effects of false heart-rate feedback.Journal of personality and social psychology 4 4 (1966), 400–8.Google ScholarGoogle Scholar
  36. Scott Wiltermuth and Chip Heath. 2009. Synchrony and Cooperation. Psychological science 20 (02 2009), 1–5. https://doi.org/10.1111/j.1467-9280.2008.02253.xGoogle ScholarGoogle Scholar

Index Terms

  1. Sharing Heartbeat: Toward Conducting Heartrate and Speech Rhythm through Tactile Presentation of Pseudo-heartbeats

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      UIST '22 Adjunct: Adjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology
      October 2022
      413 pages
      ISBN:9781450393218
      DOI:10.1145/3526114

      Copyright © 2022 Owner/Author

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 28 October 2022

      Check for updates

      Qualifiers

      • poster
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate842of3,967submissions,21%

      Upcoming Conference

      UIST '24
    • Article Metrics

      • Downloads (Last 12 months)54
      • Downloads (Last 6 weeks)1

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format