Daniel Roth
Marc Erich Latoschik
ABSTRACT
In this demonstration we present a prototype for an avatar-mediated social interaction interface that supports the replication of head- and eye movement in distributed virtual environments. In addition to the retargeting of these natural behaviors, the system is capable of augmenting the interaction based on the visual presentation of affective states. We derive those states using neuronal data captured by electroencephalographic (EEG) sensing in combination with a machine learning driven classification of emotional states.
- Jeremy N Bailenson, Andrew C Beall, Jack Loomis, Jim Blascovich, and Matthew Turk. 2004. Transformed social interaction: Decoupling representation from behavior and form in collaborative virtual environments. Presence: Teleoperators & Virtual Environments 13, 4(2004), 428–441.Google Scholar
Digital Library
- Jeremy N Bailenson, Nick Yee, Dan Merget, and Ralph Schroeder. 2006. The effect of behavioral realism and form realism of real-time avatar faces on verbal disclosure, nonverbal disclosure, emotion recognition, and copresence in dyadic interaction. Presence: Teleoperators and Virtual Environments 15, 4(2006), 359–372.Google ScholarDigital Library
- Jonathon D Hart, Thammathip Piumsomboon, Louise Lawrence, Gun A Lee, Ross T Smith, and Mark Billinghurst. 2018. Demonstrating Emotion Sharing and Augmentation in Cooperative Virtual Reality Games. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts. ACM, 117–120.Google Scholar
- David Roberts, Robin Wolff, John Rae, Anthony Steed, Rob Aspin, Moira McIntyre, Adriana Pena, Oyewole Oyekoya, and Will Steptoe. 2009. Communicating eye-gaze across a distance: Comparing an eye-gaze enabled immersive collaborative virtual environment, aligned video conferencing, and being together. In 2009 IEEE Virtual Reality Conference. IEEE, 135–142.Google ScholarDigital Library
- D. Roth, C. Kleinbeck, T. Feigl, C. Mutschler, and M. E. Latoschik. 2018. Beyond Replication: Augmenting Social Behaviors in Multi-User Virtual Realities. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 215–222. https://doi.org/10.1109/VR.2018.8447550Google Scholar
- Daniel Roth, Peter Kullmann, Gary Bente, Dominik Gall, and Marc Erich Latoschik. 2018. Effects of Hybrid and Synthetic Social Gaze in Avatar-Mediated Interactions. In 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, 103–108. https://doi.org/10.1109/ISMAR-Adjunct.2018.00044Google Scholar
- Daniel Roth, Kristoffer Waldow, Felix Stetter, Gary Bente, Marc Erich Latoschik, and Arnulph Fuhrmann. 2016. SIAMC: A Socially Immersive Avatar Mediated Communication Platform. In Proceedings of the 22Nd ACM Conference on Virtual Reality Software and Technology(VRST ’16). ACM, New York, NY, USA, 357–358. https://doi.org/10.1145/2993369.2996302Google ScholarDigital Library
- Daniel Roth, Franziska Westermeier, Larissa Brübach, Tobias Feigl, Christian Schell, and Marc Erich Latoschik. 2019, to appear. Brain 2 Communicate: EEG-based Affect Recognition to Augment Virtual Social Interactions. In Proceedings of the Mensch und Computer 2019 Workshop on User-Embodied Interaction in Virtual Reality.Google Scholar
- A Social Interaction Interface Supporting Affective Augmentation Based on Neuronal Data
Recommendations
Measuring immersion and affect in a brain-computer interface game
INTERACT'11: Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part IBrain-computer interfaces (BCIs) have widely been used in medical applications, to facilitate making selections. However, whether they are suitable for recreational applications is unclear as they have rarely been evaluated for user experience. As the ...
Integrating virtual agents in BCI neurofeedback systems
VRIC '14: Proceedings of the 2014 Virtual Reality International ConferenceThe recent development of Brain-Computer Interfaces (BCI) to Virtual World has resulted in a growing interest in realistic visual feedback. In this paper, we investigate the potential role of Virtual Agents in neurofeedback systems, which constitute an ...
Emotional Beasts: Visually Expressing Emotions through Avatars in VR
CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing SystemsWith the advances in Virtual Reality (VR) and physiological sensing technology, even more immersive computer-mediated communication through life-like characteristics is now possible. In response to the current lack of culture, expression and emotions in ...
Comments