Skip to main content

A Hypothesis of Brain-to-Brain Coupling in Interactive New Media Art and Games Using Brain-Computer Interfaces

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9090))

Abstract

Interactive new media art and games belong to distinctive fields, but nevertheless share common grounds, tools, methodologies, challenges, and goals, such as the use of applications and devices for engaging multiple participants and players, and more recently electroencephalography (EEG)-based brain-computer interfaces (BCIs). At the same time, an increasing number of new neuroscientific studies explore the phenomenon of brain-to-brain coupling, the dynamics and processes of the interaction and synchronisation between multiple subjects and their brain activity. In this context, we discuss interactive works of new media art, computer and serious games that involve the interaction of the brain-activity, and hypothetically brain-to-brain coupling, between multiple performer/s, spectator/s, or participants/players. We also present Enheduanna – A Manifesto of Falling (2015), a new live brain-computer cinema performance, with the use of an experimental passive multi-brain BCI system under development. The aim is to explore brain-to-brain coupling between performer/s and spectator/s as means of controlling the audio-visual creative outputs.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Zioga, P., Chapman, P., Ma, M., Pollick, F.: A Wireless Future: performance art, interaction and the brain-computer interfaces. In: INTER-FACE: International Conference on Live Interfaces 2014, Lisbon (2014)

    Google Scholar 

  2. Hasson, U., Ghazanfar, A.A., Galantucci, B., Garrod, S., Keysers, C.: Brain-to-brain coupling: a mechanism for creating and sharing a social world. Trends in Cognitive Neuroscience 16(2), 114–121 (2012). doi:10.1016/j.tics.2011.12.007

    Google Scholar 

  3. Stephens, G.J., Silbert, L., Hasson, U.: Speaker–listener neural coupling underlies successful communication. Proceedings of the National Academy of Sciences of the United States of America 107(32), 14425–14430 (2010)

    Google Scholar 

  4. Schippers, M.B., Roebroeck, A., Renken, R., Nanettia, L., Keysers, C.: Mapping the information flow from one brain to another during gestural communication. Proceedings of the National Academy of Sciences of the United States of America 107(20), 9388–9393 (2010)

    Google Scholar 

  5. Anders, S., Heinzle, J., Weiskopf, N., Ethofer, T., Haynes, J.-D.: Flow of affective information between communicating brains. Neuroimage 54(1–4), 439–446 (2011)

    Article  Google Scholar 

  6. Jola, C., McAleer, P., Grosbras, M.-H., Love, S.A., Morison, G., Pollick, F.E.: Uni- and multisensory brain areas are synchronized across spectators when watching unedited dance recordings. i-Perception 4(4), 265–284 (2013)

    Article  Google Scholar 

  7. Mori, M., Bregenz, K., Schneider, E.: Mariko Mori: wave UFO. Verlag der Buchhandlung Walther König, Köln (2003)

    Google Scholar 

  8. Dikker, S.: REAL-TIME INTERACTIVE BRAIN INSTALLATIONS (Last Modified September 2014). https://files.nyu.edu/sd1083/public/art.html. (accessed October 19, 2014)

  9. Marina Abramovic Institute: Out of the Lab (2014). http://www.immaterial.org/content/2014/6/9/out-of-the-lab. (accessed October 19, 2014)

  10. Eaton, J.: The Space Between Us. Vimeo video, 06:35. Posted by “joel eaton” (2015). https://vimeo.com/116013316. (accessed March 04, 2015)

  11. Eaton, J., Jin, W., Miranda, E.: The space between us: a live performance with musical score generated via affective correlates measured in EEG of one performer and an audience member. In: NIME 2014 International Conference on New Interfaces for Musical Expression, pp. 593-596. NIME 2014, London (2014)

    Google Scholar 

  12. Nijholt, A., Gürkök, H.: Multi-brain games: cooperation and competition. In: Stephanidis, C., Antona, M. (eds.) UAHCI 2013, Part I. LNCS, vol. 8009, pp. 652–661. Springer, Heidelberg (2013)

    Google Scholar 

  13. Bonnet, L., Lotte, F., Lecuyer, A.: Two Brains, One Game: Design and Evaluation of a Multi-User BCI Video Game Based on Motor Imagery. IEEE Transactions on Computational Intelligence and AI in games, IEEE Computational Intelligence Society 5(2), 185–198 (2013)

    Google Scholar 

  14. Bahrami, B., Olsen, K., Latham, P.E., Roepstorff, A., Rees, G., Frith, C.D.: Optimally interacting minds. Science 329(5995), 1081–1085 (2010)

    Article  Google Scholar 

  15. Rao, R.P.N., Stocco, A., Bryan, M., Sarma, D., Youngquist, T.M., Wu, J., Prat, C.: A Direct Brain-to-Brain Interface in Humans. University of Washington Computer Science and Engineering. In: Technical Report No. UW-CSE-14-07-01 (July 2014). http://homes.cs.washington.edu/~rao/brain2brain/UW-CSE-14-07-01.PDF.pdf. (accessed October 22, 2014)

  16. MyndPlay: Focus Pocus for Windows (2015). http://myndplay.com/software.php?swid=19. (accessed March 04, 2014)

  17. Zioga, P., Katsinavaki, A.: Enheduanna – A Manifesto of Falling. Premiere 30th July 2015. Centre for Contemporary Arts, Glasgow, UK. Performers: Anastassia Katsinavaki, Minas Borboudakis, and Polina Zioga. Director: Polina Zioga (2015)

    Google Scholar 

  18. Willis, H.: Real Time Live: Cinema as Performance. AfterImage 37(1), 11–15 (2009)

    Google Scholar 

  19. Hasson, U., Landesman, O., Knappmeyer, B., Vallines, I., Rubin, N., Heeger, D.: Neurocinematics: The Neuroscience of Film. Projections: The Journal for Movies and Mind 2(1), 1–26 (2008)

    Article  Google Scholar 

  20. Zander T.O., Kothe C, Welke S, Roetting M.: Enhancing human-machine systems with secondary input from passive brain-computer interfaces. In: Proceedings of the 4th International BCI Workshop & Training Course, Graz, Austria, 2008. Graz University of Technology Publishing House, Graz (2008)

    Google Scholar 

  21. MyndPlay: BrainBandXL & MyndPlay Pro Bundle (2015). http://myndplay.com/products.php?prod=9. (accessed March 04, 2014)

  22. Renard, Y., Lotte, F., Gibert, G., Congedo, M., Maby, E., Delannoy, Bertrand, V. O., Lécuyer, A.: OpenViBE: An Open-Source Software Platform to Design, Test and Use Brain-Computer Interfaces in Real and Virtual Environments, Presence: Teleoperators and Virtual Environments 19(1) (2010)

    Google Scholar 

  23. Swartz Center of Computational Neuroscience – University of California San Diego: Introduction To Modern Brain-Computer Interface Design Wiki (2012). http://sccn.ucsd.edu/wiki/Introduction_To_Modern_Brain-Computer_Interface_Design. (accessed September 24, 2014)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Polina Zioga .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Zioga, P., Chapman, P., Mae, M., Pollick, F. (2015). A Hypothesis of Brain-to-Brain Coupling in Interactive New Media Art and Games Using Brain-Computer Interfaces. In: Göbel, S., Ma, M., Baalsrud Hauge, J., Oliveira, M., Wiemeyer, J., Wendel, V. (eds) Serious Games. JCSG 2015. Lecture Notes in Computer Science(), vol 9090. Springer, Cham. https://doi.org/10.1007/978-3-319-19126-3_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-19126-3_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-19125-6

  • Online ISBN: 978-3-319-19126-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics