Skip to main content

Providing a Tangible and Visual Feedback of Affective States Self-expressions

  • Conference paper
  • First Online:
Universal Access in Human-Computer Interaction. Applications and Practice (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12189))

Included in the following conference series:

  • 2657 Accesses

Abstract

Understanding people’s emotion and affective states in educational environments is relevant given the intrinsic relationship between emotion and learning. In this work, we designed artefacts that use tangible technologies to provide manikins to report the person’s affective states in three dimensions: pleasure, arousal and dominance. In a school environment, the tangible artefacts can joyfully trigger the self-expression of affective states in the students and in the teachers’ practice. In order to raise the school’s awareness about the self-assessment practice of expressing affective states, a joyful data presentation using a LED board was proposed as a visual feedback, which was named SAMLight. The LEDs light up according to the assessment results of the affective states of the students in different classes in the school. To evaluate the system, we carried out sessions with students of eight different classes. The results show that the visual feedback was very illustrative to both students and teachers, leading them to reflect about the subject concerning the classes and school environments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Balaam, M., Fitzpatrick, G., Good, J., Luckin, R.: Exploring affective technologies for the classroom with the subtle stone. In: Conference on Human Factors in Computing Systems (CHI 2010) (2010)

    Google Scholar 

  2. Worsley, M., Blikstein, P.: Using learning analytics to study cognitive disequilibrium in a complex learning environment. In: International Conference on Learning Analytics and Knowledge, pp. 426–427 (2015)

    Google Scholar 

  3. Schmidt, S.J.: Embracing and harnessing the intimate connection between emotion and cognition to help students learn. Food Sci. Educ. 2, 1–10 (2019)

    Google Scholar 

  4. Marshall, P., Rogers, Y., Scaife, M.: PUPPET : a virtual environment for children to act and direct interactive narratives. In: International Workshop on Narrative and Interactive Learning Environments, pp. 6–9 (2002)

    Google Scholar 

  5. Ryokai, K., Raffle, H., Kowalski, R.: StoryFaces: pretend-play with ebooks to support social-emotional storytelling. In: Interaction Design and Children, pp. 125–133 (2012)

    Google Scholar 

  6. Bradley, M.M., Lang, P.J.: Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25(1), 49–59 (1994)

    Article  Google Scholar 

  7. Ishii, H.: Tangible bits: beyond pixels. In: International Conference on Tangible and Embedded Interaction (TEI 2008), no. November, pp. 15–25 (2008)

    Google Scholar 

  8. Moreira, E.A., Baranauskas, M.C.C.: Investigando processos de comunicação alternativa via tecnologia tangível: um estudo exploratório. In: Brazilian Symposium on Computers in Education, pp. 856–865 (2016)

    Google Scholar 

  9. Moreira, E.A., Carbajal, M.L., Baranauskas, M.C.C.: Creative learning and artefacts making: promises and challenges in practice. In: Zaphiris, P., Ioannou, A. (eds.) Learning and Collaboration Technologies. Designing Learning Experiences. HCII 2019. Lecture Notes in Computer Science, vol. 11590, pp. 856–865. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-21814-0_24

  10. Moreira, E.A., et al.: Explorando a Utilização de Storyboard em um Ambiente Tangível de Apoio à Comunicação Alternativa e Aumentativa. In: Brazilian Symposium on Computers in Education, pp. 1083–1092 (2018)

    Google Scholar 

  11. Moreira, E.A., Baranauskas, M.C.C.: Alice das Coisas: entendendo a comunicação entre objetos na construção de ambientes de aprendizagem. In: Anais do XXVIII Simpósio Brasileiro de Informática na Educação (SBIE 2017), vol. 1, no. Cbie, p. 1017 (2017)

    Google Scholar 

  12. Amparo: Secretaria Municipal de Educação. Programa de Educação Inclusiva : A educação tem muitas faces – Educando e aprendendo na diversidade Secretaria Municipal de Educação, Amparo (2016)

    Google Scholar 

Download references

Acknowledgements

This work was supported by the Federal Institute of São Paulo, National Council of Technological and Scientific Development - CNPq - (#306272/2017-2), São Paulo Research Foundation (FAPESP, grant #2015/16528-0) and Institute of Computing at University of Campinas (UNICAMP). Special thanks to the Education Secretariat of city of Amparo/São Paulo/Brazil.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Eliana Alves Moreira .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Moreira, E.A., Alberto Herrera, J., Baranauskas, M.C.C. (2020). Providing a Tangible and Visual Feedback of Affective States Self-expressions. In: Antona, M., Stephanidis, C. (eds) Universal Access in Human-Computer Interaction. Applications and Practice. HCII 2020. Lecture Notes in Computer Science(), vol 12189. Springer, Cham. https://doi.org/10.1007/978-3-030-49108-6_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-49108-6_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-49107-9

  • Online ISBN: 978-3-030-49108-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics