Skip to main content

Multimodal Intercultural Information and Communication Technology – A Framework for Designing and Evaluating Multimodal Intercultural Communicators

  • Chapter
Book cover Multimodal Corpora (MMCorp 2008)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5509))

Included in the following conference series:

  • 1179 Accesses

Abstract

The paper presents a framework, combined with a checklist for designing and evaluating multimodal, intercultural ICT, especially when embodied artificial communicators are used as front ends for data bases, as digital assistants, as tutors in pedagogical programs or players in games etc. Such a framework is of increasing interest, since the use of ICT across cultural boundaries in combination with the use of ICT by persons with low literacy skills is rapidly increasing. This development presents new challenges for intercultural ICT. A desideratum for interculturally sensitive artificial communicators is a generic, exportable system for interactive communication with a number of parameters that can be set to capture intercultural variation in communication. This means a system for a Generic, Multimodal, Intercultural Communicator (a GMIC).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Peirce, C.S.: Collected Papers of Charles Sanders Peirce, 1931-1958. In: Hartshorne, C., Weiss, P., Burks, A. (eds.) vol. 8, Harvard University Press, Cambridge (1931)

    Google Scholar 

  2. Allwood, J.: Capturing Differences between Social Activities in Spoken Language. In: Kenesei, I., Harnish, R.M. (eds.) Perspectives in Semantics, Pragmatics and Discourse, pp. 301–319. John Benjamins, Amsterdam (2001)

    Chapter  Google Scholar 

  3. Kenny, P., Harholt, A., Gratsch, J., Swartout, W., Traum, D., Marsella, S., Piepol, D.: Building Interactive Virtual Humans for Training Environments. In: Proceedings of I/ITSEC (2007)

    Google Scholar 

  4. Jan, D., Herrera, D., Martinovski, B., Novick, D., Traum, D.: A computational Model of Culture-specific Conversational Behavior. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 45–56. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  5. Kopp, S., Allwood, J., Ahlsén, E., Stocksmeier, T.: Modeling Embodied Feedback with Virtual Humans. In: Wachsmuth, I., Knoblich, G. (eds.) ZiF Research Group International Workshop. LNCS (LNAI), vol. 4930, pp. 18–37. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  6. Poggi, I., Pelachaud, C., de Rosis, F., Carofiglio, V., De Carolis, N.: GRETA. A Believable Embodied Conversational Agent. In: Stock, O., Zancarano, M. (eds.) Multimodal Intelligent Information Presentation. Kluwer, Dordrecht (2005)

    Google Scholar 

  7. Koda, T.: Cross-cultural study of avatars’ facial expressions and design considerations within Asian countries. In: Ishida, T., Fussell, S.R., Vossen, P.T.J.M. (eds.) IWIC 2007. LNCS, vol. 4568, pp. 207–220. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  8. Koda, T., Rehm, M., André, E.: Cross-cultural Evaluations of avatar facial expressions designed by Western and Japanese Designers. In: Prendinger, H., Lester, J.C., Ishizuka, M. (eds.) IVA 2008. LNCS (LNAI), vol. 5208, pp. 245–252. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  9. Koda, T., Ishida, T.: Cross-Cultural Study of Avatar Expression Interpretations. In: SAINT 2006, pp. 130–136 (2006)

    Google Scholar 

  10. Johansen, S.: Avatars in Global E-Commerce: A Cross-Cultural Analysis of the Effects of Avatars on Online Consumer Behavior in Germany and the U.S. Journal of Undergraduate Research 6(8), 32611 (352) 846–2032 (2006)

    Google Scholar 

  11. Kilbourne, J.: Deadly Persuasion. Free Press, New York (1999)

    Google Scholar 

  12. Hofstede, G.: Cultural Constraints in Personnel Management. Journal of International Business, Special Issue 2/98, Management International Review, 8–9 (1998)

    Google Scholar 

  13. Barber, W., Badre, A.: Culturability: the merging of culture and usability. Human Factors and the Web (1998), http://www.research.att.com/conf/hfweb/proceedings/barder/index.htm

  14. Chau, P., Cole, M., Massey, A., Montoya-Weiss, M., O’Keefe, R.: Cultural differences in the online behavior of consumers. Journal of the Association for Computing Machinery 45(10) (2002)

    Google Scholar 

  15. Allwood, J.: Are There Swedish Patterns of Communication? In: Tamura, H. (ed.) Cultural Acceptance of CSCW in Japan & Nordic Countries, pp. 90–120. Kyoto Institute of Technology, Kyoto (1999)

    Google Scholar 

  16. Lustig, M., Koester, J.: Intercultural Competence: Interpersonal Communication across Cultures. Longman, New York (2006)

    Google Scholar 

  17. Allwood, J., Cerrato, L., Jokinen, K., Paggio, P., Navaretta, C.: The MUMIN Annotation Scheme for Feedback, Turn Management and Sequencing. In: Proceedings from the Second Nordic conference on Multimodal Communication. Gothenburg Papers in Theoretical

    Google Scholar 

  18. Morris, D.: Manwatching. Jonathan Cape, London (1977)

    Google Scholar 

  19. Allwood, J.: Bodily Communication – Dimensions of Expression and Content. In: Granström, B., House, D., Karlsson, I. (eds.) Multimodality in Language and Speech Systems, pp. 7–26. Kluwer Academic Publishers, Dordrecht (2002); Linguistics, 92. University of Gothenburg, Department of Linguistics (2006)

    Chapter  Google Scholar 

  20. Allwood, J.: Intercultural Communication. In: Allwood, J. (ed.) Papers in Anthropological Linguistics 12. University of Gothenburg, Department of Linguistics, Göteborg (1985)

    Google Scholar 

  21. Hofstede, G.: Cultures and Organizations: Software of the Mind. McGraw-Hill, New York (1997)

    Google Scholar 

  22. Sacks, H., Schegloff, E.A., Jefferson, G.: A simplest systematics for the organization of turn-taking for conversation. Language 50, 696–735 (1974)

    Article  Google Scholar 

  23. Allwood, J., Nivre, J., Ahlsén, E.: On the semantics and pragmatics of linguistic feedback. Journal of Semantics 9(1), 1–26 (1992)

    Article  Google Scholar 

  24. Cassell, J., Thórisson, K.: The power of a nod and a glance. Envelope vs. emotional feedback in animated conversational agents. Applied Artificial Intelligence 13, 519–538 (1999)

    Article  Google Scholar 

  25. Kopp, S., Wachsmuth, I.: Synthesizing Multimodal Utterances for Conversational Agents. The Journal Computer Animation and Virtual Words 15(1), 39–52 (2004)

    Article  Google Scholar 

  26. Kopp, S.: How Humans Talk to Virtual Humans - Conversations From a Real-World Application. In: Fischer, K. (ed.) How People Talk to Computers, Robots, and Other Artificial Interaction Partners, SFB/TR 8 Report No. 010-09/2006, pp. 101–113 (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Allwood, J., Ahlsén, E. (2009). Multimodal Intercultural Information and Communication Technology – A Framework for Designing and Evaluating Multimodal Intercultural Communicators. In: Kipp, M., Martin, JC., Paggio, P., Heylen, D. (eds) Multimodal Corpora. MMCorp 2008. Lecture Notes in Computer Science(), vol 5509. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04793-0_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-04793-0_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-04792-3

  • Online ISBN: 978-3-642-04793-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics