ABSTRACT
Qualitative research using video data requires a systematic approach to elicitation, collection and analysis of recordings. An analytic procedure was designed for a recent study focused on the creation of visual information as communicative practice. Video recordings of face-to-face conversations during which images were made provided rich evidence of both verbal and non-verbal modes of communication. This poster will present the video-based methodology used in this research to study multimodal social interactions associated with the creation of visual artifacts.
- Levine, P. and R. Scollon, Discourse and Technology: Multimodal Discourse Analysis, 2004, Washington, D. C.: Georgetown University Press.Google Scholar
- Heath, C., J. Hindmarsh, and P. Luff, Video in Qualitative Research: Analysing Social Interaction in Everyday Life, 2010, Thousand Oaks, CA: Sage Publications.Google Scholar
- Gibson, W. J. and A. Brown, Working with Qualitative Data, 2009, Thousand Oaks, CA: Sage Publications.Google Scholar
- Norris, S., Analyzing multimodal interaction: A methodological framework, 2004, New York and London: Routledge.Google Scholar
- Johnstone, B., Qualitative methods in sociolinguistics, 2000, New York: Oxford University PressGoogle Scholar
- Have, P. T., Doing Conversation Analysis: A Practical Guide, 2007, Thousand Oaks, CA: Sage Publications.Google Scholar
- Hutchby, I. and R. Wooffitt, Conversation Analysis 2008, Cambridge, UK: Polity Press.Google Scholar
- Van Dijk, T. A., Episodes as units of discourse analysis, in Analyzing Discourse: Text and Talk, D. Tannen, Editor 1981, Georgetown University Press: Georgetown. p. 177--195.Google Scholar
- Nakatani, C., et al., Instructions for annotating discourses, 1995, Center for Research in Computing Technology, Harvard University: Technical Report Number TR-21-95. Cambridge, MA.Google Scholar
Recommendations
Multimodal multiparty social interaction with the furhat head
ICMI '12: Proceedings of the 14th ACM international conference on Multimodal interactionWe will show in this demonstrator an advanced multimodal and multiparty spoken conversational system using Furhat, a robot head based on projected facial animation. Furhat is a human-like interface that utilizes facial animation for physical robot heads ...
Multimodal Analysis of Interruptions
Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. Anthropometry, Human Behavior, and CommunicationAbstractDuring an interaction, interactants exchange speaking turns. Exchanges can be done smoothly or through interruptions. Listeners can display backchannels, send signals to grab the speaking turn, wait for the speaker to yield the turn, or even ...
Multimodal Interaction During Multiparty Dialogues: Initial Results
ICMI '02: Proceedings of the 4th IEEE International Conference on Multimodal InterfacesGroups of people involved in collaboration on a task often incorporate the objects in their mutual environment into their discussion. With this comes physical reference to these 3-D objects, including: gesture, gaze, haptics, and possibly other ...
Comments