Elsevier

System

Volume 77, October 2018, Pages 19-27
System

Developing university students’ multimodal communicative competence: Field research into multimodal text studies in English

https://doi.org/10.1016/j.system.2018.01.004Get rights and content

Abstract

Reconsideration of Hymes' concept of communicative competence within a multimodal perspective implies that learners of a foreign language should develop a metalanguage that enables them to talk about how semiotic resources are co-deployed in specific texts and to relate their insights to these texts' contexts of situation and culture. This article reports on how research into multimodality, developed within Halliday's systemic functional framework, has been integrated into a university syllabus for text studies in English through a specific course designed to achieve this goal. In other words, students engaged in text analysis activities using analytical tools that guided them in the exploration of the complex array of semiotic resources that contribute to a text's meaning, but within a wider-ranging syllabus whose ultimate goal is to promote overall communicative competence. The article describes instruments for multimodal text analysis and sample materials created for the course. It then draws conclusions about the feasibility and benefits of an approach to text studies in English that fosters multimodal communicative competence, which naturally has an important metacommunicative component as it encourages reflection on texts.

Introduction

The use of authentic texts in language teaching is nothing new; what is new are the frameworks and models through which language practitioners use these texts in the language classroom. With the onset of the communicative approach in the 1970s, many (e.g. Cook, 1981, Little et al., 1988, Morrow, 1977, Wilkins, 1976) advocated the use of authentic texts, such as radio and television broadcasts, recipes, leaflets and advertisements, which were slowly introduced into the language classroom. These texts were considered “as a main source of the target language input” (Little, Devitt, & Singleton, 1994: 43), that were particularly useful in helping learners understand the language used, as well as the target culture, and “the means by which [the learner] can bridge the gap between classroom knowledge and an effective capacity to participate in real language events” (Wilkins, 1976: 79). At present, these materials are still present in the language classroom, but with the rapid spread of research into multimodal discourse that has ultimately been triggered by the rise of digital genres and media, their use in many contexts goes beyond a linguistic component and embraces other semiotic resources with which language functions (e.g. images, gestures and movement).

The intention of this article is to contribute to research into multimodal pedagogies in the context of English language teaching and learning in higher education. In particular, it provides a proposal under which upper-intermediate students of English as a foreign language at university level are provided with analytical frameworks and methods for multimodal text analysis developed within Halliday (1978) social semiotic approach to communication (e.g. Kress and van Leeuwen, 2006, Baldry and Thibault, 2006, Eggins, 2004). The proposal includes genre-focused activities whose ultimate goal is to raise students' awareness of the multimodal nature of meaning-making in English in today's world.

The article is arranged as follows: Section 2 reviews the literature most relevant to this study in an attempt to interpret the term multimodal communicative competence (Royce, 2002, Royce, 2007), which represents the main focus of this article. Section 3 provides a description of the objectives of the study and the learning context in which this course was carried out, while Section 4 describes two classroom applications created for the course based on two authentic multimodal texts, namely a procedural text and a pedagogical animation. Finally, Section 5 draws some conclusions about the feasibility and benefits of the multimodal approach in the course, and suggests future steps for its further implementation.

Section snippets

Literature review

Undoubtedly, constant advances in communication technology have revolutionized our ways of interacting and led to the emergence and diffusion of new text genres, especially multimodal ones (Cambria et al., 2012, Campagna et al., 2012). The affordances provided by social media platforms, such as Facebook, Twitter, and WhatsApp, allow us to combine different modes of meaning to fulfil a number of communicative purposes, including sharing our feelings, narrating either wonderful, terrifying or

Objectives

This article provides two examples of classroom applications which illustrate how a multimodal approach to discourse analysis can prepare students of English as a foreign language at university level and assist them in the understanding of multimodal texts and genres characterizing contemporary society. The goal is to help them develop their multimodal communicative competence and become more competent text users as advocated in the Introduction of this article. The article shows that the use

Fostering multimodal communicative competence: two classroom applications

The following subsections describe two activities created for the course which illustrate the methodology and tools used to foster the multimodal communicative competence of the students attending the second-year English Language course. The activities focus on two texts exemplifying two different genres: the first text is an extract from The Simpsons™ House by LEGO1 and exemplifies what the instruction genre has typically turned into in the

Conclusions

The study presented in this article has provided a pedagogical proposal illustrating how research into multimodality, developed within the Systemic Functional Linguistics framework, can be integrated into a university syllabus for text studies in English to foster multimodal communicative competence.

The analysis sessions carried out in class, as the one illustrated in Section 4.2 vis-à-vis the Pedagogical Animation genre, showed that over the course the students developed a greater awareness of

Funding

This research has not received any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Disclaimer

The copyrights of Fig. 1 are owned by the LEGO group.

Acknowledgements

I am very grateful to Anthony Baldry for commenting and proofreading this article.

References (55)

  • L. Ajayi

    English as a second language learners' exploration of multimodal texts in a junior high school

    Journal of Adolescent & Adult Literacy

    (2009)
  • A. Baldry

    English in a visual society: Comparative and historical dimensions in multimodality and multimediality

  • A. Baldry

    Multimodal web genres. Exploring scientific English. Como-pavia: Ibis

    (2012)
  • A. Baldry et al.

    Multimodal transcription and text analysis. A multimedia toolkit and coursebook. London & oakville: Equinox

    (2006)
  • J. Bezemer et al.

    Multimodal transcription as academic practice: A social-semiotic perspective

    International Journal of Social Research Methodology

    (2011)
  • D. Biber et al.

    Longman grammar of spoken and written English

    (1999)
  • S. Campagna et al.

    Multimodal business and economics. Milano: LED

    (2009)
  • M. Canale

    From communicative competence to communicative language pedagogy

  • M. Canale et al.

    Theoretical bases of communicative approaches to second language teaching and testing

    Applied Linguistics

    (1980)
  • M. Celce-Murcia

    Rethinking the role of communicative competence in language teaching

  • M. Celce-Murcia et al.

    A pedagogical framework for communicative competence: A pedagogically motivated model with content specifications

    Issues in Applied Linguistics

    (1995)
  • N. Chomsky

    Aspects of the theory of syntax

    (1965)
  • V. Cook

    Using authentic materials in the classroom

    Modern English Teacher

    (1981)
  • Council of Europe

    Common European framework of reference for languages: Learning, teaching, assessment

    (2001)
  • S. Eggins

    An introduction to systemic functional linguistics

    (2004)
  • R. Flewitt et al.

    What are multimodal data and transcription?

  • M. Gotti

    Investigating specialized discourse. New edition

    (2011)
  • M.A.K. Halliday

    Language as social semiotic. The social interpretation of language and meaning

    (1978)
  • M.A.K. Halliday

    Part A

  • M.A.K. Halliday et al.

    Halliday's introduction to functional grammar

    (2014)
  • R. Hampel et al.

    Computer-mediated language learning: Making meaning in multimodal virtual learning spaces

    The JALT CALL Journal

    (2006)
  • D.H. Hymes

    On communicative competence

  • Cited by (28)

    • Stories behind the scenes: L2 students’ cognitive processes of multimodal composing and traditional writing

      2023, Journal of Second Language Writing
      Citation Excerpt :

      Teachers who embrace the social semiotic theory have designed a variety of multimodal tasks and projects with the central goal of helping students become more aware of the modal affordance in different rhetorical situations (Grapin, 2019). Previous research adopting this view showed that through active engagement with multimodal resources, students have the opportunity to critically discuss social issues (Darvin, 2015; Huang, 2015), convey and construct multiple identities (Ajayi, 2008; Ho, Nelson, & Müeller-Wittig, 2011), develop autonomy in learning (Hafner & Miller, 2011), and grow multimodal communicative competence (Coccetta, 2018; Smith, 2018). On the other hand, multimodality, especially the use of nonlinguistic modes, is treated by some scholars as “a crutch or temporary scaffold to be removed once students develop proficiency with more privileged forms of communication, namely, oral and written language” (Grapin, 2019, p. 33).

    • Developing multimodal communicative competence: Insights from “semantic gravity” and the Knowledge Process framework

      2021, System
      Citation Excerpt :

      However, explicitly teaching students a metalanguage is still not popular in EFL multimodal classrooms. While Coccetta (2018), as a valuable exception, elucidated how a metalanguage could aid EFL students' multimodal text analysis, more information is needed to plan and sequence activities in multimodal pedagogies that develop students' abilities to interpret and produce multimodal texts. As such, our study seeks to demonstrate how multimodal practices (SG+) and multimodal concepts (SG-) can be systematically integrated into EFL pedagogies, informed by the Knowledge Process framework.

    • SYSTEMIC FUNCTIONAL LINGUISTICS AND THE (EXPANDED) TEACHING AND LEARNING CYCLE

      2023, Conducting Genre-Based Research In Applied Linguistics: A Methodological Guide
    View all citing articles on Scopus
    View full text