The Routledge handbook of multimodal analysis

What is multimodal critical discourse studies

Abstract: Discourses are communicated not only through political speeches and news items but through entertainment media such as computer games and movies, in the social and material culture of everyday life...

Teaching Multimodal and Digital Literacy in L2 Settings: New Literacies, New Basics, New Pedagogies

Abstract: Globalization and digitization have reshaped the communication landscape, affecting how and with whom we communicate, and deeply altering the terrain of language and literacy education. As children in urban contexts become socialized into communities of increasing cultural and communicational connectivity, complexity, and convergence (Jenkins, 2004), and funding for specialist second language (L2) support declines, classrooms have become linguistically heterogeneous spaces where every teacher is a teacher of L2 learners.This article has two purposes: The first is to give an overview of the concept of multimodal literacies, which utilize diverse media to represent visual, audio, gestural, spatial, and tactile dimensions of communication in addition to traditional written and oral forms (Cope & Kalantzis, 2009a). Since the New London Group's manifesto on multiliteracies in 1996, which merged language and literacy education agendas in L2 teaching, language arts, media literacy, and cultural studies, new basics have developed that apply to all classrooms and all learners. Second, this article reviews and reports on innovative pedagogical approaches to multimodal literacies involving L2 learners. These are grounded theoretically (Cope & Kalantzis, 2009a, 2009b; Kress, 2003, 2010; New London Group, 1996) and epistemologically (de Castell & Jenson, 2003; Gee, 2009, 2010; Kellner, 2004; Lankshear & Knobel, 2003, 2006).

Multimodal interaction from a conversation analytic perspective

Abstract: This special issue of the Journal of Pragmatics has its origins in the International Conference on Conversation Analysis 10 (ICCA10), which took place in Mannheim (Germany) in July 2010. More than 650 scholars attended the conference, whose theme was ‘‘multimodal interaction’’. This volume includes papers based on the four plenary talks given at ICCA10 and four additional contributions related to the conference theme.

The use of videoconferencing to support multimodal interaction in an online language classroom

Abstract: The introduction of virtual learning environments has made new tools available that have the potential to support learner communication and interaction, thus aiding second language acquisition both from a psycholinguistic and a sociocultural point of view. This article focuses on the use of videoconferencing in the context of a larger exploratory study to find out how interaction was influenced by the affordances of the environment. Taking a mainly qualitative approach, the authors analysed the written and spoken interaction in recorded videoconferencing sessions, alongside examining some quantitative data to reveal participation patterns. Exploring language learning interaction in a synchronous online medium allows us to show how this is a process mediated by interaction with experts and peers as well as by the artefacts used (e.g., technology) and how learners use and combine multiple modes to make meaning. Our findings illustrate how an online videoconferencing environment with its multiple modalities can be used in language teaching, how teachers and learners adapt to the multimodal online environment and how new patterns of communication emerge in the process.

Beyond languages, beyond modalities: transforming the study of semiotic repertoires

Abstract: This paper presents a critical examination of key concepts in the study of (signed and spoken) language and multimodality. It shows how shifts in conceptual understandings of language use, moving from bilingualism to multilingualism and (trans)languaging, have resulted in the revitalisation of the concept of language repertoires. We discuss key assumptions and analytical developments that have shaped the sociolinguistic study of signed and spoken language multilingualism as separate from different strands of multimodality studies. In most multimodality studies, researchers focus on participants using one named spoken language within broader embodied human action. Thus while attending to multimodal communication, they do not attend to multilingual communication. In translanguaging studies the opposite has happened: scholars have attended to multilingual communication without really paying attention to multimodality and simultaneity, and hierarchies within the simultaneous combination of resources. The (socio)linguistics of sign language has paid attention to multimodality but only very recently have started to focus on multilingual contexts where multiple sign and/or multiple spoken languages are used. There is currently little transaction between these areas of research. We argue that the lens of semiotic repertoires enables synergies to be identified and provides a holistic focus on action that is both multilingual and multimodal.