scispace - formally typeset
Search or ask a question
Book

The Routledge handbook of multimodal analysis

01 Jan 2009-
TL;DR: Theoretical and Methodological Tools for Multimodal Analysis as mentioned in this paper is a toolkit for multimodal analysis with a focus on the analysis of the transmodal moment.
Abstract: Introduction: Handbook Rationale, Scope and Structure Part 1 Theoretical And Methodological Tools For Multimodal Analysis 1.An Introduction to multimodalit 2. Different approaches to multimodality 3.What are multimodal data and transcription? 4.What is mode? 5.Parametric systems: the case of voice quality Theo van Leeuwen 6. Modal density and modal configurations: multimodal actions 7. Transformation, transduction and the transmodal moment Part 1 readings Par 2 Key themes for multimodality 8. Historical Changes in the Semiotic Landscape From Calculation to Computation 9. Technology and Sites of Display 10. Multimodality and Mobile Culture 11. Multimodality, Identity, and Time 12. Multimodality and reading: the construction of meaning through image-text interaction 13. Power, social justice and multimodal pedagogies Part 3 Multimodality across different theoretical perspectives 14. Multimodality and language: A retrospective and prospective view 15. Multimodality and theories of the visual 16. Multimodality and New Literacy Studies 17. Using Multimodal Corpora for Empirical Research 18. Critical Discourse Analysis and multimodality 19. Semiotic paradigms and multimodality 20. Reception of multimodality: Applying eye-tracking methodology in multimodal research 21. Representations in practices: A socio-cultural approach to multimodality in reasoning 22. Indefinite precision: artefacts and interaction in design 23. Anthropology and Multimodality: The Conjugation of the Senses Part 4 Multimoda Case Studies 24. Practical function and meaning: a case study of Ikea tables 2 The use of gesture in operations 26. Gesture and Movement in Tourist Spaces 2 The kineikonic mode: towards a multimodal aproach to moving image media 28. Multimodal Analytics: Software and Visualization Techniques for Analyzing and Interpreting Multimodal Data 29. Colour: code, mode, modality -- the case of.
Citations
More filters
Journal ArticleDOI
TL;DR: This article examined the impact of Becoming a Nation of Readers: The Report of the Commission on Reading (BNR) (Anderson, Hiebert, Scott, & Wilkinson, 1985) with the idea of extending literacy learning beyon...
Abstract: We examine the impact of Becoming a Nation of Readers: The Report of the Commission on Reading (BNR) (Anderson, Hiebert, Scott, & Wilkinson, 1985) with the idea of extending literacy learning beyon...

7 citations


Cites background from "The Routledge handbook of multimoda..."

  • ...In this cosmopolitan space (Hull & Stornaiuolo, 2014), many new forms of learning and new ways of knowing collide (Leander & Vasudevan, 2009)....

    [...]

Journal ArticleDOI
10 Dec 2020
TL;DR: In this paper, a discussion of epistemologic aspects of the Linguistica Aplicada and ensino de linguas estrangeiras in the context of multimodal systems is presented.
Abstract: Este texto se propoe a discutir as nocoes de modo e de letramento multimodal e sua relevância para o campo de ensino de linguas estrangeiras inserido na cultura das midias, dado ao fato de que aprendizes, no ensino fundamental, medio, superior e em cursos de idiomas, tem acesso constante a tecnologias digitais moveis para o seus processos de aprendizagem e, por essa razao, estao em continuo contato com multimodalidades propiciadas pelas novas tecnologias. Interessa-nos, sobremaneira, a discussao sobre os aspectos epistemologicos no campo da Linguistica Aplicada e ensino de linguas estrangeiras e o papel que a multimodalidade e o letramento multimodal exercem nessas praticas, essenciais ao ensino e a aprendizagem das tais linguas e a formacao de professores de que irao ministra-las.

7 citations


Cites background from "The Routledge handbook of multimoda..."

  • ...…modos servem e as propiciações que possibilitam, uma vez que o autor está tratando de uma abordagem sociossemiótica e, numa abordagem dessa natureza, a ênfase deve ser posta no aspecto material do modo, mas também no aspecto cultural ao longo do tempo em que tal modo foi usado (KRESS, 2017, p. 61)....

    [...]

Dissertation
01 Jan 2016

7 citations


Cites background or methods from "The Routledge handbook of multimoda..."

  • ...The notion of multimodality was further refined through the work of Kress and Van Leeuwen (1996, 2001, 2002); Jewitt and Kress (2003); and Kress (2010)....

    [...]

  • ...…systemic functional grammar (SFG) as its core approach, emphasising Halliday’s characterisation of the sign system into ideational, interpersonal and textual metafunctions, which was interpreted in the visual domain by Kress and Van Leeuwen (Kress & Van Leeuwen, 1996, p. 54; Jewitt, 2009, p. 29)....

    [...]

  • ...The term ‘multimodality’ was coined by linguists in the mid-1990s to name practices of sign-making that combine and integrate different modes and media of communication, for example sounds (produced by human beings and by musical instruments), written text, pictures and gestures (Kress & Van Leeuwen, 1996, 2001; Kress & Ogborn, 1998; Jewitt, 2009; Machin, 2007; Kress, 2010)....

    [...]

  • ...In the modal taxonomies of scholars such as Jewitt (2007), O’Halloran (2008), Stein (2008) and Kress (2010) movement, which is a visual mode, has almost been elevated to the status of a primary mode....

    [...]

  • ...© University of Pretoria 42 Jewitt (2007; 2009) seems to entertain a similar argument around the notion of visual grammar as Szczelkun (2010) in terms of seeing grammar not only as a set of fixed rules applied to language, but as a set of socially shaped resources to make meaning....

    [...]

Journal ArticleDOI
TL;DR: This article examined language learners' critical multimodal literacy practices with a moving-image text, focusing on text comprehension and interpretation rather than text production, and found that focusing on images, sounds, words and their purposeful organization enabled the students to critically examine a moving image text through considerations for the multiple modes and arriving at the structural and ideological interpretive perspectives.
Abstract: Purpose This paper aims to examine language learners’ critical multimodal literacy practices with a moving-image text, focusing on text comprehension and interpretation rather than text production. It takes a critical perspective towards multimodality and proposes the simultaneous emphasis on critical and multimodal literacies. Design/methodology/approach This qualitative teacher-inquiry adopts critical multimodal literacy as the framework for understanding learners’ literacy practices. The course implementation highlights images, sounds and words as encompassing the five modes of visual, aural, linguistic, gestural and spatial (Arola et al., 2014) in emphasizing the multimodal in critical multimodal literacy, and the purposeful organization of the images, sounds and words as reflecting the critical in critical multimodal literacy. The analysis also adopts Serafini’s (2010) concentric perceptual, structural and ideological perspectives as the tenets of critical multimodal literacy. Findings The findings show that focusing on images, sounds, words and their purposeful organization enabled the students to critically examine a moving-image text through considerations for the multiple modes and arriving at the structural and ideological interpretive perspectives. Originality/value This study fills a gap in the literature, as very little research has been done to investigate the ways in which language learners engage with, that is, comprehend and interpret, moving-image multimodal texts. In addition, it presents a critical multimodal literacy framework based on Serafini’s (2010) tripartite perspectives and offers pedagogical suggestions for incorporating critical multimodal literacy in language classrooms.

7 citations

Journal ArticleDOI
TL;DR: The semiotic character of requirement representation is revealed by mobilising a social semiotic analytic framework to reveal how project artefacts are multimodal resources that critically affect stakeholder engagement and interpretation.
Abstract: The semiotic nature of design and engineering communications has often evaded direct interrogation; specifically the representation of requirements using multiple semiotic modes. This paper...

7 citations