scispace - formally typeset
Search or ask a question
Book

The Routledge handbook of multimodal analysis

01 Jan 2009-
TL;DR: Theoretical and Methodological Tools for Multimodal Analysis as mentioned in this paper is a toolkit for multimodal analysis with a focus on the analysis of the transmodal moment.
Abstract: Introduction: Handbook Rationale, Scope and Structure Part 1 Theoretical And Methodological Tools For Multimodal Analysis 1.An Introduction to multimodalit 2. Different approaches to multimodality 3.What are multimodal data and transcription? 4.What is mode? 5.Parametric systems: the case of voice quality Theo van Leeuwen 6. Modal density and modal configurations: multimodal actions 7. Transformation, transduction and the transmodal moment Part 1 readings Par 2 Key themes for multimodality 8. Historical Changes in the Semiotic Landscape From Calculation to Computation 9. Technology and Sites of Display 10. Multimodality and Mobile Culture 11. Multimodality, Identity, and Time 12. Multimodality and reading: the construction of meaning through image-text interaction 13. Power, social justice and multimodal pedagogies Part 3 Multimodality across different theoretical perspectives 14. Multimodality and language: A retrospective and prospective view 15. Multimodality and theories of the visual 16. Multimodality and New Literacy Studies 17. Using Multimodal Corpora for Empirical Research 18. Critical Discourse Analysis and multimodality 19. Semiotic paradigms and multimodality 20. Reception of multimodality: Applying eye-tracking methodology in multimodal research 21. Representations in practices: A socio-cultural approach to multimodality in reasoning 22. Indefinite precision: artefacts and interaction in design 23. Anthropology and Multimodality: The Conjugation of the Senses Part 4 Multimoda Case Studies 24. Practical function and meaning: a case study of Ikea tables 2 The use of gesture in operations 26. Gesture and Movement in Tourist Spaces 2 The kineikonic mode: towards a multimodal aproach to moving image media 28. Multimodal Analytics: Software and Visualization Techniques for Analyzing and Interpreting Multimodal Data 29. Colour: code, mode, modality -- the case of.
Citations
More filters
Journal ArticleDOI
TL;DR: The authors identify three major challenges of using video to capture social practices: (1) getting close enough to details without losing context, (2) encountering the most severe consequence of "death by data", and (3) representing data so that an audience can actually assess whether inferences drawn from the data are plausible.
Abstract: Audio- and video-recordings are increasingly popular data sources in contemporary qualitative research, making discussions about methodological implications of such recordings timelier than ever. This article goes beyond discussing practical issues and issues of ‘camera effect’ and reactivity to identify three major challenges of using video to ‘capture’ social practices: (1) getting close enough to details without losing context, (2) encountering the most severe consequence of ‘death by data’ – namely magnifying events that may not be significant to participants, and finally, (3) representing data so that an audience can actually assess whether inferences drawn from the data are plausible. These important issues directly impact the credibility of qualitative research relying on video. The article combines existing literature with contemporary examples from educational research to critically discuss these three key challenges and some possible ways of addressing them.

59 citations


Cites background from "The Routledge handbook of multimoda..."

  • ...Flewitt et al. (2009) pointed out that non-linguistic elements ‘provide data whose significance is frequently lost in translation, or reduced to the status of context’....

    [...]

  • ...The final key challenge in this article, the issue of the representation of data, has also been welldiscussed by others (Flewitt et al. 2009; Hammersley 2010; Heath, Hindmarsh, and Luff 2010)....

    [...]

Book ChapterDOI
30 Apr 2014
TL;DR: In this article, Sperber and Wilson's Relevance Theory/RT is applied to multimodal discourse, where the focus of attention is the visual mode, sometimes accompanied by the written verbal mode, but the reasoning developed here is generalizable to other modes.
Abstract: Elaborating on my earlier work (Forceville 1996: chapter 5, 2005, 2009; see also Yus 2008), I will here sketch how discussions of visual and multimodal discourse can be embedded in a more general theory of communication and cognition: Sperber and Wilson’s Relevance Theory/RT (Sperber and Wilson 1986, 1995; Wilson and Sperber 2004, 2012). The focus of attention will be the visual mode, sometimes accompanied by the written verbal mode, but the idea is that the reasoning developed here is generalizable to other (combinations of) modes. Such a project should benefit both multimodality theory, which urgently needs more rigorous analytic models than have hitherto been proposed for it, and RT, which while claiming to hold for all forms of communication has been mainly applied to its spoken verbal varieties.

58 citations

Book
21 Jul 2014
TL;DR: In this paper, a detailed study of Arandic sand stories is presented, which takes a multimodal approach to the analysis of the stories and shows how the expressive elements used in the stories are orchestrated together.
Abstract: Sand stories from Central Australia are a traditional form of Aboriginal women's verbal art that incorporates speech, song, sign, gesture and drawing. Small leaves and other objects may be used to represent story characters. This detailed study of Arandic sand stories takes a multimodal approach to the analysis of the stories and shows how the expressive elements used in the stories are orchestrated together. This richly illustrated volume is essential reading for anyone interested in language and communication. It adds to the growing recognition that language encompasses much more than speech alone, and shows how important it is to consider the different semiotic resources a culture brings to its communicative tasks as an integrated whole rather than in isolation.

57 citations

Journal ArticleDOI
TL;DR: An instructional approach developed to teach multimodal texts and the trial of the approach in a secondary school in Singapore are described, informed by Systemic Functional Theory and aligned to the Learning by Design Framework widely used in multiliteracies.
Abstract: This article argues for the importance of teaching multimodal literacy in schools so as to adequately equip students to navigate the multimodal communicative landscape. Developing multimodal literacy in students is about developing in them the ability to view multimodal texts critically and for them to represent their ideas through the production of effective multimodal texts. This article describes an instructional approach developed to teach multimodal texts and describes the trial of the approach in a secondary school in Singapore. The approach is informed by Systemic Functional Theory and is aligned to the Learning by Design Framework widely used in multiliteracies. The systemic functional approach provides scaffolds for students to access the meanings made in multimodal texts by introducing the features and typical functions of the text, as well as highlighting the common strategies used in these multimodal texts to make meaning.

57 citations

Journal ArticleDOI
TL;DR: There has been a marked shift away from conceptualizing literacy as a functional skill set toward its recognition, particularly for children and youth, as a social achiev... as discussed by the authors,.
Abstract: Over the past few decades, there has been a marked shift away from conceptualizing literacy as a functional skill set toward its recognition, particularly for children and youth, as a social achiev...

56 citations


Cites background from "The Routledge handbook of multimoda..."

  • ...(Jewitt, 2009, p. 35; cf. Bezemer & Kress, 2008) We qualify our interpretation of a social semiotic approach as “broad” because we find it most helpful to recruit analytic tools from “mainstream semiotics” (Hodge & Kress, 1988), and diverse theories of communication and design, as well as the…...

    [...]