Book•
The Routledge handbook of multimodal analysis
01 Jan 2009-
TL;DR: Theoretical and Methodological Tools for Multimodal Analysis as mentioned in this paper is a toolkit for multimodal analysis with a focus on the analysis of the transmodal moment.
Abstract: Introduction: Handbook Rationale, Scope and Structure Part 1 Theoretical And Methodological Tools For Multimodal Analysis 1.An Introduction to multimodalit 2. Different approaches to multimodality 3.What are multimodal data and transcription? 4.What is mode? 5.Parametric systems: the case of voice quality Theo van Leeuwen 6. Modal density and modal configurations: multimodal actions 7. Transformation, transduction and the transmodal moment Part 1 readings Par 2 Key themes for multimodality 8. Historical Changes in the Semiotic Landscape From Calculation to Computation 9. Technology and Sites of Display 10. Multimodality and Mobile Culture 11. Multimodality, Identity, and Time 12. Multimodality and reading: the construction of meaning through image-text interaction 13. Power, social justice and multimodal pedagogies Part 3 Multimodality across different theoretical perspectives 14. Multimodality and language: A retrospective and prospective view 15. Multimodality and theories of the visual 16. Multimodality and New Literacy Studies 17. Using Multimodal Corpora for Empirical Research 18. Critical Discourse Analysis and multimodality 19. Semiotic paradigms and multimodality 20. Reception of multimodality: Applying eye-tracking methodology in multimodal research 21. Representations in practices: A socio-cultural approach to multimodality in reasoning 22. Indefinite precision: artefacts and interaction in design 23. Anthropology and Multimodality: The Conjugation of the Senses Part 4 Multimoda Case Studies 24. Practical function and meaning: a case study of Ikea tables 2 The use of gesture in operations 26. Gesture and Movement in Tourist Spaces 2 The kineikonic mode: towards a multimodal aproach to moving image media 28. Multimodal Analytics: Software and Visualization Techniques for Analyzing and Interpreting Multimodal Data 29. Colour: code, mode, modality -- the case of.
Citations
More filters
TL;DR: This paper investigated the representation of social values and their ontogenetic development in English as a foreign language textbooks in Hong Kong and found that the social values change from the personal domain (e.g. good hygiene and healthy lifestyle), through the interpersonal domain, to the altruistic concern for all mankind.
Abstract: This paper investigates the representation of social values and their ontogenetic development in English as a foreign language textbooks in Hong Kong. Adopting a social semiotic approach, it considers social values in textbooks as semantic categories which are constructed by complex semiotic discursive resources, and develops an explicit framework to model what values are selected and how the values are constructed. Analysis of 19 textbooks from Primary 1 to Secondary 4–6 shows that the social values change from the personal domain (e.g. good hygiene and healthy lifestyle), through the interpersonal domain (e.g. politeness and respect), to the altruistic concern for all mankind. The result also suggests that the textbooks are more concerned with the didactic education of good citizens than with cultivating children’s critical thinking. The analytical framework and the findings can be used for the explicit instruction and critical analysis of social values in English language teaching.
32 citations
Cites background from "The Routledge handbook of multimoda..."
...As Machin (2009) explains, describing multimodal texts on the basis of a semiotic theory is ‘to replace commonsensical terms such as “evoke” and “suggest” that we often use with systematic and stable terms that allow us to talk in concrete terms about how such a composition communicates’ (p. 182)....
[...]
TL;DR: In this article, the authors argue that understanding the complexity of dialogue interaction requires careful investigation of the interplay between multiple interactional resources, i.e., verbal in conjunction with visual, aural, embodied and spatial meaning-making resources.
Abstract: Research in Dialogue Interpreting (DI) has traditionally drawn on qualitative analysis of verbal
behaviour to explore the complex dynamics of these ‘triadic’ exchanges. Less attention has been
paid to interpreter-mediated interaction as a situated, embodied activity where resources other
than talk (such as gaze, gestures, head and body movement, proxemics) play a central role in the
co-construction of the communicative event. This article argues that understanding the complexity
of DI requires careful investigation of the interplay between multiple interactional resources, i.e.
verbal in conjunction with visual, aural, embodied and spatial meaning-making resources. This call
for methodological innovation is strengthened by the emergence of video-mediated interpreting,
where interacting via screens without sharing the same physical space adds a further layer of
complexity to interactional dynamics. Drawing on authentic extracts from interpreter-mediated
interaction, both face-to-face and video-mediated, this article problematizes how the integration
of a multimodal perspective into qualitative investigation of interpreter-mediated interaction can
contribute to the advancement of our understanding of key interactional dynamics in DI and, in
turn, broaden the scope of multimodality to include new, uncharted territory.
31 citations
Cites background from "The Routledge handbook of multimoda..."
...…new perspective of “representation, communication and interaction as something more than language” (Jewitt 2013:1), and has been adopted by researchers from diverse theoretical and methodological perspectives to investigate how verbal and embodied resources interact to create meaning (Jewitt 2014)....
[...]
TL;DR: In this article, the authors explore how the ongoing development of young children's understanding of visual art and design would affect their comprehension, interpretation and analysis of the artwork in a selection of picturebooks.
Abstract: One of the purposes of the classroom-based research featured in this article was to explore how the ongoing development of young children’s understanding of elements of visual art and design would affect their comprehension, interpretation and analysis of the artwork in a selection of picturebooks. Social semiotics, multimodality, sociocultural theory and transactional theory framed the study, as well as the analysis and discussion of the data featured in this article. Further, the reading of and writing about the picturebooks were situated in the four roles/practices required for reading multimodal and visual texts. During a nine-week period, 22 seven- and eight-year-old students participated in several activities that focused on learning about specific elements of visual art and design. The students read, talked about and responded in writing to a selection of picturebooks. This article features an analysis of the students’ responses to two picturebooks and discusses what the students’ text-based writin...
31 citations
TL;DR: In this paper, a framework for analysing multimodal legitimation is proposed, based upon work on legitimation by Van Leeuwen and Van Dijk, and a six-layer framework is proposed.
Abstract: This article introduces a framework for analysing multimodal legitimation. Building upon work on legitimation by Van Leeuwen and Van Dijk, a six-layer framework is proposed. This framework pulls to...
31 citations
Cites background from "The Routledge handbook of multimoda..."
...Kress and Van Leeuwen (1996), Kress (2010), Jewitt (2009), Bignell (2002) and Van Leeuwen (2005) have been of primary importance in drawing out questions concerning both how multimodal analyses can be conducted and the discursive and necessarily political dimension which a social semiotics entails....
[...]
TL;DR: Results indicate that Busuu is an ecological system composed of nested sub-systems that reflect structural, interactional, and ecological views of language that interweave in conflicting and complementary ways.
Abstract: Social networking has compelled the area of computer-assisted language learning (CALL) to expand its research palette and account for new virtual ecologies that afford language learning and socialization. This study focuses on Busuu, a social networking site for language learning (SNSLL), and analyzes the views of language that are enacted through the semiotic design of this participatory online environment. The study draws on methodological principles of multimodality to examine the website and data collected through auto-ethnographic accounts of the researcher, who participated as a member of the Busuu community for 10 weeks. Results indicate that Busuu is an ecological system composed of nested sub-systems that reflect structural, interactional, and ecological views of language that interweave in conflicting and complementary ways. Suggestions to improve SNSLLs concern the need to reach alignment in terms of the theoretical and pedagogical tenets that underscore the design of instructional materials. I...
31 citations