scispace - formally typeset
Search or ask a question
Book

The Routledge handbook of multimodal analysis

01 Jan 2009-
TL;DR: Theoretical and Methodological Tools for Multimodal Analysis as mentioned in this paper is a toolkit for multimodal analysis with a focus on the analysis of the transmodal moment.
Abstract: Introduction: Handbook Rationale, Scope and Structure Part 1 Theoretical And Methodological Tools For Multimodal Analysis 1.An Introduction to multimodalit 2. Different approaches to multimodality 3.What are multimodal data and transcription? 4.What is mode? 5.Parametric systems: the case of voice quality Theo van Leeuwen 6. Modal density and modal configurations: multimodal actions 7. Transformation, transduction and the transmodal moment Part 1 readings Par 2 Key themes for multimodality 8. Historical Changes in the Semiotic Landscape From Calculation to Computation 9. Technology and Sites of Display 10. Multimodality and Mobile Culture 11. Multimodality, Identity, and Time 12. Multimodality and reading: the construction of meaning through image-text interaction 13. Power, social justice and multimodal pedagogies Part 3 Multimodality across different theoretical perspectives 14. Multimodality and language: A retrospective and prospective view 15. Multimodality and theories of the visual 16. Multimodality and New Literacy Studies 17. Using Multimodal Corpora for Empirical Research 18. Critical Discourse Analysis and multimodality 19. Semiotic paradigms and multimodality 20. Reception of multimodality: Applying eye-tracking methodology in multimodal research 21. Representations in practices: A socio-cultural approach to multimodality in reasoning 22. Indefinite precision: artefacts and interaction in design 23. Anthropology and Multimodality: The Conjugation of the Senses Part 4 Multimoda Case Studies 24. Practical function and meaning: a case study of Ikea tables 2 The use of gesture in operations 26. Gesture and Movement in Tourist Spaces 2 The kineikonic mode: towards a multimodal aproach to moving image media 28. Multimodal Analytics: Software and Visualization Techniques for Analyzing and Interpreting Multimodal Data 29. Colour: code, mode, modality -- the case of.
Citations
More filters
Journal ArticleDOI
Elin Westlund1
TL;DR: This paper explored visual formation of science content in multimodal compositions (text and image) made by students through their second school year, and aims to contribute to the body of knowledge in science.
Abstract: This article explores visual formation of science content in multimodal compositions (text and image) made by students through their second school year, and aims to contribute to the body o...

7 citations


Cites background or methods from "The Routledge handbook of multimoda..."

  • ...Data processing and method of analysis Data processing was carried out with a social semiotic multimodal analysis (Jewitt, 2011b), focussing on image and relations between image and writing....

    [...]

  • ...It would be interesting to see future studies exploring young students’ content representations put to use in classroom discussions about meaning-design processes and how different design choices shape the meaning of the content differently (Jewitt, 2011a; Kress et al., 2001)....

    [...]

  • ...Understanding how to make meaning with a variety of modes in science education is important because ‘the choice of mode […] is a central aspect of the epistemological shaping of knowledge and ideological design’ (Jewitt, 2011a, p. 15; Kress et al., 2001)....

    [...]

Journal ArticleDOI
TL;DR: In this article, the authors propose a multimodal analysis model through which it is possible to map and explain the multimodial persuasive strategies employed by Coca-Cola company in their community-related films.
Abstract: This article addresses how the multimodal persuasive strategies of corporate social responsibility communication can highlight a company’s commitment to gender empowerment and environmental protection while advertising simultaneously its products. Drawing on an interdisciplinary methodological framework related to CSR communication, multimodal discourse analysis and gender theory, the article proposes a multimodal analysis model through which it is possible to map and explain the multimodal persuasive strategies employed by Coca-Cola company in their community-related films. By examining the semiotic modes’ interconnectivity and functional differentiation, this analytical endeavour expands the existing research work as the usual textual focus is extended to a multimodal one.

7 citations

01 Jan 2013
TL;DR: In this article, the authors analyze the way in which the subject English Language IV of the degree English Studies at the University of Alicante combines the development of the five skills (listening, speaking, reading, writing and interacting) evaluated through a portfolio with multimodality in the teaching practices and in each of the activities that are part of the portfolio.
Abstract: espanolNuestra sociedad es cada vez mas tecnologica y multimodal por lo que es necesario que la ensenanza se adapte a los nuevos tiempos. Este articulo analiza el modo en que la asignatura Lengua Inglesa IV de la Licenciatura en Filologia Inglesa en la Universidad de Alicante combina el desarrollo de las cinco destrezas (escucha, habla, lectura, escritura e interaccion) evaluadas por medio de un portafolio con la multimodalidad en las practicas docentes y en cada una de las actividades que componen el portafolio. Los resultados de una encuesta preparada al final del curso academico 2011-2012 ponen de manifiesto las competencias principales que el alumnado universitario desarrolla gracias a la docencia multimodal y la importancia de las tutorias en este tipo de ensenanza EnglishOur society becomes more technological and multimodal and, consequently, teaching has to be adapted to the new time. This article analyses the way in which the subject English Language IV of the degree English Studies at the University of Alicante combines the development of the five skills (listening, speaking, reading, writing and interacting) evaluated through a portfolio with multimodality in the teaching practices and in each of the activities that are part of the portfolio. The results of a survey prepared at the end of the academic year 2011-2012 point out the main competences that university students develop thanks to multimodal teaching and the importance of tutorials in this kind of teaching

7 citations

Proceedings Article
01 Jan 2014
TL;DR: The Social Semiotic Multimodal (SSMM) framework is introduced, a framework based on multimodal extensions to Systemic Functional Linguistics, a semiotic theory of language to identify meanings associated with various social media conversations called Themed Clusters.
Abstract: There is a growing need to comprehensively understand how messages and online conversations construct and convey meanings especially when they are likely to be distributed across multiple social media platforms. This paper introduces a framework to address this need, the Social Semiotic Multimodal (SSMM) framework based on multimodal extensions to Systemic Functional Linguistics, a semiotic theory of language. The framework uses a set of expansion resources, to reveal how the meanings of social media messages are chained together to form online conversations. These meanings are frequently distributed across more than one social media platform. This semantic approach is exemplified using a case study, the Fairtrade Fortnight 2012 campaign. The framework is used to identify meanings associated with various social media conversations called Themed Clusters. The findings demonstrate the utility of semantic approaches for IS research and practice to analyse meanings within social media messages and how they form online conversations.

7 citations


Cites background from "The Routledge handbook of multimoda..."

  • ...SSMM attempts to reveal how semiotic resources, different modes and socio-cultural influences can impact meaning making, text deployment and text interpretation (Jewitt 2009b; Kress 2010)....

    [...]

  • ...…Marketing, University of Wollongong, Australia mmehmet@uow.edu.au Rodney J. Clarke School of Management, Operations & Marketing, University of Wollongong, Australia rclarke@uow.edu.au Karlheinz Kautz School of Management, Operations & Marketing, University of Wollongong, Australia kautz@uow.edu.au...

    [...]

  • ...Space does not permit a critical comparison of each and so the reader is directed to Jewitt (2009a) for that purpose....

    [...]

  • ...Modern communication scholars handle the complexity of new media in general, and social media in particular, in a familiar way, by drawing on different communications disciplines to develop a toolkit for analysis (Baldry and Thibault 2006, Jewitt 2009ab: Kress 2010; O’Halloran et al. 2010)....

    [...]

  • ...It is uncommon for a single media modality to be used when communicating new media meanings (Baldry and Thibault 2006; Jewitt 2009ab; Kress 2010; Kress and van Leeuwen 1996)....

    [...]

Journal ArticleDOI
TL;DR: In this article, a study on how language use and language development can be promoted through engaging students in different participation roles in board games was conducted, where a group of primary students learning English as a second language in Hong Kong participated in the games with alternating roles as players and facilitators.
Abstract: This article discusses a study on how language use and language development can be promoted through engaging students in different participation roles in board games. Theoretically, the study is grounded in sociocultural perspectives of activity theory and the role of play as a form of human motivation. A group of Grade 4 primary students learning English as a second language in Hong Kong participated in the games, with alternating roles as players and facilitators. Students’ discursive and embodied participation in the games was analysed to reveal how changing participation roles constitute a form of social-relational mediation that motivates students’ deployment of different interaction practices and multimodal semiotic resources to achieve context-sensitive, object-related and goal-directed actions in collaborative group activities. The data also show students’ agency and self-regulation when they enacted the same participation role with different subject positions and semiotic resources. This article ...

7 citations