scispace - formally typeset
Search or ask a question
Book•

The Routledge handbook of multimodal analysis

Carey Jewitt
01 Jan 2009-
TL;DR: Theoretical and Methodological Tools for Multimodal Analysis as mentioned in this paper is a toolkit for multimodal analysis with a focus on the analysis of the transmodal moment.
Abstract: Introduction: Handbook Rationale, Scope and Structure Part 1 Theoretical And Methodological Tools For Multimodal Analysis 1.An Introduction to multimodalit 2. Different approaches to multimodality 3.What are multimodal data and transcription? 4.What is mode? 5.Parametric systems: the case of voice quality Theo van Leeuwen 6. Modal density and modal configurations: multimodal actions 7. Transformation, transduction and the transmodal moment Part 1 readings Par 2 Key themes for multimodality 8. Historical Changes in the Semiotic Landscape From Calculation to Computation 9. Technology and Sites of Display 10. Multimodality and Mobile Culture 11. Multimodality, Identity, and Time 12. Multimodality and reading: the construction of meaning through image-text interaction 13. Power, social justice and multimodal pedagogies Part 3 Multimodality across different theoretical perspectives 14. Multimodality and language: A retrospective and prospective view 15. Multimodality and theories of the visual 16. Multimodality and New Literacy Studies 17. Using Multimodal Corpora for Empirical Research 18. Critical Discourse Analysis and multimodality 19. Semiotic paradigms and multimodality 20. Reception of multimodality: Applying eye-tracking methodology in multimodal research 21. Representations in practices: A socio-cultural approach to multimodality in reasoning 22. Indefinite precision: artefacts and interaction in design 23. Anthropology and Multimodality: The Conjugation of the Senses Part 4 Multimoda Case Studies 24. Practical function and meaning: a case study of Ikea tables 2 The use of gesture in operations 26. Gesture and Movement in Tourist Spaces 2 The kineikonic mode: towards a multimodal aproach to moving image media 28. Multimodal Analytics: Software and Visualization Techniques for Analyzing and Interpreting Multimodal Data 29. Colour: code, mode, modality -- the case of.
Citations
More filters
Journal Article•DOI•
Representation of Butchulla cultural heritage values in communication of K'gari (Fraser Island) as a tourism destination

[...]

S. Brown1, Claudia Baldwin1, Lisa Chandler1•
University of the Sunshine Coast1
16 Mar 2015-Australasian Journal of Environmental Management
TL;DR: This article examined the degree to which indigenous values are visible in the promotion of K'gari as a tourism destination, through content and image analysis and found a lack of representation of indigenous culture in tourism marketing material, which misses the opportunity to share a rich history, makes indigenous perspectives visible for visitors and provides a different perspective to the values for which WH status is nominated.
Abstract: K'gari is a popular international tourism destination, having gained World Heritage (WH) status for its natural values. In spite of the local indigenous population, the Butchulla, having clear aspirations for its management, indigenous cultural heritage values have yet to be recognised in the listing. This project examined the degree to which indigenous values are visible in the promotion of K'gari as a tourism destination, through content and image analysis. The study found a lack of representation of indigenous culture in tourism marketing material. This acts to marginalise indigenous values and misses the opportunity to share a rich history, makes indigenous perspectives visible for visitors and provides a different perspective to the values for which WH status is nominated. The research provides recommendations about promoting indigenous cultural values in tourism and a future review of K'gari's WH status, as well as recommendations for further research.

7 citations

Cites background from "The Routledge handbook of multimoda..."

  • ...While images are valuable in capturing the viewer’s attention, they generally convey meaning (and the promoter’s message) more effectively when combined with text (Kress 2009; Kress and van Leeuwin 1996; Barthes 1977)....

    [...]

A Multimodal Seamless Learning Approach Supported by Mobile Digital Storytelling (mDS)

[...]

Susanna Nordmark
01 Jan 2018
TL;DR: The use of digital tools such as smartphones, tablets and laptops have shown potential to enhance teaching and learning in a wide variety of contexts.
Abstract: The use of digital tools such as smartphones, tablets and laptops have shown potential to enhance teaching and learning in a wide variety of contexts. 21st century skills such as creativity, proble ...

7 citations

Spinning the truth on social media: A textual analysis of health-related television advertisements

[...]

Nicole Isaacs
01 Jan 2015

7 citations

Cites background from "The Routledge handbook of multimoda..."

  • ...and the relationship between these different signs (Jewitt, 2009)....

    [...]

  • ...Multimodality is the study of multimodal signs – a theoretical approach which focusses on communicational aspects other than language such as image, gesture, gaze, posture etc. and the relationship between these different signs (Jewitt, 2009)....

    [...]

  • ...The social semiotic approach to multimodality on the other hand “grounds the notion of ‘mode’ in its cultural and material uses” or as Jewitt phrases it, “in a specific context (time and place) modes are shaped by the daily social interaction of people” (Jewitt, 2009c:21 cited in Gibbons, 2012)....

    [...]

Journal Article•DOI•
Multiplayer Games: Multimodal Features That Support Friendships of Students with Autism Spectrum Disorder.

[...]

Bessie G. Stone1, Kathy A. Mills1, Beth Saggers2•
Australian Catholic University1, Queensland University of Technology2
08 Dec 2019
TL;DR: In this paper, the authors describe how friendships of students with ASD were developed in an online multiplayer context using the popular sandbox game, Minecraft, and demonstrate that online multiplayer gaming supported students' use of speech to engage in conversations about their friendships, and to share gaming experiences with their offline and online friends.
Abstract: There is an absence of research into online friendships and video gaming activities of students with autism spectrum disorder (ASD). In this article we describe how friendships of students with ASD were developed in an online multiplayer context using the popular sandbox game, Minecraft. Multimodal analysis of the data demonstrated that online multiplayer gaming supported students’ use of speech to engage in conversations about their friendships, and to share gaming experiences with their offline and online friends. Online gaming enabled students to visually gather information about their friends’ online status and activities, and to engage in the creative and adventurous use of virtual images and material representations with friends. Despite the benefits for friendships, students with ASD experienced difficulties in friendships in multimodal ways. Notably, students engaged in verbal disagreements about video gaming discourses, sought out activities associated with the themes of death and damage using written text, and tended to dominate shared creations of virtual images and their representation. The findings have implications to better support the friendships of students through inclusive literacy practices online

7 citations

Cites background from "The Routledge handbook of multimoda..."

  • ...…of inclusive new literacies extends the notion of inclusive education to recognise the rights, literacies practices, and social needs of literacies learners, such as students with ASD, which has not been specifically addressed in the new literacy studies (CRPD, 2016; Street et al., 2017)....

    [...]

Journal Article•DOI•
Framing Diversity in Corporate Digital Contexts: A Multimodal Approach to Discursive Recontextualizations of Social Practices

[...]

Carmen Daniela Maier1, Silvia Ravazzani1•
Aarhus University1
01 Oct 2021-International journal of business communication
TL;DR: In this paper, the authors determine how discursive strategies employed by organizations to frame diversification are used to define and define diversification in the context of a company's organizational culture.
Abstract: Diversity has become a buzzword and a “must-have” corporate practice for contemporary organizations. This article aims to determine how discursive strategies employed by organizations to frame dive...

7 citations

Cites background from "The Routledge handbook of multimoda..."

  • ...These platforms empower corporate communicators (Argenti & Barnes, 2009; Cornelissen, 2014) and give room to other semiotic modes than language only (Jewitt, Bezzemer, & O’Halloran, 2016; Kress, 2009; van Leeuwen, 2005)....

    [...]

  • ...Thus, the selection of particular discursive strategies takes place not just verbally, but through images, gestures, sounds, and their interplay (Jewitt et al., 2016; Kress, 2009; Maier, 2017; van Leeuwen, 2005)....

    [...]

Related Papers (5)
Reading Images: The Grammar of Visual Design

[...]

02 May 1996
Gunther Kress, Theo van Leeuwen
Multimodal Discourse: The Modes and Media of Contemporary Communication

[...]

01 Jan 2001
Gunther Kress, T van Leeuwen
Literacy in the New Media Age

[...]

01 Jan 2003
Gunther Kress
An Introduction to Functional Grammar

[...]

01 Jan 1985
Michael Halliday
Language as social semiotic : the social interpretation of language and meaning

[...]

01 Jan 1978
Michael Halliday