Book•
The Routledge handbook of multimodal analysis
01 Jan 2009-
TL;DR: Theoretical and Methodological Tools for Multimodal Analysis as mentioned in this paper is a toolkit for multimodal analysis with a focus on the analysis of the transmodal moment.
Abstract: Introduction: Handbook Rationale, Scope and Structure Part 1 Theoretical And Methodological Tools For Multimodal Analysis 1.An Introduction to multimodalit 2. Different approaches to multimodality 3.What are multimodal data and transcription? 4.What is mode? 5.Parametric systems: the case of voice quality Theo van Leeuwen 6. Modal density and modal configurations: multimodal actions 7. Transformation, transduction and the transmodal moment Part 1 readings Par 2 Key themes for multimodality 8. Historical Changes in the Semiotic Landscape From Calculation to Computation 9. Technology and Sites of Display 10. Multimodality and Mobile Culture 11. Multimodality, Identity, and Time 12. Multimodality and reading: the construction of meaning through image-text interaction 13. Power, social justice and multimodal pedagogies Part 3 Multimodality across different theoretical perspectives 14. Multimodality and language: A retrospective and prospective view 15. Multimodality and theories of the visual 16. Multimodality and New Literacy Studies 17. Using Multimodal Corpora for Empirical Research 18. Critical Discourse Analysis and multimodality 19. Semiotic paradigms and multimodality 20. Reception of multimodality: Applying eye-tracking methodology in multimodal research 21. Representations in practices: A socio-cultural approach to multimodality in reasoning 22. Indefinite precision: artefacts and interaction in design 23. Anthropology and Multimodality: The Conjugation of the Senses Part 4 Multimoda Case Studies 24. Practical function and meaning: a case study of Ikea tables 2 The use of gesture in operations 26. Gesture and Movement in Tourist Spaces 2 The kineikonic mode: towards a multimodal aproach to moving image media 28. Multimodal Analytics: Software and Visualization Techniques for Analyzing and Interpreting Multimodal Data 29. Colour: code, mode, modality -- the case of.
Citations
More filters
TL;DR: In this article, the authors focus on the visual puns and allusions and the artistic expressivity in films, while Voellmer examines the metalinguistic references in a poly-lingual film Inglourious Basterds.
Abstract: next two chapters focus on translatability. Stojilkov concentrates on the visual puns and allusions and the artistic expressivity in films, while Voellmer examines the metalinguistic references in a poly-lingual film Inglourious Basterds. The final two chapters analyse adaption practices in comics and theatre: Fragonara examines the adaptation of SaintExupéry’s Le Petit Prince into the comic by Joann Sfar, and Tomàs-Albina examines the adaptation of Sophocle’s Electra into a stage production in Catalan. In this volume, we can discern several features around which the present cycle of multimodal research rotates. One of the striking features is that the research deals with multiple languages apart from English, including Spanish, Italian and German, and that the articles are written in both English and French, which places an extra load on readers but adds evidential weight to the cross-linguistic and cross-cultural perspectives mentioned previously. Another great attribute of the book is that the museology and education sections, although having a comparatively smaller number of contributions, are of high quality and thus pave the way for improving museological and pedagogical research in multimodal contexts. What is most striking, however, is that the contributions not only reflect diverse research backgrounds and perspectives on the spoken language and its fusion with other modalities, but they also touch upon a wide diversity of genres and texts, from multimodal communication in museum and school to virtual/chat communication on the Internet, from novel and film to comic and theatre, which creates a great opportunity for a wide readership to transcend narrow disciplinary boundaries and constitutes a significant point of reference for postgraduates and researchers from similar or other fields, who attempt to benefit from this approach to make a difference in the standards of practice in their own communities or to strike out in a new direction in the fields of pragmatics, sociolinguistics, applied linguistics, communication and discourse studies.
2 citations
01 Jan 2012
TL;DR: A framework for stress analytics is proposed and technologies facilitating management and exploration of multi-modal affective data captured in physiological signals, such as galvanic skin response and heart rate, as well as in facial expression, in speech and in written text are described.
2 citations
01 Dec 2018
TL;DR: This article explored the use of nonverbal language in the strategic part of Tesco's corporate annual report and found that the text producers of the annual report intend to create a positive image of the company and narrow the relationship with their target readers via the employment of discursive strategies.
Abstract: Drawing on the theory of Multimodal Critical Discourse Analysis (MCDA), this paper explores the language use in the strategic part of Tesco’s corporate annual report. By focusing on both visual and verbal modes employed in the selected text, the paper not only discusses their discursive features separately, but also investigates how they work as a whole in conveying the integrated messages and reflecting the ideology of the speakers. In addition, it adopts a new framework to further dig out the social issues and power relations hidden behind the discourse from three different layers. The main finding is: the text producers of the annual report intend to create a positive image of Tesco and narrow the relationship with their target readers via the employment of discursive strategies. Keywords—Multimodal Critical Discourse Analysis; nonverbal language; visual grammar; annual report
2 citations
Cites background or methods from "The Routledge handbook of multimoda..."
...Based on Jewitt’s study [17], Feng et al. [18] conclude that there are five major perspectives for the current study of multimodal analysis, including interactional sociological analysis [19], the analysis of multimodal metaphor [20], the corpus-based analysis, the social semiotics [4] and Systemic Functional Grammar....
[...]
...Based on Jewitt’s study [17], Feng et al....
[...]
...However, as Jewit [17] argues, the micro description of non-verbal semiotics is separated from broader social issues and cultural contexts....
[...]
TL;DR: The sonic logo for McDonald's i’m lovin' it campaign has been widely distributed and highly praised, but little is known about the actual characteristics and meaning potentials of this particular logo.
Abstract: While the sonic logo for McDonald’s i’m lovin’ it campaign has been widely distributed and highly praised, little is known about the actual characteristics and meaning potentials of this particular...
2 citations
01 Jun 2018
TL;DR: The notion of materiality is crucial for understanding voice in designed three dimensional artefacts as discussed by the authors, where meaning is seen to be made through the selection and configuration of modes in texts and through the interest of the sign-maker in a particular context.
Abstract: Abstract Although ‘voice’ is a contested concept used in many different ways, it is often used to indicate degrees of authorial agency and, as such, is useful for exploring interest and design in artwork and three dimensional artefacts. This paper investigates the semiotic signifiers of voice in artwork, arguing that the notion of materiality is crucial for understanding voice in designed three dimensional artefacts. The methodological approach is multimodal social semiotics where meaning is seen to be made through the selection and configuration of modes in texts and through the interest of the sign-maker in a particular context. This position paper focuses on authorial engagement as realized through semiotic choices, and explores the relationship between creativity and constraints in sign-making. It also investigates ways in which voice is constructed intertextually through citation in artwork. It argues that in designed artefacts, citation takes the form of explicit or implicit negotiation with authoritative conventions, and it is also realised through sensory and connotative provenance. The overall aim is to find apt semiotic terms to talk about voice across modes, genres and domains. Identifying these semiotic tools and signifiers of voice may be useful in a number of domains, including the pedagogical where voice often instantiates the negotiation between students’ lifeworlds and the new ideas, contexts and genres they encounter.
2 citations
Cites background from "The Routledge handbook of multimoda..."
...The approach to artefacts as texts taken here is multimodal social semiotics where meaning is seen to be contextdependant and meaning-making is seen as a social practice (Van Leeuwen and Jewitt 2001; Kress 2010; Jewitt 2009)....
[...]