Book•
The Routledge handbook of multimodal analysis
01 Jan 2009-
TL;DR: Theoretical and Methodological Tools for Multimodal Analysis as mentioned in this paper is a toolkit for multimodal analysis with a focus on the analysis of the transmodal moment.
Abstract: Introduction: Handbook Rationale, Scope and Structure Part 1 Theoretical And Methodological Tools For Multimodal Analysis 1.An Introduction to multimodalit 2. Different approaches to multimodality 3.What are multimodal data and transcription? 4.What is mode? 5.Parametric systems: the case of voice quality Theo van Leeuwen 6. Modal density and modal configurations: multimodal actions 7. Transformation, transduction and the transmodal moment Part 1 readings Par 2 Key themes for multimodality 8. Historical Changes in the Semiotic Landscape From Calculation to Computation 9. Technology and Sites of Display 10. Multimodality and Mobile Culture 11. Multimodality, Identity, and Time 12. Multimodality and reading: the construction of meaning through image-text interaction 13. Power, social justice and multimodal pedagogies Part 3 Multimodality across different theoretical perspectives 14. Multimodality and language: A retrospective and prospective view 15. Multimodality and theories of the visual 16. Multimodality and New Literacy Studies 17. Using Multimodal Corpora for Empirical Research 18. Critical Discourse Analysis and multimodality 19. Semiotic paradigms and multimodality 20. Reception of multimodality: Applying eye-tracking methodology in multimodal research 21. Representations in practices: A socio-cultural approach to multimodality in reasoning 22. Indefinite precision: artefacts and interaction in design 23. Anthropology and Multimodality: The Conjugation of the Senses Part 4 Multimoda Case Studies 24. Practical function and meaning: a case study of Ikea tables 2 The use of gesture in operations 26. Gesture and Movement in Tourist Spaces 2 The kineikonic mode: towards a multimodal aproach to moving image media 28. Multimodal Analytics: Software and Visualization Techniques for Analyzing and Interpreting Multimodal Data 29. Colour: code, mode, modality -- the case of.
Citations
More filters
21 May 2019
TL;DR: In this article, a multimodal analysis of the textual, visual, and compositional modes of the covers of real-life women's magazines is presented. But while these covers present a seemingly upbeat character at a glance, themes of a distressing nature, including but not limited to abuse and violence, are present throughout.
Abstract: Studies analysing women’s magazines note contradiction as a common theme, whether it be the content of the magazines and the ideological values presented therein, or at broader, political levels. This paper empirically investigates to what extent contradiction may occur on the covers of real-life magazines (a subgenre of women’s magazines; N = 100). Employing a multimodal analysis of the textual, visual, and compositional modes, contradiction is posited to occur at various levels. Overall, while these covers present a seemingly upbeat character at a glance, themes of a distressing nature – including but not limited to abuse and violence – are present throughout. The interactions between associated texts and imagery, and the relative salience of these elements, are suggested as key factors in these contradictory compositions. Furthermore, these factors are posited as explanations for why real-life magazines are often in full view in magazine racks around the UK, yet are omitted from the scrutiny that other (sub)genres of magazines undergo.
2 citations
06 Jun 2018
TL;DR: In this paper, the authors present des donnees recueillies lors de la creation and de la reconstruction d'un texte multimodal par Blastoise, un garcon parlant anglais, francais, and russe.
Abstract: Notre etude de cas ethnographique s’est deroulee dans une classe de 6e annee dans une ecole en milieu francophone minoritaire en Colombie-Britannique. Elle visait une meilleure comprehension de l’influence des litteraties mediatiques multimodales sur le developpement identitaire d’eleves plurilingues. Dans le present article, nous presentons des donnees recueillies lors de la creation et de la reconstruction d’un texte multimodal par Blastoise, un garcon parlant anglais, francais et russe. Le plurilinguisme, les positionnements identitaires et la multimodalite servent de cadre theorique a cette recherche. L’analyse des resultats indique que cet eleve fait une utilisation somme toute limitee des divers modes disponibles (ex. : mot ecrit, son, image, video) et montre egalement l’absence du russe, l’une des ressources du repertoire linguistique de l’eleve. Par contre, l’utilisation que cet eleve fait du francais, de l’anglais et d’autres modes lui permet de se positionner en tant que bon eleve et expert en jeux video.
2 citations
01 Mar 2017
TL;DR: In this paper, the relevancy of New Learning Technologies (NLT) to favor knowledge's mediation in inclusive classrooms with deaf students was discussed, and the use of different mediational means and multimodality, such as gestures, images, videos and animations, was discussed.
Abstract: This paper discusses the relevancy of New Learning Technologies (NLT) to favor knowledge’s mediation in inclusive classrooms with deaf students. The research was motivated by the project developed in the Coordination of Distance Education (CEAD) at Federal University of Viçosa (Brazil), focusing the inclusion of deaf student in the Civil Engineering course. Then, it was discussed the importance of NLT, the use of different mediational means and multimodality, such as gestures, images, videos and animations, to foster interactions and construction of concepts in inclusive classrooms. To give meaning to the specifics terms of Civil Engineering, it is important that the Interpreter of Brazilian Sign Language (Libras) and teacher establish a partnership, exploring different visuals mediational means, such as images, concrete models, graphs and classifiers in signal language that enable spatial description of scientific concepts, besides gestures, which represent bodily actions inherent to discourse.
2 citations
Cites background from "The Routledge handbook of multimoda..."
...…Education have pointed out a growing interest in understanding the role that semiotic modes can play in the discursive process of knowledge construction in classroom (KRESS et al., 2001; KRESS, 2003; GILBERT, 2005; PRAIN & WALDRIP, 2006; KRESS, 2009; JEWITT, 2009; KLEIN & KIRKPATRICK, 2010)....
[...]
...This multimodal approach, according to Jewitt (2009), may offer advantages over works that focus attention on analyzing only speech / signaling aspects of the deaf or writing....
[...]
...Thus, to understand communication it is necessary to extend the social interpretation of language and its meanings to a set of representation modes and communication, or semiotic resources (JEWITT, 2009)....
[...]
TL;DR: The analysis undertaken is data-driven and has revealed the existence of various entities which are made visible by means of a combination of lexicogrammatical devices together with other modes afforded by the digital platforms.
Abstract: In the last few years, the web has become a privileged access platform for knowledge for an increasingly globalized society. Thus, digital platforms are currently used by researchers to strengthen the visibility of their research output as well as their own. In this study we explore the concept of e-visibility as a key notion in the current digital discursive practices within the scientific context. For such purposes we have focused on international research project websites as instances of such practices.The analysis undertaken is data-driven and has revealed the existence of various entities which are made visible by means of a combination of lexicogrammatical devices together with other modes afforded by the digital platforms. Results also show that there are various types of e-visibility emerging from the combination of the entities and the lexicogrammatical and visual resources used to make them visible.
2 citations
DOI•
01 Jan 2016
TL;DR: It will be suggested that a common anchoring in a well specified notion of discourse as an intrinsically multimodal phenomenon offers beneficial new angles on how narratives can be modelled, as well as establishing bridges between humanistic understandings of narrative and complementary computational accounts of narratives involving communicative goal-based planning.
Abstract: Models of narrative have been proposed from many perspectives and most of these nowadays promote further the notion that narrative is a transmedial phenomenon: i.e., stories can be told making use of distinct and multiple forms of expressions. This raises a range of theoretical and practical questions, as well as rendering the task of providing computational models of narrative both more interesting and more challenging. Central to this endeavour are issues concerned with the potential mutual conditioning of narrative forms and the media employed. Methods are required for isolating narrative properties and mechanisms that may be generalised across media, while at the same time appropriately respecting differences in medial affordances. In this discussion paper I set out a corresponding approach to characterising narrative that draws on a fine-grained formal characterisation of multimodal discourse developed on the basis of both functional and formal linguistic models of discourse, generalised to the multimodal case. After briefly setting out the theoretical principles on which the account builds, I position narrative with respect to the framework and give an example of how audiovisual narratives such as film are accounted for. It will be suggested that a common anchoring in a well specified notion of discourse as an intrinsically multimodal phenomenon offers beneficial new angles on how narratives can be modelled, as well as establishing bridges between humanistic understandings of narrative and complementary computational accounts of narratives involving communicative goal-based planning.
2 citations