Book•
The Routledge handbook of multimodal analysis
01 Jan 2009-
TL;DR: Theoretical and Methodological Tools for Multimodal Analysis as mentioned in this paper is a toolkit for multimodal analysis with a focus on the analysis of the transmodal moment.
Abstract: Introduction: Handbook Rationale, Scope and Structure Part 1 Theoretical And Methodological Tools For Multimodal Analysis 1.An Introduction to multimodalit 2. Different approaches to multimodality 3.What are multimodal data and transcription? 4.What is mode? 5.Parametric systems: the case of voice quality Theo van Leeuwen 6. Modal density and modal configurations: multimodal actions 7. Transformation, transduction and the transmodal moment Part 1 readings Par 2 Key themes for multimodality 8. Historical Changes in the Semiotic Landscape From Calculation to Computation 9. Technology and Sites of Display 10. Multimodality and Mobile Culture 11. Multimodality, Identity, and Time 12. Multimodality and reading: the construction of meaning through image-text interaction 13. Power, social justice and multimodal pedagogies Part 3 Multimodality across different theoretical perspectives 14. Multimodality and language: A retrospective and prospective view 15. Multimodality and theories of the visual 16. Multimodality and New Literacy Studies 17. Using Multimodal Corpora for Empirical Research 18. Critical Discourse Analysis and multimodality 19. Semiotic paradigms and multimodality 20. Reception of multimodality: Applying eye-tracking methodology in multimodal research 21. Representations in practices: A socio-cultural approach to multimodality in reasoning 22. Indefinite precision: artefacts and interaction in design 23. Anthropology and Multimodality: The Conjugation of the Senses Part 4 Multimoda Case Studies 24. Practical function and meaning: a case study of Ikea tables 2 The use of gesture in operations 26. Gesture and Movement in Tourist Spaces 2 The kineikonic mode: towards a multimodal aproach to moving image media 28. Multimodal Analytics: Software and Visualization Techniques for Analyzing and Interpreting Multimodal Data 29. Colour: code, mode, modality -- the case of.
Citations
More filters
TL;DR: In this article, the authors examine languaging in a bilingual school setting and explore young people's doing of multilingualism as well as social positioning in and through the everyday social practices where literacy is salient.
41 citations
TL;DR: This study taught 13 preservice primary teachers how to create a slowmation during a two-hour class in a science methods course and then created one about an allocated science topic as an assignment and asked them to represent their concept in the animation.
Abstract: Research has identified the value of students constructing their own representations of science concepts using modes such as writing, diagrams, 2-D and 3-D models, images or speech to communicate meaning. “Slowmation” (abbreviated from “Slow Animation”) is a simplified way for students, such as preservice teachers, to make a narrated animation using a combination of modes. In this study, 13 preservice primary teachers learned how to create a slowmation during a two-hour class in a science methods course and then created one about an allocated science topic as an assignment. The research question that guided this study was, “What are the preservice teachers’ perceptions of making a slowmation and how was the science concept represented in the animation?” Data included pre and post individual interviews, concept maps constructed during the interviews and the animations as artifacts. Three case studies provide a window into the perceptions of preservice teachers making a slowmation and show how they represented their concept. Slowmation is a new form of student-generated representation which enables them to use their own technology to construct a narrated animation as a multimodal representation to explain a science concept.
41 citations
01 Jan 2017
TL;DR: The authors imagines a tussle between Multimodality, focused on modes, and Applied Linguistics, based on language, which treats speech and writing as modes with distinct affordances, and, as all modes, treats them as partial means of communication.
Abstract: This article imagines a tussle between Multimodality, focused on ‘modes’, and Applied Linguistics (AL), based on ‘language’. A Social Semiotic approach to MM treats speech and writing as modes with distinct affordances, and, as all modes, treats them as ‘partial’ means of communication. The implications of partiality confound long-held assumptions of the sufficiency of ‘language’ for all communicational needs: an assumption shared by AL. Given MM’s plurality of modes and the diversity of audiences, design moves into focus, with a shift from competent performance to apt design. Principles of composition — e.g. linear ity versus modularity — become crucial, raising the question at the heart of this paper: how do AL and MM deal with the shape of the contemporary semiotic landscape?
40 citations
TL;DR: In this article, the authors explore how features of language and embodied action in product design interactions over time consequentially influence the shape of subsequent communicative actions in particular ways, which in turn cumulatively affect the emergence of a design.
40 citations
Dissertation•
28 Apr 2016
TL;DR: SMS text messaging is presented as one of the intertextually-related forms of self-published written interaction which mark a diachronic shift towards re-regulated forms of orthographic convention, so disrupting attitudes to standard English spelling.
Abstract: From 1998, SMS text messaging diffused in the UK from an innovation associated with a small minority, mainly adolescents, to a method of written communication practised routinely by people of all ages and social profiles. From its earliest use, and continuing to the time of writing in 2015, SMS texting has attracted strong evaluation in public sphere commentary, often focused on its spelling. This thesis presents analysis of SMS orthographic choice as practised by a sample of adolescents and young adults in England, with data collected between 2000 and 2012. A threelevel analytical framework attends to the textual evidence of SMS orthographic practices in situated use; respondents’ accounts of their choices of spelling in text messaging as a literacy practice; and the metadiscursive evaluation of text messaging spelling in situated interaction and in the public sphere. I present analysis of a variety of representations of SMS orthographic choice, including facsimile texts, electronic corpus data, questionnaire survey responses and transcripts of recorded interviews. This mixed methods empirical approach enables a cross-verified, longitudinal perspective on respondents’ practices, and on the wider significance of SMS orthographic choice, as expressed in private and public commentary. I argue that the spelling used in SMS exemplifies features, patterns, and behaviours, which are found in other forms of digitally-mediated interaction, and in previous and concurrent vernacular literacy practices. I present SMS text messaging as one of the intertextually-related forms of self-published written interaction which mark a diachronic shift towards re-regulated forms of orthographic convention, so disrupting attitudes to standard English spelling. I consider some implications represented by SMS spelling choice for the future of written conventions in standardised English, and for teaching and learning about spelling and literacy in formal educational settings.
40 citations
Cites background from "The Routledge handbook of multimoda..."
...See also Jewitt 2009 and Kress 2010 for multimodal perspectives on these issues....
[...]
...…interaction of a text message exchange mediated in bodily proximity on a small screen, with constraints of screen representation and awkward text entry: text becomes meaningful in relation to its material situatedness in geographical and social space (Scollon & Scollon 2003, Jewitt 2009)....
[...]
...In this study, the linguistic design in an exchange of SMS is understood as being situated in its graphical and material realisation, following Jewitt and Kress’s formulations of a theory of multimodal social semiotics (Jewitt 2009, Kress 1997, 2010)....
[...]