Book•
The Routledge handbook of multimodal analysis
01 Jan 2009-
TL;DR: Theoretical and Methodological Tools for Multimodal Analysis as mentioned in this paper is a toolkit for multimodal analysis with a focus on the analysis of the transmodal moment.
Abstract: Introduction: Handbook Rationale, Scope and Structure Part 1 Theoretical And Methodological Tools For Multimodal Analysis 1.An Introduction to multimodalit 2. Different approaches to multimodality 3.What are multimodal data and transcription? 4.What is mode? 5.Parametric systems: the case of voice quality Theo van Leeuwen 6. Modal density and modal configurations: multimodal actions 7. Transformation, transduction and the transmodal moment Part 1 readings Par 2 Key themes for multimodality 8. Historical Changes in the Semiotic Landscape From Calculation to Computation 9. Technology and Sites of Display 10. Multimodality and Mobile Culture 11. Multimodality, Identity, and Time 12. Multimodality and reading: the construction of meaning through image-text interaction 13. Power, social justice and multimodal pedagogies Part 3 Multimodality across different theoretical perspectives 14. Multimodality and language: A retrospective and prospective view 15. Multimodality and theories of the visual 16. Multimodality and New Literacy Studies 17. Using Multimodal Corpora for Empirical Research 18. Critical Discourse Analysis and multimodality 19. Semiotic paradigms and multimodality 20. Reception of multimodality: Applying eye-tracking methodology in multimodal research 21. Representations in practices: A socio-cultural approach to multimodality in reasoning 22. Indefinite precision: artefacts and interaction in design 23. Anthropology and Multimodality: The Conjugation of the Senses Part 4 Multimoda Case Studies 24. Practical function and meaning: a case study of Ikea tables 2 The use of gesture in operations 26. Gesture and Movement in Tourist Spaces 2 The kineikonic mode: towards a multimodal aproach to moving image media 28. Multimodal Analytics: Software and Visualization Techniques for Analyzing and Interpreting Multimodal Data 29. Colour: code, mode, modality -- the case of.
Citations
More filters
01 Jan 2014
13 citations
01 Jan 2016
TL;DR: The authors conducted a qualitative study of the social and ideological actions of Canada's Food Guide (CFG) and concluded that the CFG, instead of an enabling resource, serves as a limiting document: it limits who can make healthier food choices and how such choices can be made.
Abstract: "Eating Well with Canada’s Food Guide" (CFG), Canada’s official dietary guidelines, is designed to address high rates of obesity and diet-related chronic diseases in Canada. This dissertation reports on a qualitative study of the social and ideological actions that the CFG performs. The study draws on concepts from Rhetorical Genre Studies, Science and Technology Studies, and Multimodal Interactional Analysis, and applies them in the analysis of interviews with key informants involved with the latest revision of the CFG and registered dietitians (RDs) working with vulnerable populations, as well as in a rhetorical and multimodal analysis of the guidelines. The findings of the analyses suggest that the CFG relies heavily on the representations typically reserved for scientific evidence from nutrition science, which focus on nutrients rather than on food. In the context of the CFG, these typical scientific representations are used for non-scientific audiences or in non-scientific situations, that is, cease to be scientific and become scientistic. The scientistic representations create rhetorical complexities, such as layers of rhetorical action (rhetorical laminations), and contribute to multiple rhetorical failures of the CFG. The scientistic representations in the CFG and the rhetorical failures they produce influence how RDs conceptualize nutrition, and dominate, rather than facilitate, discussions about healthy eating. As a result, RDs develop new discursive activities whereby they have to rely on additional resources to translate the scientistic representations for people and apply the CFG to their lives. Overall, the study suggests that the CFG, instead of an enabling resource, serves as a limiting document: it limits who can make healthier food choices and how such choices can be made. The study indicates that the CFG, as a rhetorical failure, has not achieved its intended social and ideological goals, or, in other words, has written itself out of usefulness.
13 citations
Cites background from "The Routledge handbook of multimoda..."
...Finally, the CFG represents nutrition information using language, pictures, charts, and numbers, and as such, my study draws on Multimodal Analysis (e.g., Jewitt, 2009; Norris, 2012) as an analytical approach to investigating multimodal text....
[...]
...Multimodality is based on three assumptions: language is only one means of communicating, other modes in a given situation also perform communicative functions, and people communicate via a complex configuration of multiple modes, hence the term “multimodal” (Jewitt, 2009)....
[...]
11 Aug 2016
TL;DR: The affordances and constraints inherent in an examination of children’s picturebook apps through multiple analytical frameworks drawn from social semiotics, film analysis, and game studies are explored and lessons that might be learned are learned.
Abstract: Research on the nature and impact of book apps or e-reading in general is still limited and informed by diverse assumptions about the nature of these new “texts,” the varied forms of engagement and meaning-making associated with them, and their implications for understanding literacy and learning in the digital age. The purpose of this article is to explore the affordances and constraints inherent in an examination of children’s picturebook apps through multiple analytical frameworks—in this case drawn from social semiotics, film analysis, and game studies. After outlining these frameworks in the context of our evolving new media landscape, we move on to more detailed analyses of the children’s picturebook app The Fantastic Flying Books of Mr. Morris Lessmore from each of these perspectives. We conclude with lessons that might be learned from juxtaposing these analytical frameworks and suggest implications for literacy education, research, and practice.
13 citations
Cites background from "The Routledge handbook of multimoda..."
...Finally, multimodality assumes that people orchestrate meaning through the ways they select and configure modes, thus highlighting the importance of both the interaction between modes and the motivations and interests of people in a specific social context (Jewitt, 2009)....
[...]
...…analyses in the notion that children’s picturebook apps, much like their printed predecessors, are multimodal ensembles that draw upon different modalities (visual image, written language, animation, music) in the rendering of a narrative (Duncum, 2004; Jewitt, 2009; Kress, 2003; Serafini, 2013)....
[...]
...We argue that the key assumptions underpinning the field of multimodal analysis align well with the digital and multimodal features associated with children’s picturebook apps (Jewitt, 2009; Norris, 2004; Painter, Martin, & Unsworth, 2013)....
[...]
...Such an approach takes as a central understanding that communication and representation are about more than language (Jewitt, 2009)....
[...]
TL;DR: In this article, a social semiotic investigation into children's birthday photo sharing and textual interaction in the public photo sharing website Flickr.com was conducted, and the analysis showed that the aesthetic frame becomes more prominent in the online context.
Abstract: This article reports on a social semiotic investigation into children’s birthday photo sharing and textual interaction in the public photo sharing website Flickr.com; the analysis shows that the aesthetic frame becomes more prominent in the online context. In other words, people share their family photos as a form of self-expression, and that can be seen in the semiotic organization of the verbal and visual texts they publish. However, the aesthetic frame is often entwined with the family frame both in the postings of the image publishers and in the comments that the photos gather. It could have been assumed that the aesthetic frame assumes a particularly dominant position on Flickr, which as a social media site specializes in publishing photographs and discussing their qualities. Since the family frame nevertheless retains an important role on Flickr, it can be expected that the same is true of more general social media services such as Facebook.
13 citations
Cites methods from "The Routledge handbook of multimoda..."
...Due to the multimodal property of the data, we adopt the approach of social semiotic multimodality as categorized by Jewitt (2009)....
[...]
TL;DR: The authors investigated the impacts of post language on B2B brand engagement on social media and identified six linguistic features (i.e., post length, language complexity, visual complexity, emotional cues, interpersonal cues, and multimodal cues in rich media) that influence brand engagement, captured using Twitter likes and retweets.
13 citations