Perspectives on Multimodality

Editors

Eija Ventola | University of Salzburg

Cassily Charles | University of Salzburg

Martin Kaltenbacher | University of Salzburg

Hardbound – Available

ISBN 9789027232069 (Eur) | EUR 95.00

ISBN 9781588115959 (USA) | USD 143.00

e-Book –

ISBN 9789027275158 | EUR 95.00 | USD 143.00

This volume sign posts several paths of multimodality research and theory-building today. The chapters represent a cross-section of current perspectives on multimodal discourse with a special focus on theoretical and methodological issues (mode hierarchies, modelling semiotic resources as multiple semiotic systems, multimodal corpus annotation). In addition, it discusses a wide range of applications for multimodal description in fields like mathematics, entertainment, education, museum design, medicine and translation.

[Document Design Companion Series, 6] 2004. x, 250 pp.

Publishing status: Available

https://doi.org/10.1075/ddcs.6

Table of Contents

Introduction

Eija Ventola and Martin Kaltenbacher | pp. 1–6

Part I — Multimodal Issues

In between Modes: Language and Image in Printed Media

Hartmut Stöckl | pp. 9–30

Modelling Multiple Semiotic Systems: The Case of Gesture and Speech

Peter Muntigl | pp. 31–50

Problematising ‘Semiotic Resource’

Victor Lim Fei | pp. 51–62

Multimodality and Empiricism: Preparing for a Corpus-based Approach to the Study of Multimodal Meaning-making

John A. Bateman, Judy Delin and Renate Henschel | pp. 65–87

Part II — Analyses and Applications

On the Effectiveness of Mathematics

Kay O’Halloran | pp. 91–117

Multimodality in Language Teaching CD-ROMs

Martin Kaltenbacher | pp. 119–136

The Multiple Modes of Dirty Dancing: A Cultural Studies Approach to Multimodal Discourse Analysis

Markus Rheindorf | pp. 137–152

Multimodal Text Analysis and Subtitling

Christopher Taylor | pp. 153–172

Multimodality in the Translation of Humour in Comics

Klaus Kaindl | pp. 173–192

Multimodality in Operation: Language and Picture in a Museum

Andrea Hofinger and Eija Ventola | pp. 193–209

Drawing on Theories of Inter-semiotic Layering to Analyse Multimodality in Medical Self-Counselling Texts and Hypertexts

Eva Martha Eckkrammer | pp. 211–226

On the Multimodality of Interpreting in Medical Briefings for Informed Consent: Using Diagrams to Impart Knowledge

Kristin Bührig | pp. 227–241

Index | pp. 243–248

Cited by

Cited by 40 other publications

Order by:

Abdolhamid Mirhosseini, Seyyed

2005. Philip LeVine and Ron Scollon (eds): Discourse and Technology: Multimodal Discourse Analysis. Georgetown University Press, 2004. Applied Linguistics 26:4 ► pp. 597 ff.

ALOUSQUE, ISABEL NEGRO

2014. Verbo-pictorial metaphor in French advertising. Journal of French Language Studies 24:2 ► pp. 155 ff.

ATALAY, Gül Esra

2019. Sosyal Medya ve Çocuk: “Babishko Family Fun TV” İsimli Youtube Kanalının Eleştirel Bir Analizi. Erciyes İletişim Dergisi :1 ► pp. 179 ff.

Braun, Sabine

2012. Creating Coherence in Audio Description. Meta 56:3 ► pp. 645 ff.

Dash, Amarendra Kumar, Priyadarshi Patnaik & Damodar Suar

2016. A multimodal discourse analysis of glocalization and cultural identity in three Indian TV commercials. Discourse & Communication 10:3 ► pp. 209 ff.

Ennis, Georgia

2022. Afecto y modalidad en la revalorización lingüística del kichwa del Alto Napo. In Oralidades y escrituras kichwas, ► pp. 121 ff.

ERKAL, Kürşad

2023. Türk Sinemasında Taşralı-Kentli Sunumu: Nuri Bilge Ceylan’ın Kış Uykusu Filmi Örneği. Erciyes İletişim Dergisi 10:2 ► pp. 819 ff.

Gilbert, Carrie Anne

2022. The text-privileging infrastructures of academic journals. Communication Design Quarterly 10:3 ► pp. 20 ff.

Guillot, Marie-Noëlle

2010. Film Subtitles from a Cross-cultural Pragmatics Perspective. The Translator 16:1 ► pp. 67 ff.

Jimenez Hurtado, Catalina & Silvia Soler Gallego

2013. Multimodality, translation and accessibility: a corpus-based study of audio description. Perspectives 21:4 ► pp. 577 ff.

Law, Locky

2020. Creativity and Education: Facilitating Transfer of Learning Through Digital Creativity Multimodal Analysis (DCMA) of Social Media Posts. In New Media Spectacles and Multimodal Creativity in a Globalised Asia [Digital Culture and Humanities, 3], ► pp. 95 ff.

Li, Dongyan & Qingfeng Guo

2014. 2014 Seventh International Symposium on Computational Intelligence and Design, ► pp. 299 ff.

Liu, Yu & Kay L. O'Halloran

2009. Intersemiotic Texture: analyzing cohesive devices between language and images. Social Semiotics 19:4 ► pp. 367 ff.

Liu, Zhengyuan

2022. Introducing a multimodal perspective to emotional variables in second language acquisition education: Systemic functional multimodal discourse analysis. Frontiers in Psychology 13

Martinez Lirola, Maria

2014. Exploring visual dysphemisms in pieces of news related to immigrant minors in a Spanish newspaper. Visual Communication 13:4 ► pp. 405 ff.

Morini, Massimiliano

2013. Towards a musical stylistics: Movement in Kate Bush’s ‘Running Up That Hill’. Language and Literature: International Journal of Stylistics 22:4 ► pp. 283 ff.

O'Halloran, Kay L .

2008. Systemic functional-multimodal discourse analysis (SF-MDA): constructing ideational meaning using language and visual imagery. Visual Communication 7:4 ► pp. 443 ff.

O'Halloran, Kay L.

2003. Systemics 1.0: Software for Research and Teaching Systemic Functional Linguistics. RELC Journal 34:2 ► pp. 155 ff.

Payrató, Lluís

2003. Non-verbal communication. In Handbook of Pragmatics, ► pp. 1 ff.

Pinar Sanz, María Jesús

2007. WEBLOGS AS A SUBGENRE OF POLITICAL COMMUNICATION / MARKETING. Revista de Lingüística y Lenguas Aplicadas 2:1

Pérez-González, Luis

2007. Appraising Dubbed Conversation. The Translator 13:1 ► pp. 1 ff.

Pöchhacker, Franz

2020. Chapter 1. “Going video”. In Linking up with Video [Benjamins Translation Library, 149], ► pp. 13 ff.

Qi, Wenjin & Nadezda Sorokina

2021. Constructing online tourist destination images: a visual discourse analysis of the official Beijing Tourism website. Chinese Semiotic Studies 17:3 ► pp. 421 ff.

Ramos, Marina

2015. The emotional experience of films: does Audio Description make a difference?. The Translator 21:1 ► pp. 68 ff.

Renkema, Jan & Christoph Schubert

2018. Introduction to Discourse Studies,

Rheindorf, Markus

2019. Working with Different Types of Data: Methodological Plurality Within and Beyond the Linguistic. In Revisiting the Toolbox of Discourse Studies, ► pp. 87 ff.

Romera, Magdalena

2015. The transmission of gender stereotypes in the discourse of public educational spaces. Discourse & Society 26:2 ► pp. 205 ff.

Ruhe, Stefanie

2020. Fostering (Digital) Media Literacy Skills and Global Citizenship in the EFL Classroom. In Handbook of Research on Cultivating Literacy in Diverse and Multilingual Classrooms [Advances in Educational Technologies and Instructional Design, ], ► pp. 125 ff.

Schmitz, Ulrich

2012. Multimodality and Globalization. In The Encyclopedia of Applied Linguistics,

Snytko, Olena & Mariia Pohorilova

2023. Multimodal texts with a suggestive orientation in the information space of wartime Ukraine. Current issues of Ukrainian linguistics: theory and practice :47 ► pp. 6 ff.

Taboada, Maite & Christopher Habel

2013. Rhetorical relations in multimodal documents. Discourse Studies 15:1 ► pp. 65 ff.

Tan, Hua

2021. Sara Dicerto: Multimodal Pragmatics and Translation: A New Model for Source Text Analysis. Applied Linguistics 42:2 ► pp. 377 ff.

UĞURLU AKBAŞ, Özge & Gül Esra ATALAY

2020. Geleneksel Kadınlık Rollerinin Sosyal Medyada Yeniden Üretimi: Kendine Yardım Temalı YouTube Kanallarına Yönelik Çok Modlu Eleştirel Söylem Analizi. Kültür ve İletişim 23(1):45 ► pp. 58 ff.

Van Leeuwen, Theo

2015. Multimodality. In The Handbook of Discourse Analysis, ► pp. 447 ff.

Villanueva-Jordán, Iván

2023. Audiovisual Translation, Multilingual Desire, and the Construction of the Intersectional Gay Male Body. Languages 8:2 ► pp. 105 ff.

Woźniak, Beata

2020. Multimodalitätspuzzle – ein Navigator zur disziplinübergreifenden multimodalen Analyse. Janina Wildfeuer, John A. Bateman und Tuomo Hiippala (2020): Multimodalität: Grundlagen, Forschung und Analyse – eine problemorientierte Einführung. Berlin, Boston: de Gruyter, 415 S.. tekst i dyskurs - text und diskurs :13 (2020) ► pp. 403 ff.

Zha, Yiyun

2017. Unpacking communication tensions in visual transmediation from print to digital papers. Communication Design 5:1-2 ► pp. 165 ff.

Đorđević, Jasmina P. & Dušan Stamenković

2021. The influence of monomodal and multimodal presentation on translation error recognition: an empirical approach. Perspectives 29:6 ► pp. 833 ff.

[no author supplied]

2014. Personalisation in Mass Media Communication [Pragmatics & Beyond New Series, 240],

[no author supplied]

2019. References. In Systematically Working with Multimodal Data, ► pp. 277 ff.

This list is based on CrossRef data as of 16 april 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Subjects