Discourse, Vision, and Cognition
While there is a growing body of psycholinguistic experimental research on mappings between language and vision on a word and sentence level, there are almost no studies on how speakers perceive, conceptualise and spontaneously describe a complex visual scene on higher levels of discourse. This book explores the relationship between language, eye movements and cognition, and brings together discourse analysis with cognitively oriented behavioral research. Based on the analysis of data drawn from spoken descriptive discourse, spontaneous conversation, and experimental investigations, this work offers a comprehensive picture of the dynamic natures of language, vision and mental imagery. Verbal and visual data, synchronised and correlated by means of a multimodal scoring method, are used as two windows to the mind to show how language and vision, in concert, can elucidate covert mental processes.
[Human Cognitive Processing, 23] 2008. xiii, 202 pp.
Publishing status: Available
Published online on 19 September 2008
Published online on 19 September 2008
© John Benjamins Publishing Company
Table of Contents
-
Preface | pp. xi–xiii
-
Chapter 1. Segmentation of spoken discourse | pp. 1–17
-
Chapter 2. Structure and content of spoken picture descriptions | pp. 19–38
-
Chapter 3. Description coherence and connection between foci | pp. 39–54
-
Chapter 4. Variations in picture description | pp. 55–77
-
Chapter 5. Multimodal sequential analysis and analytic tool | pp. 79–98
-
Chapter 6. Temporal correspondence between verbal and visual data | pp. 99–123
-
Chapter 7. Semantic correspondence between verbal and visual data | pp. 125–150
-
Chapter 8. Picture viewing, picture description and mental imagery | pp. 151–169
-
Chapter 9. Concluding chapter | pp. 171–178
-
-
Index | pp. 193–202
Cited by (32)
Cited by 32 other publications
Capece, Sonia, Camelia Chivăran, Giovanna Giugliano, Elena Laudante, Maria Laura Nappi & Mario Buono
Chen, Yixiong & Csilla Weninger
Hirvonen, Maija & Betta Saari
Lee, Hyeri, Yoomi Choi & Jee Eun Sung
Boiko, Yana
Friedrich, Maik, Seung Yong Lee, Paul Bates, Wayne Martin & Anja K. Faulhaber
Gerstenberg, Annette
Cialone, Claudia, Thora Tenbrink & Hugo J. Spiers
Soler Gallego, Silvia
2018. Audio descriptive guides in art museums. Translation and Interpreting Studies 13:2 ► pp. 230 ff. 
Martinez, Santiago, John Isaacs, Fabiola Fernandez-Gutierrez, Daniel Gilmour & Ken Scott-Brown
Waugh, Linda R., Theresa Catalano, Khaled Al Masaeed, Tom Hong Do & Paul G. Renigar
Zhao, Qingli
Cullipher, Steven & Hannah Sevian
Reinermann-Matatko, Anja
Taylor, Christopher
Ahmad, Gufran
Klein, Christoph, Juliane Betz, Martin Hirschbuehl, Caroline Fuchs, Barbara Schmiedtová, Martina Engelbrecht, Julia Mueller-Paul, Raphael Rosenberg & Kevin Paterson
Wang, Jiayu
Taboada, Maite & Christopher Habel
van Gog, Tamara & Halszka Jarodzka
Boeriis, Morten & Jana Holsanova
Bucher, Hans-Juergen & Philipp Niemann
Holsanova, Jana
Holsanova, Jana
Holsanova, Jana
Kruger, Jan-Louis
Tenbrink, Thora
TENBRINK, THORA
Sandgren, Håkan
Holsanova, Jana, Nils Holmberg & Kenneth Holmqvist
This list is based on CrossRef data as of 5 january 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.
Subjects
Psychology
Main BIC Subject
JMR: Cognition & cognitive psychology
Main BISAC Subject
PSY008000: PSYCHOLOGY / Cognitive Psychology & Cognition