Do speakers intend their gestures to communicate? Central as this question is to the study of gesture, researchers cannot seem to agree on the answer. According to one common framing, gestures are an “unwitting” window into the mind (McNeill, 1992); but, according to another common framing, they are designed along with speech to form “composite utterances” (Enfield, 2009). These two framings correspond to two cultures within gesture studies – the first cognitive and the second interactive in orientation – and they appear to make incompatible claims. In this article I attempt to bridge the cultures by developing a distinction between foreground gestures and background gestures. Foreground gestures are designed in their particulars to communicate a critical part of the speaker’s message; background gestures are not designed in this way. These are two fundamentally different kinds of gesture, not two different ways of framing the same monolithic behavior. Foreground gestures can often be identified by one or more of the following hallmarks: they are produced along with demonstratives; they are produced in the absence of speech; they are co-organized with speaker gaze; and they are produced with conspicuous effort. The distinction between foreground and background gestures helps dissolve the apparent tension between the two cultures: interactional researchers have focused on foreground gestures and elevated them to the status of a prototype, whereas cognitive researchers have done the same with background gestures. The distinction also generates a number of testable predictions about gesture production and understanding, and it opens up new lines of inquiry into gesture across child development and across cultures.
Alibali, Martha W., Dana C. Heath, & Heather J. Myers (2001). Effects of visibility between speaker and listener on gesture production: Some gestures are meant to be seen. Journal of Memory and Language, 441, 169–188.
Alibali, Martha W. (2005). Gesture in spatial cognition: Expressing, communicating, and thinking about spatial information. Spatial Cognition & Computation, 5 (4), 307–331.
Bangerter, Adrian (2004). Using pointing and describing to achieve joint focus of attention in dialogue. Psychological Science, 151, 415–419.
Bangerter, Adrian & Eric Chevalley (2007). Pointing and describing in referential communication: When are pointing gestures used to communicate? In Sluis van der Ielka, Mariët Theune, Ehud Reiter, & Emiel Krahmer (Eds.), CTIT Proceedings of the Workshop on Multimodal Output Generation (MOG), 25–26 January 2007, Aberdeen, Scotland (pp. 17–28). Enschede, The Netherlands: Universiteit Twente.
Bavelas, Janet B. (1994). Gestures as part of speech: Methodological implications. Research on Language and Social Interaction, 27 (3), 201–221.
Bavelas, Janet B., Jennifer Gerwing, Chantelle Sutton, & Danielle Prevost (2008). Gesturing on the telephone: Independent effects of dialogue and visibility. Journal of Memory and Language, 58 (2), 495–520.
Brentari, Diane, Marie Coppola, Laura Mazzoni, & Susan Goldin-Meadow (2012). When does a system become phonological? Handshape production in gesturers, signers, and homesigners. Natural Language and Linguistic Theory, 301, 1–31.
Brookes, Heather (2004). A repertoire of South African quotable gestures. Journal of Linguistic Anthropology, 14 (2), 186–224.
Brooks, Neon, David Barner, Michael Frank, & Susan Goldin-Meadow (2017). The role of gesture in supporting mental representations: The case of mental abacus arithmetic. Cognitive Science. .
Butterworth, George & Shoji Itakura (2000). How the eyes, head and hand serve definite reference. British Journal of Developmental Psychology, 181, 25–50.
Carlson, Richard A., Mario N. Avraamides, Melanie Cary, & Stephen Strasberg (2007). What do the hands externalize in simple arithmetic?Journal of Experimental Psychology: Learning, Memory, and Cognition, 33 (4), 747–56.
Chu, Mingyuan & Sotaro Kita (2008). Spontaneous gestures during mental rotation tasks: insights into the microdevelopment of the motor strategy. Journal of Experimental Psychology. General, 137 (4), 706–23.
Chu, Mingyuan, & Sotaro Kita (2011). The nature of gestures’ beneficial role in spatial problem solving. Journal of Experimental Psychology: General, 140 (1), 102–16.
Chu, Mingyuan, Antje Meyer, Lucy Foulkes, & Sotaro Kita (2013). Individual differences in frequency and saliency of speech-accompanying gestures: The role of cognitive abilities and empathy. Journal of Experimental Psychology. General, 143 (2), 694–709.
Clark, Herbert H. (1996). Using language. Cambridge: Cambridge University Press.
Cooperrider, Kensy (2011). Reference in action: Links between pointing and language. Doctoral dissertation, University of California – San Diego.
Cooperrider, Kensy (2014). Body-directed gestures: Pointing to the self and beyond. Journal of Pragmatics, 711, 1–16.
de Ruiter, Jan-Peter & David P. Wilkins (1998). The synchronization of gesture and speech in Dutch and Arrernte (an Australian Aboriginal language): A cross-cultural comparison. In Serge Santi (Ed.), Oralité et gestualité (pp. 603–607). Paris: Harmattan.
de Ruiter, Jan-Peter, Adrian Bangerter, & Paula Dings (2012). The interplay between gesture and speech in the production of referring expressions: Investigating the tradeoff hypothesis. Topics in Cognitive Science, 4 (2), 232–248.
Emmorey, Karen, Robin Thompson, & Rachael Colvin (2009). Eye gaze during comprehension of American Sign Language by native and beginning signers. Journal of Deaf Studies and Deaf Education, 141, 237–243.
Enfield, Nicholas J. (2004). On linear segmentation and combinatorics in co-speech gesture: A symmetry-dominance construction in Lao fish trap descriptions. Semiotica, 1491, 57–123.
Enfield, Nicholas J. (2009). The anatomy of meaning: Speech, gesture, and composite utterances. Cambridge: Cambridge University Press.
Enfield, Nicholas J., Sotaro Kita, & Jan-Peter de Ruiter (2007). Primary and secondary pragmatic functions of pointing gestures. Journal of Pragmatics, 39 (10), 1722–1741.
Engle, Randi (2000). Toward a theory of multimodal communication: Combining speech, gestures, diagrams, and demonstrations in instructional explanations. Doctoral dissertation, Stanford University.
Floyd, Simeon (2016). Modally hybrid grammar? Celestial pointing for time-of-day reference in Nheengatú. Language, 92 (1), 31–64.
Forrester, Gillian S. & Alina Rodriguez (2015). Slip of the tongue: Implications for evolution and language development. Cognition, 1411, 103–111.
Garber, Paul, & Susan Goldin-Meadow (2002). Gesture offers insight into problem-solving in adults and children. Cognitive Science, 261, 817–831.
Galati, Alexia & Susan E. Brennan (2014). Speakers adapt gestures to addressees’ knowledge: implications for models of co-speech gesture. Language and Cognitive Processes, 29 (4), 435–451.
Gentilucci, Maurizio, Francesca Benuzzi, Massimo Gangitano, & Silvia Grimaldi (2001). Grasp with hand and mouth: A kinematic study on healthy subjects. Journal of Neurophysiology, 861, 1685–1699.
Goldin-Meadow, Susan (2003). Hearing gesture: How our hands help us think. Cambridge, MA: Belknap.
Goldin-Meadow, Susan & Martha W. Alibali (2013). Gesture’s role in speaking, learning, and creating language. Annual Review of Psychology, 641, 257–283.
Goodwin, Charles (1986). Gesture as a resource for the organization of mutual orientation. Semiotica, 62 (1/2), 29–49.
Goodwin, Charles (1994). Professional vision. American Anthropologist, 96 (3), 606–633.
Guérin, Valérie (2015). Demonstrative verbs: A typology of verbal manner deixis. Linguistic Typology, 19 (2), 141–199.
Gullberg, Marianne & Sotaro Kita (2009). Attention to speech-accompanying gestures: Eye movements and information uptake. Journal of Nonverbal Behavior, 33 (4), 251–277.
Haviland, John B. (2004). Gesture. In Alessandro Duranti (Ed.), A Companion to Linguistic Anthropology (pp. 197–221). Oxford: Blackwell.
Hostetter, Autumn B. (2014). Action attenuates the effect of visibility on gesture rates. Cognitive Science, 38 (7), 1468–1481.
Hostetter, Autumn B. & Martha W. Alibali (2008). Visible embodiment: Gestures as simulated action. Psychonomic Bulletin & Review, 15 (3), 495–514.
Iverson, Jana M. & Susan Goldin-Meadow (1998). Why people gesture when they speak. Nature, 396 (6708), 228.
Iverson, Jana M. & Esther Thelen (1999). Hand, mouth, and brain: The dynamic emergence of speech and gesture. In Rafael Núñez & Walter J. Freeman (Eds.), Reclaiming cognition: The primacy of action, intention and emotion (pp. 19–40). Thorverton: Imprint Academic.
Kendon, Adam (1988). How gestures can become like words. In Fernando Poyatos (Ed.), Cross-cultural perspectives in nonverbal communication (pp. 131–141). Toronto: Hogrefe.
Kendon, Adam (1990). On some human greetings. In Adam Kendon, Conducting interaction: Patterns of behavior in focused encounters (pp. 153–207). Cambridge: Cambridge University Press.
Kendon, Adam (1995). Gestures as illocutionary and discourse structure markers in Southern Italian conversation. Journal of Pragmatics, 23 (3), 247–279.
Kendon, Adam (2004). Gesture: Visible action as utterance. Cambridge: Cambridge University Press.
Le Guen, Olivier (2011). Speech and gesture in spatial language and cognition among the Yucatec Mayas. Cognitive Science, 351, 905–938.
McComsey, Melanie, Kensy Cooperrider, & Tyler Marghetis (2016, January). Sources of within-population variability in spatial communication and reasoning: Evidence from Juchitán, Mexico. Presented at the Annual Meeting of the Linguistic Society of America, Washington, DC.
McNeill, David (1985). So you think gestures are nonverbal?Psychological Review, 92 (3), 350–371.
McNeill, David (1992). Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
McNeill, David (2000). Introduction. In David McNeill (Ed.), Language and gesture (pp. 1–10). Cambridge: Cambridge University Press.
McNeill, David (2005). Gesture and thought. Chicago: University of Chicago Press.
McNeill, David, Justine Cassell, & Elena T. Levy (1993). Abstract deixis. Semiotica, 95 (1/2), 5–20.
Meissner, Martin & Stuart B. Philpott (1975). The sign language of sawmill workers in British Columbia. Sign Language Studies, 9 (1), 291–308.
Oben, Bert, & Geert Brône (2015). What you see is what you do. On the relationship between gaze and gesture in multimodal alignment. Language and Cognition, 71, 546–562.
Rimé, Bernard, & Loris Schiaratura (1991). Gesture and speech. In Robert S. Feldman (Ed.), Fundamentals of nonverbal behavior (pp. 239–281). New York: Cambridge University Press.
Sandler, Wendy (2009). Symbiotic symbolization by hand and mouth in sign language. Semiotica, 2009 (174), 241–275.
Sidnell, Jack (2005). Gesture in the pursuit and display of recognition: A Caribbean case study. Semiotica, 2005 (156), 55–87.
Slama-Cazacu, Tatiana (1976). Nonverbal components in message sequence: “Mixed syntax”. In William C. McCormack & Stephen A. Wurm (Eds.), Language and man: Anthropological issues (pp. 217–227). The Hague: Mouton.
Slonimska, Anita, Aslı Özyürek, & Emanuela Campisi (2015). Ostensive signals: markers of communicative relevance of gesture during multimodal demonstrations to adults and children. In Gaëlle Ferré & Mark Tutton (Eds.), Proceedings of the 4th GESPIN Conference (pp. 217–222). Nantes: Université de Nantes.
Snow, Charles Percy (1959). The two cultures and the scientific revolution. Cambridge: Cambridge University Press.
Streeck, Jürgen (1993). Gesture as communication I: Its coordination with gaze and speech. Communication Monographs, 601, 275–299.
Tuite, Kevin (1993). The production of gesture. Semiotica, 93 (1/2), 83–105.
Wharton, Tim (2009). Pragmatics and non-verbal communication. Cambridge: Cambridge University Press.
Cited by (22)
Cited by 22 other publications
Cuffari, Elena Clare
2024. Gesture and Intersubjectivity. In The Cambridge Handbook of Gesture Studies, ► pp. 599 ff.
Gawne, Lauren & Kensy Cooperrider
2024. Emblems: Meaning at the interface of language and gesture. Glossa: a journal of general linguistics 9:1
Janzen Ulbricht, Natasha & Shane Lindsay
2023. Can grammatical morphemes be taught? Evidence of gestures influencing second language procedural learning in middle childhood. PLOS ONE 18:2 ► pp. e0280543 ff.
Laparle, Schuyler
2023. Gradient at-issueness and semiotic complexity in gesture: a response. Theoretical Linguistics 49:3-4 ► pp. 261 ff.
Mlakar, Izidor, Darinka Verdonik, Simona Majhenič & Matej Rojc
2023. Understanding conversational interaction in multiparty conversations: the EVA Corpus. Language Resources and Evaluation 57:2 ► pp. 641 ff.
Raghavan, Renuka, Limor Raviv & David Peeters
2023. What's your point? Insights from virtual reality on the relation between intention and action in the production of pointing gestures. Cognition 240 ► pp. 105581 ff.
Cartmill, Erica A.
2022. Gesture. Annual Review of Anthropology 51:1 ► pp. 455 ff.
Cooperrider, Kensy, James Slotta & Rafael Núñez
2022. The ups and downs of space and time: topography in Yupno language, culture, and cognition. Language and Cognition 14:1 ► pp. 131 ff.
2020. Space in Hand and Mind: Gesture and Spatial Frames of Reference in Bilingual Mexico. Cognitive Science 44:12
Pouw, Wim, Steven J. Harrison, Núria Esteve-Gibert & James A. Dixon
2020. Energy flows in gesture-speech physics: The respiratory-vocal system and its coupling with hand gestures. The Journal of the Acoustical Society of America 148:3 ► pp. 1231 ff.
This list is based on CrossRef data as of 17 november 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.