Insights into interaction management through backchannels: The case of French Belgian Sign Language and Catalan Sign Language

Alysson Lepeut and Sílvia Gabarró-López
Norwegian University of Science and Technology | Pompeu Fabra University

This paper analyzes backchannel signals in two signed languages: French Belgian Sign Language (LSFB) and Catalan Sign Language (LSC). While backchannels have been extensively studied in spoken languages, their documentation across signed languages remains sparse in comparison. This study investigates how backchannels operate in signed language interaction, focusing on their forms and articulatory types within and across LSFB and LSC conversations. The data comprise face-to-face video recordings of twenty-four deaf participants (twelve per language). Backchannels were identified and annotated based on prior typologies for coding multimodal backchannels in ELAN. The study offers a descriptive account of backchannel use in both languages and presents qualitative analyses of key selected examples. The findings reveal compelling commonalities in the forms of backchannels between both languages, particularly the prominent role of nonmanuals. Ultimately, these findings further support the inclusion of these interactional phenomena as essential components of language.

Publication history
Table of contents

The human ability for language is intrinsically interactional, deeply rooted in the dynamic and social nature of face-to-face interaction, a property that is equally fundamental to spoken and signed languages alike. Signed languages (SLs) are natural languages that exploit the visual-manual channel, using the hands, face, and body to convey meaning. Just like spoken languages (SpLs), they exhibit complex grammatical and pragmatic structures and serve as fully fledged systems for interaction management. Central to this human ability of conversation management lies the turn-taking system, a sophisticated and very robust machinery that orchestrates the management and coordination of human conversation through a well-structured set of principles (Stivers et al. 2009; Levinson and Torreira 2015).

Full-text access is restricted to subscribers. Log in to obtain additional credentials. For subscription information see Subscription & Price. Direct PDF access to this article can be purchased through our e-platform.

References

Albert, Saul, and Jan P. de Ruiter
2018 “Repair: The Interface between Interaction and Cognition.” Topics in Cognitive Sciences 10 (2): 279–313. Google Scholar logo with link to Google Scholar
Barberà, Gemma, Josep Quer, and Santiago Frigola
2015 “Primers passos cap a la documentació de discurs signat: el projecte pilot de constitució del corpus de la llengua de signes catalana [First steps to document signed discourse: The pilot project of the Catalan Sign Language corpus].” Treballs de Sociolingüística Catalana 25: 287–302.Google Scholar logo with link to Google Scholar
Bauer, Anastasia, Sonja Gipper, Tobias-Alexander Herrmann, and Jana Hosemann
2023 “Multimodal Feedback Signals: Comparing Response Tokens in Co-Speech Gesture and Sign Languages.” 1st International Multimodal Communication Symposium (MMSYM 2023), Barcelona, Spain.Google Scholar logo with link to Google Scholar
Bauer, Anastasia, Anna Kuder, Marc Schulder, and Job Schepens
2024 “Phonetic Differences between Affirmative and Feedback Head Nods in German Sign Language (DGS): A Pose Estimation Study.” PLOS ONE 19 (5): e0304040. Google Scholar logo with link to Google Scholar
Bavelas, Janet B., Linda Coates, and Trudy Johnson
2002 “Listener Responses as a Collaborative Process: The Role of Gaze.” Journal of Communication 52 (3): 566–580. Google Scholar logo with link to Google Scholar
2000 “Listeners as Co-Narrators.” Journal of Personality and Social Psychology 79 (6): 941–952. Google Scholar logo with link to Google Scholar
Bavelas, Janet B., Jennifer Gerwing, and Sara Healing
2014 “Hand and Facial Gestures in Conversational Interaction.” In The Oxford Handbook of Language and Social Psychology, ed. by Thomas M. Holtgraves. Oxford Academic.Google Scholar logo with link to Google Scholar
Bertrand, Roxane, Gaëlle Ferré, Philippe Blache, Robert Espesser, and Stéphane Rauzy
2007 “Backchannels Revisited from a Multimodal Perspective.” Auditory-Visual Speech Processing, Hilvarenbeek, Netherlands.Google Scholar logo with link to Google Scholar
Beukeleers, Inez, and Alysson Lepeut
2022 “Who’s Got the Upper Hand? A Cross-Linguistic Study on Overlap in VGT and LSFB.” Belgian Journal of Linguistics 36: 212–246. Google Scholar logo with link to Google Scholar
Blomsma, Peter, Julija Vaitonyté, Gabriel Skantze, and Marc Swerts
2024 “Backchannel Behavior Is Idiosyncratic.” Language and Cognition 16 (4): 1158–1181. Google Scholar logo with link to Google Scholar
Börstell, Carl
2024 “Finding Continuers in Swedish Sign Language.” Linguistics Vanguard 10 (1): 537–548. Google Scholar logo with link to Google Scholar
Boudin, Auriane, Roxane Bertrand, Stéphane Rauzy, Magalie Ochs, and Philippe Blache
2024 “A Multimodal Model for Predicting Feedback Position and Type during Conversation.” Speech Communication 159: 103066. Google Scholar logo with link to Google Scholar
Clark, Herbert H., and Susan E. Brennan
1991 “Grounding in Communication.” In Perspectives on Socially Shared Cognition, ed. by Lauren B. Resnick, John M. Levine, and Sthephanie D. Teasley, 127–149. Washington, DC: APA Books. Google Scholar logo with link to Google Scholar
Cohen, Jacob
1960 “A Coefficient of Agreement for Nominal Scales.” Educational and Psychological Measurement 20 (1): 37–46. Google Scholar logo with link to Google Scholar
Crible, Ludivine, Greta Gandolfi, and Martin J. Pickering
2024 “Feedback Quality and Divided Attention: Exploring Commentaries on Alignment in Task-Oriented Dialogue.” Language and Cognition 16 (4): 895 — 923. Google Scholar logo with link to Google Scholar
Crible, Ludivine, and Loulou Kosmala
2025 “Multimodal Pragmatic Markers of Feedback in Dialogue.” Languages 10 (6): 117. Google Scholar logo with link to Google Scholar
Debreslioska, Sandra, Anna Kuder, and Pamela Perniss
2025 “The Palm-Up Open Hand Gesture Across Language Modalities: A Comparison of German and DGS (German Sign Language).” Journal of Pragmatics 249: 99–199. Google Scholar logo with link to Google Scholar
Deppermann, Arnulf
2013 “Multimodal Interaction from a Conversation Analytic Perspective.” Journal of Pragmatics 46: 1–7. Google Scholar logo with link to Google Scholar
Dideriksen, Christina, Ricardo Fusaroli, Kristian Tylén, Mark Dingemanse, and Morten H. Christiansen
2019 “Backchannel, Repair and Linguistic Alignment in Spontaneous and Task-Oriented Conversations.” In Proceedings of the 41st Annual Conference of the Cognitive Science Society, ed. by Ashok K. Goel, Colleen M. Seifert, and Christian Freksa, 261–267. Montreal: Cognitive Science Society.Google Scholar logo with link to Google Scholar
Dingemanse, Mark, Andreas Liesenfeld, and Marieke Woensdregt
2022 “Convergent Cultural Evolution of Continuers (mhmm).” Preprint PsyArXiv.Google Scholar logo with link to Google Scholar
Dingemanse, Mark, Seán G. Roberts, Julija Baranova, Joe Blythe, Paul Drew, Simeon Floyd, Rosa S. Gisladottir, Kobin H. Kendrick, Stephen C. Levinson, Elizabeth Manrique, Giovanni Rossi, and Nick J. Enfield
2015 “Universal Principals in the Repair of Communication Problems.” PLoS ONE 10 (9): e0136100. Google Scholar logo with link to Google Scholar
ELAN [Computer Software]
2020 Nijmegen, the Netherlands: Max Planck Institute for Psycholinguistics, The Language Archive. https://​archive​.mpi​.nl​/tla​/elan
Engberg-Pedersen, Elisabeth
2002 “Gestures in Signing: The Presentation Gesture in Danish Sign Language.” In Progress in Sign Language Research: In Honor of Siegmund Prillwitz, ed. by Rolf Schulmeister, and Heimo Reinitzer, 142–162. Hamburg: Signum.Google Scholar logo with link to Google Scholar
Fenlon, Jordan, and Julie Hochgesang
eds. 2022 Signed Language Corpora. Washington, DC: Gallaudet University Press.Google Scholar logo with link to Google Scholar
Fenlon, Jordan, Adam Schembri, and Rachel Sutton-Spence
2013 “Turn-Taking and Backchannel Behaviour in BSL Conversations.” 11th Theoretical Issues in Sign Language Research Conference, London, United Kingdom.Google Scholar logo with link to Google Scholar
Ferrara, Lindsay
2020 “Some Interactional Functions of Finger Pointing in Signed Language Conversations.” Glossa: A Journal of General Linguistics 5 (1).Google Scholar logo with link to Google Scholar
Ferrara, Lindsay, and Gabrielle Hodge
2018 “Language as Description, Indication, and Depiction.” Frontiers in Psychology 9: 14–29. Google Scholar logo with link to Google Scholar
Gabarró-López, Sílvia
2017 Discourse Markers in French Belgian Sign Language (LSFB) and Catalan Sign Language (LSC): Buoys, palm-up and same. Variation, Functions and Position in Discourse”. PhD thesis. University of Namur.
Gabarró-López, Sílvia, and Laurence Meurant
2022 “Contrasting Signed and Spoken Languages. Towards a Renewed Perspective on Language.” Languages in Contrast 22 (2): 169–194. Google Scholar logo with link to Google Scholar
Gardner, Rod
2001 When Listeners Talk: Response Tokens and Listener Stance. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Holler, Judith, and Katie Wilkin
2011 “An Experimental Investigation of How Addressee Feedback Affects Co-Speech Gestures Accompanying Speakers’ Responses.” Journal of Pragmatics 43: 3522–3536. Google Scholar logo with link to Google Scholar
Hömke, Paul, Judith Holler and Stephen C. Levinson
2017 “Eye Blinking as Addressee Feedback in Face-to-Face Conversation.” Research on Language and Social Interaction 50 (1): 54–70. Google Scholar logo with link to Google Scholar
Horton, Laura, and Jenny Singleton
2022 “Acquisition of Turn-Taking in Sign Language Conversations: An Overview of Language Modality and Turn Structure.” Frontiers in Psychology 13: 935342. Google Scholar logo with link to Google Scholar
Institut d’Estudis Catalans
2025 Corpus de la llengua de signes catalana (LSC) [Catalan Sign Language (LSC) corpus]. http://​blogs​.iec​.cat​/lsc​/corpus/
Jefferson, Gail
1984 “Notes on a Systematic Deployment of the Acknowledgement Tokens ‘Yeah’; and ‘Mm Hm.’” Paper in Linguistics 17 (2): 197–216. Google Scholar logo with link to Google Scholar
Johnston, Trevor
2016 Auslan Corpus Annotation Guidelines. Technical report, Macquarie University/La Trobe University, Sydney/Melbourne.Google Scholar logo with link to Google Scholar
Kaukomaa, Timo, Anssi Peräkylä, and Johanna Ruusuvuori
2015 “How Listeners Use Facial Expression to Shift the Emotional Stance of the Speaker’s Utterance.” Research on Language and Social Interaction 48 (3): 319–341. Google Scholar logo with link to Google Scholar
Kendon, Adam
1967 “Some Functions of Gaze-Direction in Social Interaction.” Acta Psychologica 26: 22–63. Google Scholar logo with link to Google Scholar
Krauss, Robert M., and Sidney Weinheimer
1966 “Concurrent Feedback, Confirmation, and the Encoding of Referents in Verbal Communication.” Journal of Personality and Social Psychology 4 (3): 343–346. Google Scholar logo with link to Google Scholar
Landis, J. Richard, and Gary G. Koch
1977 “The Measurement of Observer Agreement for Categorical Data.” Biometrics 33 (1): 159–174. Google Scholar logo with link to Google Scholar
Lepeut, Alysson
2020 “Framing Language Through Gesture: Palm-Up, Index Finger-Extended Gestures, and Holds in Spoken and Signed Interactions in French-Speaking and Signing Belgium.” PhD thesis. University of Namur.
Lepeut, Alysson, and Emily Shaw
2025 “Interactive Functions of Palm-Up: Cross-Linguistic and Cross-Modal Insights from ASL, American English, LSFB and Belgian French.” Languages 10 (9): 239. Google Scholar logo with link to Google Scholar
2024 “When the Mess is the Message: Simultaneous Signing in an ASL Multiparty Interaction.” Sign Language Studies 24 (3): 722–763. Google Scholar logo with link to Google Scholar
2022 “Time Is Ripe to Make Interactional Moves: Bringing Evidence from Four Languages Across Modalities.” Frontiers in Communication 7: 780124. Google Scholar logo with link to Google Scholar
Levinson, Stephen C.
2016 “Turn-Taking in Human Communication — Origins and Implications for Language Processing.” Trends Cognitive Science 20: 6–14. Google Scholar logo with link to Google Scholar
Levinson, Stephen C., and Francisco Torreira
2015 “Timing in Turn-Taking and Its Implications for Processing Models of Language.” Frontiers in Psychology 6: 10–26. Google Scholar logo with link to Google Scholar
Lutzenberger, Hannah, Lierin de Wael, Rehana Omardeen, and Mark Dingemanse
2024 “Interactional Infrastructure across Modalities: A Comparison of Repair Initiators and Continuers in British Sign Language and British English.” Sign Language Studies 24 (3): 548–581. Google Scholar logo with link to Google Scholar
McCleary, Leland, and Tarcísio de Arantes Leite
2013 “Turn-Taking in Brazilian Sign Language: Evidence from Overlap.” Journal of Interactional Research in Communication Disorders 4 (1): 123–154. Google Scholar logo with link to Google Scholar
McKee, Rachel L., and Sophia Wallingford
2011 “ ‘So, Well, Whatever’: Discourse Functions of Palm-Up in New Zealand Sign Language.” Sign Language & Linguistics 14: 213–247. Google Scholar logo with link to Google Scholar
Mesch, Johanna
2013 “Tactile Signing with One-Handed Perception.” Sign Language Studies 13 (2): 238–263. Google Scholar logo with link to Google Scholar
2016 “Manual Backchannel Responses in Signers’ Conversations in Swedish Sign Language.” Language & Communication 50: 22–41. Google Scholar logo with link to Google Scholar
Meurant, Laurence
2015 LSFB Corpus. A Digital Open-Access Corpus Containing Videos and Annotations in French Belgian Sign Language. French Belgian Sign Language Laboratory (LSFB-Lab). F.R.S. — FNRS and the University of Namur.Google Scholar logo with link to Google Scholar
Schegloff, Emanuel A.
2000 “Overlapping Talk and the Organization of Turn-Taking for Conversation.” Language in Society 29:1–63. Google Scholar logo with link to Google Scholar
1982 “Discourse as an Interactional Achievement: Some Uses of ’uh huh’ and Other Things that Come between Sentences.” In Analyzing Discourse: Text and Talk, ed. by Deborah Tannen, 71–93. Washington, D.C.: Georgetown University Press.Google Scholar logo with link to Google Scholar
Simon, Carsta
2018 “The Functions of Active Listening Responses.” Behavioural Processes 157: 47–53. Google Scholar logo with link to Google Scholar
Stivers, Tanya
2008 “Stance, Alignment, and Affiliation during Storytelling: When Nodding Is a Token of Affiliation.” Research on Language & Social Interaction 41 (1): 31–57. Google Scholar logo with link to Google Scholar
Stivers, Tanya, Nick J. Enfield, Penelope Brown, Christina Englert, Makoto Hayashi, Trine Heinemann, Gertie Hoymann, Frederico Rossano, Jan P. de Ruiter, Kyung-Eun Yoon, and Stephen C. Levinson
2009 “Universals and Cultural Variation in Turn-Taking in Conversation.” Proceedings of the National Academy of Sciences 106: 10587–10592. Google Scholar logo with link to Google Scholar
Stokoe, William
1960 “Sign Language Structure: An Outline of the Visual Communication Systems of the American Deaf.” Studies in Linguistics, Occasional Papers 8. Buffalo: University of Buffalo.Google Scholar logo with link to Google Scholar
Tolins, Jackson, and Jean E. Fox Tree
2014 “Addressee Backchannels Steer Narrative Development.” Journal of Pragmatics 70: 152–164. Google Scholar logo with link to Google Scholar
Yngve, Victor H.
1970 “On Getting a Word in Edgewise.” In Papers from the Sixth Regional Meeting, 567–578. Chicago: Chicago Linguistic Society.Google Scholar logo with link to Google Scholar
 
Mobile Menu Logo with link to supplementary files background Layer 1 jbe-platform.quadraat-sans-bold jbe-platform.quadraat-sans-bold-dark jbe-platform.quadraat-sans-bold-light jbe-platform.quadraat-sans-bold prag Twitter_Logo_Blue