Embodied interaction with face masks and social distancing: Brazilian health care workers’ daily routines in pandemic times

In this article, we ask how interlocutors proceed with their daily activities in the first months of the Covid-19 pandemic when faced with new ways of communication due to social distancing and the use of face masks. We carried out a fine-grained analysis of different micropractices from daily work in a healthcare center in Brazil and built our analysis on multimodal conversation analysis (MCA), interactional linguistics (IC), as well as gesture studies (GS). The analysis revealed that particularly the following recurrent patterns seem to be characteristic for communication during the pandemic in the given microcontexts: (a) a high use of deictic gestures, (b) an intensification of prosodic means, (c) verbal strategies such as reformulation and repetition, (d) the integration of object manipulation and (e) mitigation strategies in case of new formats that imply intrusion such as controls at travel checkpoints.

Publication history
Table of contents

1.Introduction

The Covid-19 pandemic has not only provoked a global health crisis but has also brought about severe bio-social consequences with regard to the interactional space people inhabit, where they routinely enact their daily practices and communicate with other individuals. Some of the most crucial public policies people have experienced particularly over the first two years of the pandemic due to the high infectivity of SARS-CoV-2 have been lockdowns, social distancing and the wearing of face masks. As a consequence, the pandemic has deeply changed the multisensorial ways through which people have engaged with each other: Our proxemic orientation in focused gatherings, displayed by body position, posture, gaze, addressed gestures and shared attention (Mondada 2013 2013 “Conversation Analysis: Talk and Bodily Resources for the Organization of Social Interaction.” In Body – Language – Communication. An International Handbook on Multimodality in Human Interaction, ed. by Cornelia Müller, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill, and Silvana Teßendorf, 218–227. Berlin, Boston: De Gruyter Mouton. Google Scholar logo with link to Google Scholar 2013 “Conversation Analysis: Talk and Bodily Resources for the Organization of Social Interaction.” In Body – Language – Communication. An International Handbook on Multimodality in Human Interaction, ed. by Cornelia Müller, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill, and Silvana Teßendorf, 218–227. Berlin, Boston: De Gruyter Mouton. Google Scholar logo with link to Google Scholar), has shifted significantly. Studies have shown that face-to-face communication between interlocutors wearing a face mask obstructs understanding each other at least partially, especially with regard to higher pitched voices; in addition to that, it covers the middle and lower face as a field of gestural expression (Mheidly et al. 2020Mheidly, Nour, Mohamad Y. Fares, Hussein Zalzale, and Jawad Fares 2020 “Effect of Face Masks on Interpersonal Communication during the COVID-19 Pandemic.” Frontiers in Public Health 1–6. Google Scholar logo with link to Google ScholarMheidly, Nour, Mohamad Y. Fares, Hussein Zalzale, and Jawad Fares 2020 “Effect of Face Masks on Interpersonal Communication during the COVID-19 Pandemic.” Frontiers in Public Health 1–6. Google Scholar logo with link to Google Scholar).

Since the beginning of the pandemic outbreak, a lot of work has been carried out in the field of experimental as well as interactional analysis directed towards the issue of how people have dealt with these new forms of reality and how they have developed new patterns of interactions for activity types such as greetings (Katila, Gan and Goodwin 2020Katila, Julia, Yumei Gan, and Marjorie H. Goodwin 2020 “Interaction Rituals and ‘Social Distancing’: New Haptic Trajectories and Touching from a Distance in the Time of COVID-19”. Discourse Studies 22 (4): 418–440. Google Scholar logo with link to Google ScholarKatila, Julia, Yumei Gan, and Marjorie H. Goodwin 2020 “Interaction Rituals and ‘Social Distancing’: New Haptic Trajectories and Touching from a Distance in the Time of COVID-19”. Discourse Studies 22 (4): 418–440. Google Scholar logo with link to Google Scholar; Mondada et al. 2020bMondada, Lorenza, Julia Bänninger, Sofian A. Bouaouina, Guillaume Gauthier, Philipp Hänggi, Mizuki Koda, Hanna Svensson, and Burak S. Tekin 2020a “Doing Paying during the Covid-19 Pandemic.” Discourse Studies 22 (6): 720–752. Google Scholar logo with link to Google ScholarMondada, Lorenza, Julia Bänninger, Sofian A. Bouaouina, Guillaume Gauthier, Philipp Hänggi, Mizuki Koda, Hanna Svensson, and Burak S. Tekin 2020a “Doing Paying during the Covid-19 Pandemic.” Discourse Studies 22 (6): 720–752. Google Scholar logo with link to Google Scholar), paying (Mondada et al. 2020aMondada, Lorenza, Julia Bänninger, Sofian A. Bouaouina, Laurent Camus, Guillaume Gauthier, Philipp Hänggi, Mizuki Koda, Hanna Svensson, and Burak S. Tekin 2020b “Human Sociality in the Times of the Covid-19 Pandemic: A Systematic Examination of Change in Greetings.” Journal of Sociolinguistics 24 (4): 441–468. Google Scholar logo with link to Google ScholarMondada, Lorenza, Julia Bänninger, Sofian A. Bouaouina, Laurent Camus, Guillaume Gauthier, Philipp Hänggi, Mizuki Koda, Hanna Svensson, and Burak S. Tekin 2020b “Human Sociality in the Times of the Covid-19 Pandemic: A Systematic Examination of Change in Greetings.” Journal of Sociolinguistics 24 (4): 441–468. Google Scholar logo with link to Google Scholar), how face masks cover certain communicatively relevant information (Mheidly et al. 2020Mheidly, Nour, Mohamad Y. Fares, Hussein Zalzale, and Jawad Fares 2020 “Effect of Face Masks on Interpersonal Communication during the COVID-19 Pandemic.” Frontiers in Public Health 1–6. Google Scholar logo with link to Google ScholarMheidly, Nour, Mohamad Y. Fares, Hussein Zalzale, and Jawad Fares 2020 “Effect of Face Masks on Interpersonal Communication during the COVID-19 Pandemic.” Frontiers in Public Health 1–6. Google Scholar logo with link to Google Scholar; Calbi et al. 2021Calbi, Marta, Nunzio Langiulli, Francesca Ferroni, Martina Montalti, Anna Kolesnikov, Vittorio Gallese, and Maria Alessandra Umiltà 2021 “The Consequences of COVID-19 on Social Interactions: An Online Study on Face Covering.” Scientific Reports 11 (1): 1–10. Google Scholar logo with link to Google ScholarCalbi, Marta, Nunzio Langiulli, Francesca Ferroni, Martina Montalti, Anna Kolesnikov, Vittorio Gallese, and Maria Alessandra Umiltà 2021 “The Consequences of COVID-19 on Social Interactions: An Online Study on Face Covering.” Scientific Reports 11 (1): 1–10. Google Scholar logo with link to Google Scholar; Giovanelli et al. 2021Giovanelli, Elena, Chiara Valzolgher, Elena Gessa, Michela Todeschini, and Francesco Pavani 2021 “Unmasking the Difficulty of Listening to Talkers with Masks: Lessons from the COVID-19 Pandemic.” i-Perception 12 (2): 1–11. Google Scholar logo with link to Google ScholarGiovanelli, Elena, Chiara Valzolgher, Elena Gessa, Michela Todeschini, and Francesco Pavani 2021 “Unmasking the Difficulty of Listening to Talkers with Masks: Lessons from the COVID-19 Pandemic.” i-Perception 12 (2): 1–11. Google Scholar logo with link to Google Scholar), or how video-mediated interaction has been rising as a ‘virus-free’ alternative to communication in co-presence and which changes this shift involves (Due and Licoppe 2020Due, Brian L., and Christian Licoppe 2020 “Video-Mediated Interaction (VMI): Introduction to a Special Issue on the Multimodal Accomplishment of VMI Institutional Activities.” Social Interaction. Video-Based Studies of Human Sociality 3 (3). Google Scholar logo with link to Google ScholarDue, Brian L., and Christian Licoppe 2020 “Video-Mediated Interaction (VMI): Introduction to a Special Issue on the Multimodal Accomplishment of VMI Institutional Activities.” Social Interaction. Video-Based Studies of Human Sociality 3 (3). Google Scholar logo with link to Google Scholar). Going beyond the rise of new routinized forms of interaction, our aim in the study we carried out was to ask to some extent for a combination of the first two research phenomena: (1) How do interlocutors proceed with their daily activities when faced with new ways of communication due to social distancing and the use of face masks? (2) Is there any change in their interactional routines? In order to elaborate a multimodal analysis of these micropractices, we will present sequences from daily work in a healthcare center in a mid-sized city in the State of Minas Gerais in Brazil. The sequences are part of an ethnographic-interactional larger study about communicative practices and their impact from the beginning of the pandemic to date (Gonçalves 2022Gonçalves, Sineide 2022Máscaras faciais e distanciamento social: uma análise intercorporeal da fala-em-interação em tempos de COVID-19. PhD dissertation, Federal University of Minas Gerais. https://​repositorio​.ufmg​.br​/handle​/1843​/46706Gonçalves, Sineide 2022Máscaras faciais e distanciamento social: uma análise intercorporeal da fala-em-interação em tempos de COVID-19. PhD dissertation, Federal University of Minas Gerais. https://​repositorio​.ufmg​.br​/handle​/1843​/46706).11.In fact, our interest started with face-to-face interactions during the pandemic and has been extended from the second year on towards intercultural video-mediated interactions as an accelerated development that accompanied pandemic and post-pandemic times. This project has been transformed into the inter-institutional and international project Probral, 2023–2026 (see www​.letras​.ufmg​.br​/icmi), funded by DAAD and CAPES. We chose these sequences from a larger dataset since they all contain recurrent patterns that called our attention being representative of the particular pandemic context we singled out.

In the following, we will shortly present our theoretical framework constituted by multimodal conversation analysis (MCA), gesture studies (GS), and interactional linguistics (IL). Afterward, we will introduce the methodological background and procedure before outlining our analysis of six sequences. Finally, we will discuss our findings and formulate emerging issues for further research.

2.From ‘face-to-face’ interaction to new forms of talk in pandemic times

2.1Embodiment in ‘face-to-face’ interaction

Despite being a continuous matter in conversation analysis since the seventies, it is only within the last twenty years that a substantial ‘holistic turn’ in different lines of research focusing on interaction can be observed. We are particularly interested in three fields of inquiry: conversation analysis, interactional linguistics, and gesture studies. Recently, these fields of research have started to influence one another, and they are all following the paradigm of embodiment,22.See also Mondada (2019) 2019 “Contemporary Issues in Conversation Analysis: Embodiment and Materiality, Multimodality and Multisensoriality in Social Interaction.” Journal of Pragmatics 145: 47–62. Google Scholar logo with link to Google Scholar 2019 “Contemporary Issues in Conversation Analysis: Embodiment and Materiality, Multimodality and Multisensoriality in Social Interaction.” Journal of Pragmatics 1451: 47–62. Google Scholar logo with link to Google Scholar, who refers to this turn as ‘corporeal’, ‘intercorporeal’, ‘carnal’, or ‘embodied’. with a growing emphasis on multimodal talk-in-interaction (Deppermann 2013Deppermann, Arnulf 2013 “Multimodal Interaction from a Conversation Analytic Perspective.” Journal of Pragmatics 46 (1): 1–7. Google Scholar logo with link to Google ScholarDeppermann, Arnulf 2013 “Multimodal Interaction from a Conversation Analytic Perspective.” Journal of Pragmatics 46 (1): 1–7. Google Scholar logo with link to Google Scholar; Müller et al. 2013Müller, Cornelia, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill, and Silvana Teßendorf (eds) 2013Body – Language – Communication: An International Handbook on Multimodality in Human Interaction. Volume 1. Berlin, Boston: De Gruyter Mouton. Google Scholar logo with link to Google ScholarMüller, Cornelia, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill, and Silvana Teßendorf (eds) 2013Body – Language – Communication: An International Handbook on Multimodality in Human Interaction. Volume 1. Berlin, Boston: De Gruyter Mouton. Google Scholar logo with link to Google Scholar; Nevile 2015Nevile, Maurice 2015 “The Embodied Turn in Research on Language and Social Interaction.” Research on Language and Social Interaction 48 (2): 121–151. Google Scholar logo with link to Google ScholarNevile, Maurice 2015 “The Embodied Turn in Research on Language and Social Interaction.” Research on Language and Social Interaction 48 (2): 121–151. Google Scholar logo with link to Google Scholar; Schröder 2017Schröder, Ulrike 2017 “Multimodal Metaphors as Cognitive Pivots for the Construction of Cultural Otherness in Talk.” Intercultural Pragmatics 14 (4): 493–524. Google Scholar logo with link to Google ScholarSchröder, Ulrike 2017 “Multimodal Metaphors as Cognitive Pivots for the Construction of Cultural Otherness in Talk.” Intercultural Pragmatics 14 (4): 493–524. Google Scholar logo with link to Google Scholar, 2020 2020 “Talking about Intercultural Experiences.” International Journal of Language and Culture 7 (1): 15–37. Google Scholar logo with link to Google Scholar 2020 “Talking about Intercultural Experiences.” International Journal of Language and Culture 7 (1): 15–37. Google Scholar logo with link to Google Scholar; Schröder and Streeck 2022Schröder, Ulrike, and Jürgen Streeck 2022 “Cultural Concept, Movement, and Way of Life: Jeitinho in Words and Gestures.” Intercultural Pragmatics 19 (4): 427–457. Google Scholar logo with link to Google ScholarSchröder, Ulrike, and Jürgen Streeck 2022 “Cultural Concept, Movement, and Way of Life: Jeitinho in Words and Gestures.” Intercultural Pragmatics 19 (4): 427–457. Google Scholar logo with link to Google Scholar). Concepts that primarily deal with the ‘inter’ of action and originate in conversation analysis such as ‘alignment’, ‘affiliation’ or ‘mutual monitoring’, to name just a few, have more and more paid attention to the relevance of the material environment, embodied activities, as well as environmentally coupled gestures. Through the multimodal prism, social interaction is therefore increasingly conceived as “collectively organized by the co-participants, in a locally situated way, achieved incrementally through its temporal and sequential unfolding, by mobilizing a large range of vocal, verbal, visual and embodied resources, which are publicly displayed and monitored in situ” (Mondada 2013 2013 “Conversation Analysis: Talk and Bodily Resources for the Organization of Social Interaction.” In Body – Language – Communication. An International Handbook on Multimodality in Human Interaction, ed. by Cornelia Müller, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill, and Silvana Teßendorf, 218–227. Berlin, Boston: De Gruyter Mouton. Google Scholar logo with link to Google Scholar 2013 “Conversation Analysis: Talk and Bodily Resources for the Organization of Social Interaction.” In Body – Language – Communication. An International Handbook on Multimodality in Human Interaction, ed. by Cornelia Müller, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill, and Silvana Teßendorf, 218–227. Berlin, Boston: De Gruyter Mouton. Google Scholar logo with link to Google Scholar, 33; see also Goodwin 2000Goodwin, Charles 2000 “Action and Embodiment within Situated Human Interaction.” Journal of Pragmatics 32: 1489–1522. Google Scholar logo with link to Google ScholarGoodwin, Charles 2000 “Action and Embodiment within Situated Human Interaction.” Journal of Pragmatics 321: 1489–1522. Google Scholar logo with link to Google Scholar, 2007 2007 “Participation, Stance and Affect in the Organization of Activities.” Discourse and Society 18 (1): 53–73. Google Scholar logo with link to Google Scholar 2007 “Participation, Stance and Affect in the Organization of Activities.” Discourse and Society 18 (1): 53–73. Google Scholar logo with link to Google Scholar; Deppermann 2013Deppermann, Arnulf 2013 “Multimodal Interaction from a Conversation Analytic Perspective.” Journal of Pragmatics 46 (1): 1–7. Google Scholar logo with link to Google ScholarDeppermann, Arnulf 2013 “Multimodal Interaction from a Conversation Analytic Perspective.” Journal of Pragmatics 46 (1): 1–7. Google Scholar logo with link to Google Scholar; Deppermann, Mondada and Doehler 2021Deppermann, Arnulf, Lorenza Mondada, and Simona Pekarek Doehler 2021 “Early Responses: An Introduction.” Discourse Processes 58 (4): 293–307. Google Scholar logo with link to Google ScholarDeppermann, Arnulf, Lorenza Mondada, and Simona Pekarek Doehler 2021 “Early Responses: An Introduction.” Discourse Processes 58 (4): 293–307. Google Scholar logo with link to Google Scholar). Even more than CA, interactional linguistics has paved the way for the integration of prosody as providing a resource for constructing and organizing shared experience, emotion, and stance thus becoming a locus of embodied habitus within the dialogic framework. Researchers from this field of inquiry have paid a lot of attention to the systematic integration of prosodic means in the linguistic analysis of talk in interaction such as hesitation particles, sound stretching, cut-offs, in-breaths, laughter, pausing, stress and intonation, and what role these play in discourse, as well as for for conversational management, sequencing and framing (Couper-Kuhlen and Selting 1996Couper-Kuhlen, Eizabeth, and Margret Selting (eds.) 1996Prosody in Conversation: Interactional Studies. Cambridge: Cambridge University Press. Google Scholar logo with link to Google ScholarCouper-Kuhlen, Eizabeth, and Margret Selting (eds.) 1996Prosody in Conversation: Interactional Studies. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar; Selting and Couper-Kuhlen 2001Selting, Margret, and Elizabeth Couper-Kuhlen 2001Studies in Interactional Linguistics. Amsterdam, Philadelphia: John Benjamins. Google Scholar logo with link to Google ScholarSelting, Margret, and Elizabeth Couper-Kuhlen 2001Studies in Interactional Linguistics. Amsterdam, Philadelphia: John Benjamins. Google Scholar logo with link to Google Scholar; Hakulinen and Selting 2005Hakulinen, Auli, and Margret Selting 2005Syntax and Lexis in Conversation: Studies on the Use of Linguistic Resources in Talk-in-Interaction. Amsterdam, Philadelphia: John Benjamins. https://​benjamins​.com​/catalog​/sidag​.17. Hakulinen, Auli, and Margret Selting 2005Syntax and Lexis in Conversation: Studies on the Use of Linguistic Resources in Talk-in-Interaction. Amsterdam, Philadelphia: John Benjamins. https://​benjamins​.com​/catalog​/sidag​.17. ; Couper-Kuhlen and Selting 2018Couper-Kuhlen, Elizabeth, and Margret Selting 2018Interactional Linguistics: Studying Language in Social Interaction. Cambridge: Cambridge University Press.Google Scholar logo with link to Google ScholarCouper-Kuhlen, Elizabeth, and Margret Selting 2018Interactional Linguistics: Studying Language in Social Interaction. Cambridge: Cambridge University Press.Google Scholar logo with link to Google Scholar).

Since the very beginning, gesture studies have pointed to the integration of language and gesture and have more and more moved away from a mere cognitive conceptualization of gesture as representation of thought. Gestures should rather be conceived as “a way of cognitively existing, of cognitively being, at the moment of speaking” (McNeill 2005 2005Gesture and Thought. Chicago: University of Chicago Press. Google Scholar logo with link to Google Scholar 2005Gesture and Thought. Chicago: University of Chicago Press. Google Scholar logo with link to Google Scholar, 99). Researchers like Jürgen Streeck (2017)Streeck, Jürgen 2017Self-Making Man: A Day of Action, Life, and Language. Cambridge: Cambridge University Press. Google Scholar logo with link to Google ScholarStreeck, Jürgen 2017Self-Making Man: A Day of Action, Life, and Language. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar aim to build a bridge between gesture studies and conversation analysis by arguing for an interactional, ethnographical and praxeological perspective on gesture, emphasizing the role of gesture in embodied interaction and the organization of interactional trajectories. In contrast to the predominant individual-pragmatic view that is still prevalent in McNeill’s (1992McNeill, David 1992Hand and Mind: What Gestures Reveal about Thought. Chicago: University of Chicago Press.Google Scholar logo with link to Google ScholarMcNeill, David 1992Hand and Mind: What Gestures Reveal about Thought. Chicago: University of Chicago Press.Google Scholar logo with link to Google Scholar, 2005 2005Gesture and Thought. Chicago: University of Chicago Press. Google Scholar logo with link to Google Scholar 2005Gesture and Thought. Chicago: University of Chicago Press. Google Scholar logo with link to Google Scholar) approach, Meyer, Streeck and Jordan (2017)Meyer, Christian, Jürgen Streeck, and Jordan Scott (eds.) 2017Intercorporeality: Emerging Socialities in Interaction. New York: Oxford University Press. Google Scholar logo with link to Google ScholarMeyer, Christian, Jürgen Streeck, and Jordan Scott (eds.) 2017Intercorporeality: Emerging Socialities in Interaction. New York: Oxford University Press. Google Scholar logo with link to Google Scholar look at the animate, spontaneous, and creative character of interaction, as well as the way speech and gesture are both related to sedimentation and creativity (Cuffari and Streeck 2017Cuffari, Elena, and Jürgen Streeck 2017 “Taking the World by Hand: How (Some) Gestures Mean.” In Incorporeality. Emerging Socialities in Interaction, ed. by Christian Meyer, Jürgen Streeck, and Jordan Scott, 173–201. New York: Oxford University Press.Google Scholar logo with link to Google ScholarCuffari, Elena, and Jürgen Streeck 2017 “Taking the World by Hand: How (Some) Gestures Mean.” In Incorporeality. Emerging Socialities in Interaction, ed. by Christian Meyer, Jürgen Streeck, and Jordan Scott, 173–201. New York: Oxford University Press.Google Scholar logo with link to Google Scholar). While gestures such as pointing serve functions within activities of shared cognition and are typically co-orchestrated with spoken deictic expressions, iconic gestures depict or reenact. Likewise, metaphorical gestures construe bodily action and experience. Here, gestures are conceived as an abstracted, yet fully embodied mode of physical action. That is to say, sedimented gestures are shared embodied thinking tools and making them is a form of public thinking. A special case of sedimented gestures are pragmatic gestures, frequently also called ‘performative’, ‘discursive’ or ‘recurrent’ gestures. They have been discussed by Kendon (2004)Kendon, Adam 2004Gesture: Visible Action as Utterance. Cambridge: Cambridge University Press. Google Scholar logo with link to Google ScholarKendon, Adam 2004Gesture: Visible Action as Utterance. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar as having a meta-communicative function such as marking exactness, denial/negation, withdrawal from action/non-intervention, and so on, with regard to something that has been said. Take for example gestures made with open hands facing and pushing downwards or brushing away: they share the semantic idea of interrupting the turn of the interlocutor or moving away something the speaker herself has said (Streeck 2017Streeck, Jürgen 2017Self-Making Man: A Day of Action, Life, and Language. Cambridge: Cambridge University Press. Google Scholar logo with link to Google ScholarStreeck, Jürgen 2017Self-Making Man: A Day of Action, Life, and Language. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar, 2019 2019 “Gesture Research.” In Handbook of Pragmatics, ed. by Jan-Ola Östman, and Jef Verschueren, p. 3–30. Amsterdam, Philadelphia: John Benjamins.Google Scholar logo with link to Google Scholar 2019 “Gesture Research.” In Handbook of Pragmatics, ed. by Jan-Ola Östman, and Jef Verschueren, p. 3–30. Amsterdam, Philadelphia: John Benjamins.Google Scholar logo with link to Google Scholar).

Recently, an increasing number of studies aim to overcome the boundaries between these three areas of research and bring together the previously separately studied resources of interaction. Although sometimes an extracommunicative33.The distinction between communicative and extracommunicative perspectives has been introduced by Gerold Ungeheuer (2004)Ungeheuer, Gerold 2004 “Kommunikative und extrakommunikative Betrachtungsweisen in der Phonetik.” In Sprache und Kommunikation, ed. by Karin Kolb, and H. Walter Schmitz, 22–34. Münster: Nodus Publikationen.Google Scholar logo with link to Google ScholarUngeheuer, Gerold 2004 “Kommunikative und extrakommunikative Betrachtungsweisen in der Phonetik.” In Sprache und Kommunikation, ed. by Karin Kolb, and H. Walter Schmitz, 22–34. Münster: Nodus Publikationen.Google Scholar logo with link to Google Scholar who assumes that every human being experiences communication twice: (1) as a communicator, employing communicative acts to achieve reciprocal understanding, and (2) as a (self-)reflexive observer, categorizing and analyzing the means of communication from an external point of view. This dichotomy has significant methodological implications for any investigation on human interaction conducted by a researcher or an external observer. point of view is necessary for analyzing the different modes of interaction as phenomena of co-occurrence in order to make them manageable for the researcher, we should be aware that from the communicative perspective of the participants themselves, they form one holistic gestalt (see also Mondada 2019 2019 “Contemporary Issues in Conversation Analysis: Embodiment and Materiality, Multimodality and Multisensoriality in Social Interaction.” Journal of Pragmatics 145: 47–62. Google Scholar logo with link to Google Scholar 2019 “Contemporary Issues in Conversation Analysis: Embodiment and Materiality, Multimodality and Multisensoriality in Social Interaction.” Journal of Pragmatics 1451: 47–62. Google Scholar logo with link to Google Scholar). In the following section, we will examine the studies that have already uncovered significant changes in interaction patterns and emerging structures during the pandemic.

2.2Interactional practices in pandemic times

The first studies conducted in the field of talk-in-interaction since the outbreak of the pandemic in Februrary of 2020 mainly deal with the consequential new intercorporeal and communicative reality emerging from social distancing, the use of face masks and the drawing of bounded public space. Katila, Gan and Goodwin (2020)Katila, Julia, Yumei Gan, and Marjorie H. Goodwin 2020 “Interaction Rituals and ‘Social Distancing’: New Haptic Trajectories and Touching from a Distance in the Time of COVID-19”. Discourse Studies 22 (4): 418–440. Google Scholar logo with link to Google ScholarKatila, Julia, Yumei Gan, and Marjorie H. Goodwin 2020 “Interaction Rituals and ‘Social Distancing’: New Haptic Trajectories and Touching from a Distance in the Time of COVID-19”. Discourse Studies 22 (4): 418–440. Google Scholar logo with link to Google Scholar investigate divergent novel practices and embodied choreographies in the elaboration of interaction rituals in the time of coronavirus that, according to the authors, are creatively designed to respond to restrictions and orders ranging from daily encounters to official meetings between politicians. These encounters include ways of how the interactants repair or decline former ways of touching or even apologize for doing so, and the authors describe step-by-step negotiations concerning relationship rituals between politicians and their co-present parties in the shared intercorporeal space. Interestingly, it is also observed that in the most face-threatening moments, when a violation occurred, reconciliation seems to take priority over the physical distancing rules. In a similar vein but much more along a synchronic line, Mondada et al. (2020b)Mondada, Lorenza, Julia Bänninger, Sofian A. Bouaouina, Guillaume Gauthier, Philipp Hänggi, Mizuki Koda, Hanna Svensson, and Burak S. Tekin 2020a “Doing Paying during the Covid-19 Pandemic.” Discourse Studies 22 (6): 720–752. Google Scholar logo with link to Google ScholarMondada, Lorenza, Julia Bänninger, Sofian A. Bouaouina, Guillaume Gauthier, Philipp Hänggi, Mizuki Koda, Hanna Svensson, and Burak S. Tekin 2020a “Doing Paying during the Covid-19 Pandemic.” Discourse Studies 22 (6): 720–752. Google Scholar logo with link to Google Scholar have aimed at documenting the emerging pandemic manifestations in social interacion as well as the changes these involve. A study of this research group has revealed the way tactile embodied greetings have changed from routine greetings to hesitated but still completed ones and finally to projected but refused patterns along with the emergence of new practices such as elbow and feetbumps or hugs-in-the-air. In another study, the research group (Mondada et al. 2020aMondada, Lorenza, Julia Bänninger, Sofian A. Bouaouina, Laurent Camus, Guillaume Gauthier, Philipp Hänggi, Mizuki Koda, Hanna Svensson, and Burak S. Tekin 2020b “Human Sociality in the Times of the Covid-19 Pandemic: A Systematic Examination of Change in Greetings.” Journal of Sociolinguistics 24 (4): 441–468. Google Scholar logo with link to Google ScholarMondada, Lorenza, Julia Bänninger, Sofian A. Bouaouina, Laurent Camus, Guillaume Gauthier, Philipp Hänggi, Mizuki Koda, Hanna Svensson, and Burak S. Tekin 2020b “Human Sociality in the Times of the Covid-19 Pandemic: A Systematic Examination of Change in Greetings.” Journal of Sociolinguistics 24 (4): 441–468. Google Scholar logo with link to Google Scholar) focuses on the reorganization of the social activity of paying in shops and services by analysing the emerging practices of sellers and customers who are now forced to integrate prevention readjustments and to orient towards the choice of payment mode, new forms of payment procedures and imperatives of keeping distance. Rather related to talk itself as well as moral expectations, the culture of the pandemic implied by discourse is studied by Ekberg et al. (2021)Ekberg, Katie, Stuart Ekberg, Lara Weinglass, and Susan Danby 2021 “Pandemic Morality-in-Action: Accounting for Social Action during the COVID-19 Pandemic.” Discourse and Society 32 (6): 666–688. Google Scholar logo with link to Google ScholarEkberg, Katie, Stuart Ekberg, Lara Weinglass, and Susan Danby 2021 “Pandemic Morality-in-Action: Accounting for Social Action during the COVID-19 Pandemic.” Discourse and Society 32 (6): 666–688. Google Scholar logo with link to Google Scholar. The authors reveal how pandemic culture and the accompanying moral order were produced within and through interaction in paediatric palliative care consultations during the first and second waves of Covid-19 in Australia.

Besides these multimodally oriented approaches in the field of conversation analysis there are in particular cognitively and medically oriented studies that deal precisely with the effect of face masks on communication and present results from current studies. Although these studies do not fall in the scope of an interactional approach, we would still like to briefly examine these results. They provide valuable insights into the material context and circumstances that need to be considered from both a communicative and extracommunicative perspective. This will be especially relevant when analyzing the retrospective interviews. Mheidly et al. (2020)Mheidly, Nour, Mohamad Y. Fares, Hussein Zalzale, and Jawad Fares 2020 “Effect of Face Masks on Interpersonal Communication during the COVID-19 Pandemic.” Frontiers in Public Health 1–6. Google Scholar logo with link to Google ScholarMheidly, Nour, Mohamad Y. Fares, Hussein Zalzale, and Jawad Fares 2020 “Effect of Face Masks on Interpersonal Communication during the COVID-19 Pandemic.” Frontiers in Public Health 1–6. Google Scholar logo with link to Google Scholar, e.g., point to the fact that important emblematic gestures such as the ‘chin raiser’, the ‘lip stretcher’, the ‘lip tightener’, ‘the lips part’, or the ‘jaw drop’, each being associated with a set of facial muscles that convey a specific emotion, cannot be identified any longer when an individual wears a face mask. As an example, they point to the ‘chin raiser’, whereby the chin and the lower lip are pushed upward, as well as the ‘lip tightener’ by which the lips appear narrower; in both cases, anger is conveyed. Now, if the lower and middle part of the face are covered, emotional perception descreases and the role of the upper face in emotional expression increases in significance. In a similar vein, Calbi et al. (2021)Calbi, Marta, Nunzio Langiulli, Francesca Ferroni, Martina Montalti, Anna Kolesnikov, Vittorio Gallese, and Maria Alessandra Umiltà 2021 “The Consequences of COVID-19 on Social Interactions: An Online Study on Face Covering.” Scientific Reports 11 (1): 1–10. Google Scholar logo with link to Google ScholarCalbi, Marta, Nunzio Langiulli, Francesca Ferroni, Martina Montalti, Anna Kolesnikov, Vittorio Gallese, and Maria Alessandra Umiltà 2021 “The Consequences of COVID-19 on Social Interactions: An Online Study on Face Covering.” Scientific Reports 11 (1): 1–10. Google Scholar logo with link to Google Scholar highlight that eyes and mouth are particularly relevant for emotional facial expressions. When only the upper part of the face is visible (the eyes), participants perceive and recognize negative emotions better than positive ones. In fact, face masks do not only cover about 60% to 70% of the face, they also have an impact on voice. The study Giovanelli et al. (2021)Giovanelli, Elena, Chiara Valzolgher, Elena Gessa, Michela Todeschini, and Francesco Pavani 2021 “Unmasking the Difficulty of Listening to Talkers with Masks: Lessons from the COVID-19 Pandemic.” i-Perception 12 (2): 1–11. Google Scholar logo with link to Google ScholarGiovanelli, Elena, Chiara Valzolgher, Elena Gessa, Michela Todeschini, and Francesco Pavani 2021 “Unmasking the Difficulty of Listening to Talkers with Masks: Lessons from the COVID-19 Pandemic.” i-Perception 12 (2): 1–11. Google Scholar logo with link to Google Scholar conducted reveals that wearing a face mask reduces meta-cognitive monitoring abilities, that is to say, it leads to lower performance from the speaker and likewise to lower listening confidence.

A preliminary pilot study was conducted by our research group, ICMI,44.Intercultural Communication in Multimodal Interaction. to investigate how people are adapting their everyday interactions during the pandemic, specifically with regards to face masks and social distancing. This pilot study was based on data from various countries collected from YouTube videos. The study showed that eyebrow raise plays a major role as an additional pitch accent marker, that gesture space is enlarged and markably used by more beat gestures when social distancing and the use of face masks are in play, as well as that intonational cues may be displayed to a higher degree in order to compensate for the loss of facial gestures and the loss of verbal means (Schröder et al., submittedSchröder, Ulrike, Anna Ladilova, Sineide Gonçalves, and Fernanda Roque Amendoreira submitted. “Perspectivas multimodais sobre a comunicação com máscaras faciais em tempos de COVID-19.”Schröder, Ulrike, Anna Ladilova, Sineide Gonçalves, and Fernanda Roque Amendoreira submitted. “Perspectivas multimodais sobre a comunicação com máscaras faciais em tempos de COVID-19.”). The present paper can be seen as a consolidation of this pilot study. In the following, the methodological steps are presented.

3.Methodological procedure and hindrances

The videotaped interactions we will present in the following are part of the ICMI corpus that belongs to the international and inter-institutional Research Center Intercultural Communication in Multimodal Interaction – ICMI.55.The ICMI homepage can be accessed at the following link: http://​www​.letras​.ufmg​.br​/icmi/ After recording, the videotapes of the interactions belonging to the ICMI corpus are transcribed in the software program EXMARaLDA (Schmidt and Wörner 2009Schmidt, Thomas, and Kai Wörner 2009 “EXMARaLDA–Creating, Analysing and Sharing Spoken Language Corpora for Pragmatic Research. Pragmatics 19 (4): 565–582. Google Scholar logo with link to Google ScholarSchmidt, Thomas, and Kai Wörner 2009 “EXMARaLDA–Creating, Analysing and Sharing Spoken Language Corpora for Pragmatic Research. Pragmatics 19 (4): 565–582. Google Scholar logo with link to Google Scholar)66.<www.exmaralda.org>, last accessed on March 26, 2019. following the conventions of GAT 2 (Selting et al. 2011Selting, Margret, Peter Auer, Dagmar Barth-Weingarten, et al. 2011 “A System for Transcribing Talk-in-Interaction: GAT 2; Translated and Adapted for English by Elizabeth Couper-Kuhlen and Dagmar Barth-Weingarten.” Gesprächsforschung – Online-Zeitschrift zur verbalen Interaktion 12: 1–51. https://​kops​.uni​-konstanz​.de​/handle​/123456789​/38351Selting, Margret, Peter Auer, Dagmar Barth-Weingarten, et al. 2011 “A System for Transcribing Talk-in-Interaction: GAT 2; Translated and Adapted for English by Elizabeth Couper-Kuhlen and Dagmar Barth-Weingarten.” Gesprächsforschung – Online-Zeitschrift zur verbalen Interaktion 121: 1–51. https://​kops​.uni​-konstanz​.de​/handle​/123456789​/38351). At the present moment, the corpus is comprised of about 2,575 minutes of videotaped interactions with a total of 57,615 intonation units. In methodological terms, GAT 2 (Gesprächsanalytisches Trans-kriptionssystem) and therefore some basic theoretical pillars of IL have become relevant for the projects the ICMI group has developed so far as well as for the ICMI corpus. The following sequences belong to the project “Communication with face masks during pandemic times” and were videotaped at two occasions: (a) at a travel checkpoint located at the entrance of the town Ouro Branco controlled by a local team of health agents from the City Health Administration; and (b) at the Healthcare Center Posto de Saúde da Família Santa Efigênia, located in Conselheiro Lafaiete, a city with approximately 126.000 habitants, in the State of Minas Gerais in Brazil. While the first three sequences were taken from videodata collected between 12h30 and 16h on June 17, 2020, the two sequences from the Healthcare Centre were taken from video data collected on May 28, 2020. All participants signed a Term of Consent and permission was given by the City Health Administration. PSF Santa Efigênia is located at the North of the city at a minor neighborhood with 3,000 habitants. It counts six employees: one head nurse, four health agents, and one receptionist. In Brazil, these healthcare centers are usually located in houses assigned by the municipal administration and allow little space for public attendance. At the beginning of the Covid-19 pandemic, attendance norms for those healthcare centers were established according to which all agents have to wear special equipment for face protection and clothes and must maintain social distancing. Additionally, the first attendance has to happen in the service room where a screening is carried out in order to see if the patient requires attendance by a medical.

For the videotaping, a camera Cannon Power Short SX50HS.4.3 without any support was chosen. One of the major challenges during the videotaping was to overcome the impossibility of locomotion within the small space of the service room. In addition to that, we videotaped the interactions when we were permitted access, that is, four hours of ongoing interaction without previous permission of patients; hence, we had to disregard the footage segments for which we did not receive permission afterwards. Despite seeking a praxeological approach, these local, spatial, and legal limitations had serious consequences for what Mondada (2012)Mondada, Lorenza 2012 “The Conversation Analytic Approach to Data Collection.” In The Handbook of Conversation Analysis, ed. by Jack Sidnell, and Tanya Stivers, 32–56. Oxford, UK: Wiley-Blackwell. Google Scholar logo with link to Google ScholarMondada, Lorenza 2012 “The Conversation Analytic Approach to Data Collection.” In The Handbook of Conversation Analysis, ed. by Jack Sidnell, and Tanya Stivers, 32–56. Oxford, UK: Wiley-Blackwell. Google Scholar logo with link to Google Scholar, leaning on Büscher (2005)Büscher, Monika 2005 “Social Life under the Microscope?Sociological Research Online 10 (1): 100–123. Google Scholar logo with link to Google ScholarBüscher, Monika 2005 “Social Life under the Microscope?Sociological Research Online 10 (1): 100–123. Google Scholar logo with link to Google Scholar, calls seeing rather “with” than “through” the camera. This problem is specifically present with regard to Mondada’s (2012Mondada, Lorenza 2012 “The Conversation Analytic Approach to Data Collection.” In The Handbook of Conversation Analysis, ed. by Jack Sidnell, and Tanya Stivers, 32–56. Oxford, UK: Wiley-Blackwell. Google Scholar logo with link to Google ScholarMondada, Lorenza 2012 “The Conversation Analytic Approach to Data Collection.” In The Handbook of Conversation Analysis, ed. by Jack Sidnell, and Tanya Stivers, 32–56. Oxford, UK: Wiley-Blackwell. Google Scholar logo with link to Google Scholar, 56) video shooting dimension of participation framework and interactional space in the case of the healthcare center: Due to the limited space of the service room as well as the dynamic use of it, it was impossible to document the ongoing interaction with a static camera or to keep a certain distance from the interactants. As a consequence, it was not possible to always capture the entire participation framework.

In addition to the data from the healthcare center, as well as that from the travel checkpoints, data was collected at a hairdresser’s shop, as well as at gyms. After having concluded our first analysis, retrospective interviews were additionally conducted with the professionals in order to elaborate if they themselves report any significant changes in their communicative behavior, patterns, and way of speaking. The choice of the following six sequences was made due to their demonstrability of recurrent patterns which we found in our data and which we consider significant with regard to emergent means of institutional communication with face masks.

4.Analysis of Brazilian health care workers’ daily routines during the pandemic

4.1Emergent interaction patterns at a Covid-19 travel checkpoint

Travel checkpoints in order to control the flux of traffic at the city entrance of Brazilian cities were implemented from March 2020 onwards as part of a series of containment measures regarding Covid-19. One checkpoint was located at Ouro Branco and monitored by three health agents and two traffic agents who measured the temperature of the incoming vehicle drivers. In case of measuring over 37.8ºC, the passengers had to leave the vehicle and were accompanied to a health station while the vehicle was desinfected. Additionally, the agents also handed in hand sanitizer, as well as face masks to the passengers as precaution measure. Figures 1a and 1b show health and traffic agents at the north entrance of the county.

Figures 1a and 1b.Health and traffic agents at the north of Ouro Branco entrance
fig1a.svg
fig1b.svg

In the following, we will present four short sequences from checkpoint interactions and discuss how recurrent interaction patterns emerge in the context of the multimodal coordination of the involved participants considering the the use of face masks, the maintanance of social distance, as well as the surrounding noise.

In all four sequences, we can observe similar patterns that constitute a format or script of interaction that might be labelled ‘checkpoint control’ due to the Covid-19 pandemic, situated here in a mid-sized Brazilian city in the upcountry of Minas Gerais, although the three healthcare workers vary this format to a certain degree. This is to say, there are rules of conduct and associated adjacency pairs emerge based on previous institutionalized scripts; the participants elaborate and reinforce their moves in the flow of interaction in situ and ad hoc by considering the details of turns-at-talk (Enfield and Sidnell 2017Enfield, Nick J., and Jack Sidnell 2017 “On the Concept of Action in the Study of Interaction.” Discourse Studies 19 (5): 515–535. Google Scholar logo with link to Google ScholarEnfield, Nick J., and Jack Sidnell 2017 “On the Concept of Action in the Study of Interaction.” Discourse Studies 19 (5): 515–535. Google Scholar logo with link to Google Scholar). How meaning construction is built as a blending of further routines and new ingredients, how they resemble one another but also differ in detail becomes quite visible in these short excerpts.

Sequence 1.
2020OBBrBS1 ((13:45:46–13:45:57))77.The sequence can be acessed at: https://​youtu​.be​/2cbdDX​_UHa0

A3=Health agent 3; D1=Driver 1

01   A3:   vindo de ↑↑!ON!de;=
           where are you coming from
02   D1:   =crisTIAno otoni ((closes his eyes, raises his eyebrows and
           moves his head backwards))
03   A3:   ˋFE:bre;
            fever
04         TOˋsse;
           cough
05         gar↑ˋGANta;=
           throat
06   D1:   [<<closes his eyes and nods> =não tô tranquilo-> ]
                                         no I’m fine
07   A3:   [=<<l> algum> sintOma gri↑ˋPAL->                 ]
                  any sign of flu
08   D1:   <<nods> tudo tranquilo->
                   everything fine
09   A3:   contato com algum sus↑PEI:to-
           contact with any suspect
10   D1:   <<nodding> tambÉm NÃO.>
                       also no
11   A3:   ↑pOsso olhar <<raising her left arm with the thermometer> a
           tempera[ˊTUra;>           ]
           may I take your temperature
12   D1:          [<<nodding> CLAro.>]
                       sure
13         ((nods))
14   A3:   ((measures the temperature, 1.7))↑cerTIM obriˋgAda;
                                             okay thanks

Although the first lines of Sequence 1, the greeting, are cut off, we can clearly identify the core pattern of the format that has been developed for this new brief interaction at the checkpoint. The health agent asks for the driver’s origin, receives an answer and then proceeds with a typical follow up question that is made up by a ‘list construction’ (Selting 2007Selting, Margret 2007 “Lists as Embedded Structures and the Prosody of List Construction as an Interactional Resource.” Journal of Pragmatics 39 (3): 483–526. Google Scholar logo with link to Google ScholarSelting, Margret 2007 “Lists as Embedded Structures and the Prosody of List Construction as an Interactional Resource.” Journal of Pragmatics 39 (3): 483–526. Google Scholar logo with link to Google Scholar), characterized by the identical prosody of the lexical items that are listed in question format (fever, cough, throat), namely, accent on the penultimate syllable, as well as falling intonation (Sequence 1, L03–07; Sequence 2, L08–11). The falling intonation indicates a routinzed ‘run-through likeness’ stylization. The same happens in Sequence 2 in which we additionally find the first adjacency pair, the greeting, too. It is also striking that the driver’s mobility seems to be kept to a minimum. The man nods in three turns (L06, 08, 10) while giving a negative answer to the routinized questions of the health agent. To our understanding, this nodding could be interpreted as a generalized affirmation of the health agent’s routine on a higher level, such as a generic ‘everything okay’.

Sequence 2.
2020OBBrBS2 ((13:18:08–13:18:24))88.The sequence can be accessed at: https://​youtu​.be​/dP1XVtdJqtI

A3=Health agent 3; D2=Driver 2

01         (2.0)
02   A3:   boa ↑TAR:de;
           good afternoon
03         (-)
04   A3:   [tá vindo de ↑ˋ!ON!de.=]
            where are you coming from
05   D2:   [((looks downwards))   ] lafaiEte;
06         ((looks at A3))
07   A3:   é::;
           yeah
08         ˋFE:bre;
           fever
09   TO:   ˋsse;
           cough
10         gar↑ˋGANta;
           throat
11         algum sintOma;
           any symptoms
12   D2:   ((looks at A3, shakes her head and then looks downwards))
13   A3:   griˊPAL,
           of flu
14         con↑TAto com algum susˊPEI:[to,                                ]
           contact with any suspect
15   D2:                              [((looks at A3 and shakes her head))]
16   A3:   ((shakes her head))↑pOsso
           [olhar <<raising her right arm> a sua tempera ]ˆTUra;>
            may I take your temperature
17   D2:   [((nods))                                     ]
18   A3:   ((measures the temperature, 2.5))↑CERˋtim (.) muiTO obriˋgAda.
                                             okay        thanks a lot

It is worth noting that apart from the beginning, the driver in this sequence only says one word, that is, where she is coming from (L05). Afterwards, she exclusively communicates via facial gestures. This could have to do with the fact that she is being videotaped but may also, in addition to the few movements she makes, be seen as an effect of the pandemic situation in which a lot of people have become insecure regarding their contact and communicative openness towards others due to the risk of infection.

In the next sequence, we see another health agent.

Sequence 3.
2020OBBrBS3 ((13:12:10–13:12:23))99.The sequence can be accessed at: https://​youtu​.be​/ubOO0AKqxAE

A2=Health agent 2; D3=Driver 3

01         (0.9)
02   A2:   bom dIa tudo <<cres> ↑↑BEM?>
           good morning how are you
03         (--)
04   A2:   tá ↑VINdo de ˊONde pra ˋonde.
           where are you coming from and where are you going to
05   D3:   lafaiEte ouro branco;
06         (-)
07   A2:   ouro ↑BRANco;
08         (-)
09   A2:   cê mora a↑QUI,
           do you live here
10         (-)
11   D3:   <<looking at A2, pointing with her head at the left> moro em
           lafaiEte mas trabalho aQUI;>
           I live in Lafaiete but I work here
12   A2:   [↑↑tá;    ]
              okay
13   D3:   [só ir lá.]
            I just go there
14         ((D3 moves her head a bit forward, A2 measures the temperature))
15   A2:   oQUÊI.
           okay

Although the questions about the symptoms are missing in this sequence, the beginning has a similar format to that displayed by the health agent in Sequences 1 and 2. Notably, the driver here does not respond verbally but instead points with her head to the place where she lives (Lafaiete, L11) in order to emphasize the difference between the two places. This might have to do with the face masks and social distancing being perceived as obstacles, in addition to the noisy surroundings. Retrospective interviews conducted with the health workers pointed to this problem, particularly when they were stationed at the checkpoints.

How deictic gestures (McNeill 1992McNeill, David 1992Hand and Mind: What Gestures Reveal about Thought. Chicago: University of Chicago Press.Google Scholar logo with link to Google ScholarMcNeill, David 1992Hand and Mind: What Gestures Reveal about Thought. Chicago: University of Chicago Press.Google Scholar logo with link to Google Scholar; Kendon 2004Kendon, Adam 2004Gesture: Visible Action as Utterance. Cambridge: Cambridge University Press. Google Scholar logo with link to Google ScholarKendon, Adam 2004Gesture: Visible Action as Utterance. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar) compensate for information that can get lost due to the communication with face masks situated in a very noisy environment can be seen par excellence in Sequence 4 where a misunderstanding occurs: When the health agent asks where the driver is coming from, she answers that she is coming from Ouro Branco. The health agent understands that she is working in Ouro Branco, but, actually, the woman lives in Ouro Branco while always driving to work in Lafaiete. By saying this, she is pointing to Lafaiete, and then the health agent is first misinterpreting the situation pointing in the same direction while saying that the woman is from there. Immediately, she then initiates a self-repair with cut-off (Couper-Kuhlen and Selting 2018Couper-Kuhlen, Elizabeth, and Margret Selting 2018Interactional Linguistics: Studying Language in Social Interaction. Cambridge: Cambridge University Press.Google Scholar logo with link to Google ScholarCouper-Kuhlen, Elizabeth, and Margret Selting 2018Interactional Linguistics: Studying Language in Social Interaction. Cambridge: Cambridge University Press.Google Scholar logo with link to Google Scholar, 118) and is now pointing with her left thumb to the left and correcting what she said by asserting that the woman is in fact from here (see Figures 3ab).

Sequence 4.
2020OBBrBS4 ((14:03:54–14:04:09))1010.The sequence can be accessed at: https://​youtu​.be​/k1P1nGnkJ30

A4=Health agent 4; D4=Driver 4

01         (2.2)
02   A4:   <<h> bOa TARde;>
                good afternoon
03         ↑SALvo enˋGAno;=
           if I’m not mistaken
04         =tá vindo de ↑ONde,
            where are you coming from
05   D4:   <<looking at A4, len> lafaiEte;>
07   A4:   então tá vindo pra ouro ↑BRAN:co-
           so you’re coming to Ouro Branco
08   D4:   <<f> ↑NÃ:O;>
                 no
09         (.) é porque eu MO:ro aqui;=
               it’s cause I live here
10         =eu sempre vou <<pointing backwards in a semicircular movement
           with her right hand> LÁ;>
            I always go there
11   A4:   há <pointing with her left thumb to the right> cê é de LÁ me;=
           is it that you are from there
12         =<<acc, pointing with her left thumb to the left> é cê é daQUI
           mesmo:;>
           is it that you are actually from here
13   A4:   sou daqQUI;
           I’m from here
14   A4:   <<raising her hand with the thermometer> é ↑SÓ vê> <<acc> a
           temperatUra;>
           it’s just to take your temperature
15   D4:   ((moves her head forward))
16   A4:   ((measures the temperature)) oˊQUÊI obriGAda;
                                        okay thanks

09   D4:   (.) é porque eu MO:ro
           aqui;=
           it’s cause I live here
10         =eu sempre vou
           <<pointing backwards
           in a semicircular
           movement with her right
           hand> LÁ;>
                 I always go there

fig3a.svg

Figure 3a

11   A4:   há <pointing with her
           left thumb to the
           right> cê é de LÁ me;=
           is it that you are from there
12         =<<acc, pointing with
           her left thumb to the
           left> é cê é daQUI
           mesmo:;>
           is it that you are actually from here
13   A4:   sou daqQUI;
           I’m from here

fig3b.svg

Figure 3b

To our understanding, what is most striking in all four sequences here is the importance of prosody in this emergent format ‘checkpoint control’: Apart from the first sequence (where this turn is probably cut), all sequences start with a greeting and a following turn by which a question is addressed to the driver of the car asking about where he or she is coming from. In all four cases, this new and uncommon intrusion into the private territory of the drivers who could normally enter the city without any impediment seems to be mitigated by prosodic means, on the one hand, by high pitch, and on the other hand, also by varying pitch contours that are frequently associated with a melodic feature.1111.Cf. for high pitch as being related to politeness Ofuka et al. (2000)Ofuka, Etsuko, J. Denis McKeown, Mitch G. Waterman, and Peter J. Roach 2000 “Prosodic Cues for Rated Politeness in Japanese Speech.” Speech Communication 32 (3): 199–217. Google Scholar logo with link to Google ScholarOfuka, Etsuko, J. Denis McKeown, Mitch G. Waterman, and Peter J. Roach 2000 “Prosodic Cues for Rated Politeness in Japanese Speech.” Speech Communication 32 (3): 199–217. Google Scholar logo with link to Google Scholar, Ohara (2001)Ohara, Yumiko 2001 “Finding One’s Voice in Japanese: A Study of the Pitch Levels of L2 Users.” In Multilingualism, Second Language Learning, and Gender, ed. by Aneta Pavlenko, Adrian Blackledge, Ingrid Piller, and Marya Teutsch-Dwyer, 231–256. Berlin, Boston: De Gruyter Mouton. Google Scholar logo with link to Google ScholarOhara, Yumiko 2001 “Finding One’s Voice in Japanese: A Study of the Pitch Levels of L2 Users.” In Multilingualism, Second Language Learning, and Gender, ed. by Aneta Pavlenko, Adrian Blackledge, Ingrid Piller, and Marya Teutsch-Dwyer, 231–256. Berlin, Boston: De Gruyter Mouton. Google Scholar logo with link to Google Scholar, as well as LaPlante and Ambady (2003)Laplante, Debi, and Nalini Ambady 2003 “On How Things Are Said: Voice Tone, Voice Intensity, Verbal Content, and Perceptions of Politeness.” Journal of Language and Social Psychology 22 (4): 434–441. Google Scholar logo with link to Google ScholarLaplante, Debi, and Nalini Ambady 2003 “On How Things Are Said: Voice Tone, Voice Intensity, Verbal Content, and Perceptions of Politeness.” Journal of Language and Social Psychology 22 (4): 434–441. Google Scholar logo with link to Google Scholar. Cf. for strong intonational movement in Brazilian Portuguese and its mitigating effect Schröder and Carneiro Mendes (2019)Schröder, Ulrike, and Mariana Carneiro Mendes 2019 “Unterschiede im Gebrauch und in der Funktion prosodischer Merkmale im deutschen und brasilianischen Sprechen im Kontext des Transkribierens.” In Sprachgebrauch im Kontext. Die deutsche Sprache im Kontakt, Vergleich und in Interaktion mit Lateinamerika/Brasilien, ed. by Thomas Johnen, Mônica Savedra, and Ulrike Schröder, 145–172. Stuttgart: ibidem. Google Scholar logo with link to Google ScholarSchröder, Ulrike, and Mariana Carneiro Mendes 2019 “Unterschiede im Gebrauch und in der Funktion prosodischer Merkmale im deutschen und brasilianischen Sprechen im Kontext des Transkribierens.” In Sprachgebrauch im Kontext. Die deutsche Sprache im Kontakt, Vergleich und in Interaktion mit Lateinamerika/Brasilien, ed. by Thomas Johnen, Mônica Savedra, and Ulrike Schröder, 145–172. Stuttgart: ibidem. Google Scholar logo with link to Google Scholar, as well as Frota et al. (2015)Frota, Sonia, Marisa Cruz, Flaviane Svartman, Gisela Collischonn, Aline Fonseca, Carolina Serra, Pedro Oliveira, and Marina Vigário 2015 “Intonational Variation in Portuguese: European and Brazilian Varieties.” In Intonation in Romance, ed. by Sonia Frota, and Pilar Prieto, 235–283. Oxford: Oxford University Press. Google Scholar logo with link to Google ScholarFrota, Sonia, Marisa Cruz, Flaviane Svartman, Gisela Collischonn, Aline Fonseca, Carolina Serra, Pedro Oliveira, and Marina Vigário 2015 “Intonational Variation in Portuguese: European and Brazilian Varieties.” In Intonation in Romance, ed. by Sonia Frota, and Pilar Prieto, 235–283. Oxford: Oxford University Press. Google Scholar logo with link to Google Scholar. A comparison of the four requests shows the similarities regarding the prosodic structure, especially the high pitch, as well as the degree of variety from one health care worker to another shown in Figures 2a, 2b, 2c and 2d:

Figure 2a.L01 of Sequence 1, transcription GAT 2, syllabic segmentation, the yellow line displays the intensity contour, the blue line the pitch contour
Figure 2a.
Figure 2b.L04 of Sequence 2, transcription GAT 2, syllabic segmentation, the yellow line displays the intensity contour, the blue line the pitch contour
Figure 2b.
Figure 2c.L04 of Sequence 3, transcription GAT 2, syllabic segmentation, the yellow line displays the intensity contour, the blue line the pitch contour
Figure 2c.
Figure 2d.L04 of Sequence 4, transcription GAT 2, syllabic segmentation, the yellow line displays the intensity contour, the blue line the pitch contour
Figure 2d.

As the images show, strong emphasis is mostly put on the syllable ON of the interrogative pronoun onde (“where”) that goes along with a pitch jump upward varying between 50 and 600 Hz,1212.According to Vargas, Cielo, and Trevisan (2010Vargas Ferreira, Fernanda Carla Aparecida Cielo, and Maria Elaine Trevisan 2010 “Medidas vocais acústicas na doença de Parkinson: estudo de casos.” Revista CEFAC 12 (5): 889–898.Google Scholar logo with link to Google ScholarVargas Ferreira, Fernanda Carla Aparecida Cielo, and Maria Elaine Trevisan 2010 “Medidas vocais acústicas na doença de Parkinson: estudo de casos.” Revista CEFAC 12 (5): 889–898.Google Scholar logo with link to Google Scholar, 891), as well as Russo and Behlau (1993)Russo, Iêda, and Mara Behlau 1993Percepção da fala: Análise acústica do português brasileiro. São Paulo: Lovise.Google Scholar logo with link to Google ScholarRusso, Iêda, and Mara Behlau 1993Percepção da fala: Análise acústica do português brasileiro. São Paulo: Lovise.Google Scholar logo with link to Google Scholar, the default value for adult female speakers of Brazilian Portuguese with regard to pitch jumps upward varies between 150 and 250 Hz, and the intensity between 15 and 45 dB. while the intensity varies between 75 and 80 dB. Therefore, this emphasis has a strong melodic impact on the question’s formulaic character and mitigates significantly its imperative and instrusive character. In addition to that, other aspects may cause these sharp intonational contours such as the principal outdoor setting with its noisy main road and the fact that the participants share different spaces additionally separated by the physical distancing rules, as well as the face masks both interlocutors are wearing, a matter that was confirmed by the health workers in our retrospective interview.

Additionally, the request for taking the temperature is likewise introduced by significant pitch changes, most strikingly by a pitch jump upwards in L11 in Sequence 1 and L16 in Sequence 2 when initiating the request ↑pOsso olhar, and in Sequence 4 even downgraded lexically by (“just”), whereby it is salient that the health agents usually start raising their arms in order to perform the measuring while still making the request instead of after having received an affirmative response as second pair. The request for permission in this context rather constitutes as second pair granting by nodding and/or moving the head forward which marks the preferred response, in a similar vein as has been revealed by Fox (2015)Fox, Barbara 2015 “On the Notion of Pre-request.” Discourse Studies 17 (1): 41–63. Google Scholar logo with link to Google ScholarFox, Barbara 2015 “On the Notion of Pre-request.” Discourse Studies 17 (1): 41–63. Google Scholar logo with link to Google Scholar for service encounters (L14–15).

In the second part of our analysis, we will focus on two longer sequences that originate from the inside of the local healthcare center, These sequences depict two situations in which appointments are made.

4.2Making an appointment at a local healthcare center

The following two sequences were selected for this paper because they represent, in a highly condensed way, some recurring patterns of interaction with face masks and social distancing when making an appointment in a healthcare center during the first months of the pandemic (Gonçalves 2022Gonçalves, Sineide 2022Máscaras faciais e distanciamento social: uma análise intercorporeal da fala-em-interação em tempos de COVID-19. PhD dissertation, Federal University of Minas Gerais. https://​repositorio​.ufmg​.br​/handle​/1843​/46706Gonçalves, Sineide 2022Máscaras faciais e distanciamento social: uma análise intercorporeal da fala-em-interação em tempos de COVID-19. PhD dissertation, Federal University of Minas Gerais. https://​repositorio​.ufmg​.br​/handle​/1843​/46706; Schröder et al., sumittedSchröder, Ulrike, Anna Ladilova, Sineide Gonçalves, and Fernanda Roque Amendoreira submitted. “Perspectivas multimodais sobre a comunicação com máscaras faciais em tempos de COVID-19.”Schröder, Ulrike, Anna Ladilova, Sineide Gonçalves, and Fernanda Roque Amendoreira submitted. “Perspectivas multimodais sobre a comunicação com máscaras faciais em tempos de COVID-19.”). In Sequence 5, we observe the end of an interaction between a health agent and a patient in which the health agent gives final instructions to the patient about his next appointment at which he should pick up the results of his exam:

Sequence 5.
2020CLBrPSF1 ((16:47:24–16:48:11))1313.The sequence can be accessed at: https://​youtu​.be​/D18aF9j​_hDo

A1=Health agent 1; P1=Patient 1

01   A1:   com ↑ESse especiaLISta,
           with this specialist
02   P1:   CERto;
           right
03   A1:   você tem que fazer ↑↑NOvos exames;
           you have to do new tests
04   P1:   hm,
05   A1:   se os <<f> ↑↑SEus exames derem alguma altera’ÇÃO,
           if your test results show any changes
06   P1:   AH sei;
           yeah I know
07   A1:   <<pointing with her left hand at the patient’s papers> aí que a
           gente manda pra lá com o xeROX;=
           we’ll send them there by e-mail
08         <<pointing with her left hand onto the papers in her right
           hand>=aí a DÉbora vai providenciar os eXAmes;=
           and then debora will provide the tests
09         <<nodding>=cê vem aqui segunda-feira depois das ↑`ONze?
           you’ll get here on Monday after eleven o’clock
10   P1:   <<nodding> VEnho;>
                      I will
11   A1:   <<nodding> fazendo o fa↑`VOR?>
                      please
12   P1:   se↑GUNda depois das ONze;
           Monday after eleven o’clock
13   A1:   <<nodding> depois das onze;>
                      after eleven o’clock
14   P1:                                                ah [então] tá BOM;
                                                        ah well okay
15   A1:   <<moving her left flat hand from left to right> [tá   ] por que
           de manhã é vaCIna;
           cause in the morning there is vaccine
16   P1:   aHAM,
17   A1:   <<pointing with her right forefinger from left to right on her
           papers> aí a gente vai repetir> os exames,
                   then we’ll repeat the tests
18   P1:           [ah tÁ;]
                    ah okay
19   A1:   <<pointing with her right hand onto the paper and then in front
           of her> [sem   ] os exames ↑NÃO tem como você ir nesse médico;
                    without these tests you can’t go to the doctor
20   P1:   ah:: então tá BOM;
           ah well okay
21   A1:   <<f> enten↑↑DEU->
                you see

As we can see in Figures 4ad below, the health agent is wearing her work clothes, a face mask and a face shield, while the patient is also wearing a face mask.1414. http://​conselheirolafaiete​.mg​.gov​.br​/v1​/wp​-content​/uploads​/2020​/04​/DECRETO​-586​-m%C3%A1scara​-obrigatoriedade​-1​.pdf. However, the health agent does not maintain the spatial distance of 1,50 to 2,00 as proposed by the WHO. This may partially be related to the difficulties of mutual understanding due to the use of face maks since the interactional space is mainly co-built, in addition to a natural, unimpeded face-to-face interaction, by intensified intonational and gestural means integrating the immediate material world at hand, in this case, particularly the papers in the health care worker’s hand. As embedded in empratic action, as Karl Bühler (1982 [1934])Bühler, Karl 1982 [1934]Sprachtheorie: Die Darstellungsfunktion der Sprache. Stuttgart: Fischer.Google Scholar logo with link to Google ScholarBühler, Karl 1982 [1934]Sprachtheorie: Die Darstellungsfunktion der Sprache. Stuttgart: Fischer.Google Scholar logo with link to Google Scholar put it, deictic gestures play a major role in pointing to abstract or concrete objects in the immediate environment of the co-participants as a “situated practice” (Goodwin 2003 2003 “Pointing as Situated Practice.” In Pointing: Where Language, Culture, and Cognition Meet, ed. by Sotaro Kita, 225–250. Mahwah, NJ: Lawrence Erlbaum. Google Scholar logo with link to Google Scholar 2003 “Pointing as Situated Practice.” In Pointing: Where Language, Culture, and Cognition Meet, ed. by Sotaro Kita, 225–250. Mahwah, NJ: Lawrence Erlbaum. Google Scholar logo with link to Google Scholar), thereby facilitating co-orientation in the limited interaction. In the following excerpts 4a, 4b, 4c and 4d, taken from Sequence 5, we see how pointing gestures and gaze shifts are co-orchestrated with spoken language in order to guide the interlocutor through the procedural routine, that is, waiting for the results of his tests, getting the results on Monday, and then possibly coming back to see a doctor. By performing this activity, pointing to the concrete object, the papers, the concrete and abstract are highly intertwined, that is, pointing to the temporal path the patient has to pursue, which includes the tranposition of the the deictic gestures to the temporal axis (Streeck 2019 2019 “Gesture Research.” In Handbook of Pragmatics, ed. by Jan-Ola Östman, and Jef Verschueren, p. 3–30. Amsterdam, Philadelphia: John Benjamins.Google Scholar logo with link to Google Scholar 2019 “Gesture Research.” In Handbook of Pragmatics, ed. by Jan-Ola Östman, and Jef Verschueren, p. 3–30. Amsterdam, Philadelphia: John Benjamins.Google Scholar logo with link to Google Scholar):

Figures 4a-d.Deictic gestures during an appointment at the health center

05   A:   se os <<f> SEus exames
          derem alguma
          altera↑↑`ÇÄO,
          if your test results show any
          changes
06   P:   AH sei;
          yeah I know
07   A:   <<pointing with her
          left hand at the
          patient’s papers> aí
          que a gente manda pra
          lá com o xeROX;=
          we’ll send them there by e-mail

fig4a.svg

Figure 4a

08   A:    <<pointing with her
           left hand onto the
           papers in her right
           hand>=aí a DĖbora vai
           Providenciar os eXAmes;=
           and then debora will provide the
           tests

fig4b.svg

Figure 4b

15   A:   <<moving her left flat
          hand from left to
          right> [Tá   ] por que
          de manhã é vaCIna;
          cause in the morning there is
          vaccine
16   P:   aHAM,
17   A:   <<pointing with her
          right forefinger from
          left to right on her
          papers> aí a gente vai
          repetir> os exames,
          then we’ll repeat the tests

fig4c.svg

Figure 4c

18   P:           [ah TÁ;]
                   ah okay
19   A:   <<pointing with her
          right hand onto the
          paper and then in front
          of her> [sem   ] os
          exames ↑NÃO tem como
          você ir nesse médico;
          without these tests you can’t go to
          the doctor

fig4d.svg

Figure 4d

Interestingly, in addition to these deictic cues, both, the healthcare agent as well as the patient display vocal and prosodic means to constitute and assure mutual understanding: Reference to the specific day of the patient’s return is made explicitly in total five times (two times later in the transcript) as repetition and re-formulation withouth any sign of repair initiation (cf. Couper-Kuhlen and Selting 2018Couper-Kuhlen, Elizabeth, and Margret Selting 2018Interactional Linguistics: Studying Language in Social Interaction. Cambridge: Cambridge University Press.Google Scholar logo with link to Google ScholarCouper-Kuhlen, Elizabeth, and Margret Selting 2018Interactional Linguistics: Studying Language in Social Interaction. Cambridge: Cambridge University Press.Google Scholar logo with link to Google Scholar), as we can see in our short excerpt already in L09: cê vem aqui segunda-feira depois das ↑`ONze? (you’ll get here on Monday after eleven o’clock), its first repetition in L12 by the patient: se↑GUNda depois das ONze; (Monday after eleven o’clock) and right afterwards by another one as a confirmation given by the health agent in L13: depois das onze; (after eleven o’clock). Alongside with these lexical means, prosodic cues are salient especially in the turns of the health agent such as pitch jumps (L01, 03, 09, 11, 19), two times even incorporated as large pitch upstep, as well as high volume (L05 and 21; Figures 4e and 4f).

Figure 4e.L05 of Sequence 5, transcription GAT 2, syllabic segmentation, the yellow line displays the intensity contour, the blue line the pitch contour
Figure 4e.
Figure 4f.L21 of Sequence 5, transcription GAT 2, syllabic segmentation, the yellow line displays the intensity contour, the blue line the pitch contour
Figure 4f.

The patient himself constantly gives tokens of response functioning as claims of understanding (Ford and Thompson 2010Ford, Cecilia E., and Sandra A. Thompson 2010 “Interactional Units in Conversation: Syntactic, Intonational, and Pragmatic Resources for the Management of Turns.” In Interaction and Grammar, ed. by Elinor Ochs, Emanuel Schegloff, and Sandra Thompson, 134–184. Cambridge: Cambridge University Press. Google Scholar logo with link to Google ScholarFord, Cecilia E., and Sandra A. Thompson 2010 “Interactional Units in Conversation: Syntactic, Intonational, and Pragmatic Resources for the Management of Turns.” In Interaction and Grammar, ed. by Elinor Ochs, Emanuel Schegloff, and Sandra Thompson, 134–184. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar) that are either overexplicit such as the exact repetition of day and time in L12, or signals an apparent ‘change-of-state’ token (Heritage 1998Heritage, John 1998 “Oh-Prefaced Responses to Inquiry.” Language in Society 27 (3): 291–334. Google Scholar logo with link to Google ScholarHeritage, John 1998 “Oh-Prefaced Responses to Inquiry.” Language in Society 27 (3): 291–334. Google Scholar logo with link to Google Scholar), as if the health agent is constantly passing new information to him although he already had received the information before (L18 and 20 and later on). This whole episode therefore seems to be exuberant by additional interactional resources displayed in order to prevent possible misunderstandings and to coordinate mutual understanding despite possible restrictions imposed by the use of the face masks. This interpretation is supported by the retrospective interview we conducted with the health agent who participated in this interaction and who confirmed that communicating with face masks would block parts of the facial gestures and would also interfere the auditory system. According to her, as a consequence, she always tried to speak louder and give more vocal and gestural hints. She maintains: “… tem um grau de dificuldade de audição e entendimento, muitas vezes, eles [os pacientes] visualizam muito a nossa boca, o nosso rosto. A máscara dificulta isso. E a gente tem que falar um pouco mais alto do que o normal [...] Eu mexo muito com minhas mãos, é o olhar...” (HA1, October 13, 2021).1515.There is a certain degree of difficulty regarding the hearing and understanding, frequently they [the patients] visualize through our mouth, our face. The mask makes this difficult. So we have to talk a little bit louder than normally [...] I use my hands a lot it’s also the look…

Sequence 6 takes place in the same service room on the same day. Besides the presence of the head nurse, there are two further health agents and one patient who wants to schedule an appointment for her newborn grandchild. In the beginning of this interaction, one of the health agents passes some information to the woman while concurrently taking notes on the corresponding documents for the appointment.

Sequence 6.
2020CLBrPSF2 ((12:34:06–12:35:26))1616.The sequence can be accessed at: https://​youtu​.be​/EhS0qTH3UbY

A1=Health agent 1; A2=Health agent 2; P2=Patient 2; P3=Patient 3; HN=Head nurse

01         (1.1)
02   A1:   <<sitting and writing> oh SHIRley;>
03         (-)
04   P2:   <<looking at the notification at the wall> seNHO:ra;>
                                                      Ma’am
05   A1:   <<writing> consegui mar:cA:r para ↑dia deZOi↑to,
                      I got an appointment for the eighteenth
06         (-)
07   HN:   sEte e meia da manHÃ,
           seven thirteen a.m.
08   P3:   ((approaches the table))
09         (--)
10   A1:   ↑TÁ->
            okay
11         <<acc> aí eu já ↑ˋVOU [entregar isso no;                   ]
                  then I’ll already hand this in
12   P3:                         [peRAÍ <<looking at HN, f> que ˆDIA;>]
                                  wait a moment             which day
13         [<<pointing to the table> ah me põe lá no paPEL lá;>]
                                     ah write it down for me there
14   HN:   [<<looking to P2> dia deˋZOIto.>                    ]
                             the eighteenth
15   A1:   [<<all> ↑↑NÃO;>   ]
                     no
16   HN:   [vai tudo aNOtado;]
            everything will be written down
17   A2:   [aNOˋtar::;       ]
            written down
18   P3:   [<<knocking with her left hand on her head, laughing> esQUEço
           minha fIlha,>        ]
           I forgot my dear
19   A2:   [<<len> ca ˊCAL::ma;>]
                   keep calm
20   P3:   [((laughs))]
21   HN:   [<<looking at the calendar> é o aniversÁrio da BIa;>]
                                       it’s Bia’s birthday
22   A2:   [vai aNOta::R;                                      ]
            she’ll write it down
23   HN:   no dia dezoito quinta [FEIra;>]
           the eighteenth Thursday
24   P3:                         [é.     ]
                                  right
25   A1:   [ˊTÁ:?                                    ]
             is it
26   P3:   [<<looking at the calendar> QUINta feira;>]
                                       Thursday
27   HN:   <<pointing with her left hand at the calendar> é.>
                                                          it is
28   A1:   ↑MARcou o retOrno pra Ela (.) que ˋdIa;
            which day you scheduled her return
29   P3:   [<<looking at the calendar> dezoito de junho né débora;=>]
                                       june eighteen right Débora
30   HN:   [<<rolling her hands over the calendar> é:.>             ]
                                                   right
31         (.)
32   P3:   <<lifting and rolling her arm, pointing in the air> ˊNÃO;=
                                                                no
33         =assim que o exame tiver PRONto vou lá;
            as soon as the test is ready I’ll go there
34   HN:   <<taking the papers> é tem que levar LÁ;>
                                you have to bring it there
35         (-)
36   A1:   <<acc> aí você já sabe que tem uma conSULta marcada pro dia
           deZOIto;
                  so you already know that you have a scheduled appointment for the eighteenth
37         [caso eles !MAR!quem cê faz o favor de explicar que já foi
           marˊcA::do?   ]
            in case they schedule please explain to them that it was already scheduled
38   HN:   [<<looking at the partner of P3> I::Sso pra não marcar
           embaixo;=↑né?>]
                                            so that you don’t schedule downstairs again
           right
39         (-)
40   A1:   e:::;
           and
41         não dá PRA::;
           it doesn’t work for
42   HN:   hoje é que dIa Jeane;
           today it’s what day Jeane
43   A1:   [pra consultar alguma coisa nesse ˋDIa; ]
            for scheduling something for this day
44   A2:   [vinte e OIto.                          ]
            twenty eight
45   A1:   <<pointing three times with her right forefinger onto the
           papers> porque,(-)
           because
46         (-)
47   A1:   ˋAplica reMÉ::diO;=↑né-
            you take your medicine right
48         ↑essas coisas TOdas;>
            all this stuff

After this sequence, the conversation still continues for some time around the topic of the appointments and P2 returns to the calendar to check other dates. Yet, what matters with regard to our discussion about recurrent patterns of communication in health care settings with face masks in Brazil unfolds par excellence in the first lines of this sequence and reflects what we have found in other sequences as well (see Gonçalves 2022Gonçalves, Sineide 2022Máscaras faciais e distanciamento social: uma análise intercorporeal da fala-em-interação em tempos de COVID-19. PhD dissertation, Federal University of Minas Gerais. https://​repositorio​.ufmg​.br​/handle​/1843​/46706Gonçalves, Sineide 2022Máscaras faciais e distanciamento social: uma análise intercorporeal da fala-em-interação em tempos de COVID-19. PhD dissertation, Federal University of Minas Gerais. https://​repositorio​.ufmg​.br​/handle​/1843​/46706). Again, it is striking to which extent and how dynamically the interactional space of this room is used by all co-participants despite the social distancing order, which is probably more remarkable in healthcare services than in other institutional settings.

In the beginning of the sequence, we can observe how social distancing is dissolved situatively by the institutional parties since the woman scheduling an appointment for her granddaughter is not positioning herself immediately in front of the table, where she probably would have stood in pre-pandemic times, but maintains more or less the appropriate distance of one or two meters (see Figure 5a). It is only after the indirect ‘call into’ the interactional space of the three health agents that the woman steps into the immediate space of verbal interaction and finally becomes an active co-participant (L04–05). She also becomes involved in the material world by manipulating the calendar together with the head nurse (HN) and writing her ID information into the registration book that is located at the desk where one of the health agents is seated (A1), instead of at a separate desk. As in Sequence 5, here again, we can observe a rich multimodal coordination involved in this contextual incorporation of the format ‘making an appointment’ with careful strategies of joint or shared understanding and double-checkings: When HN says that P3 should return on June 18, the patient initiates a repair by a repetition with a question word (Sidnell 2010Sidnell, Jack 2010Conversation Analysis: An Introduction. Malden, Oxford, West Sussex: Wiley-Blackwell.Google Scholar logo with link to Google ScholarSidnell, Jack 2010Conversation Analysis: An Introduction. Malden, Oxford, West Sussex: Wiley-Blackwell.Google Scholar logo with link to Google Scholar, 125–132): peRAÍ que ˆDIA; (L12; wait a moment which day). In the following, P3 additionally asks for a pen so that she can write the date down, supporting her request through an explanation, namely, that she will otherwise forget it, accompanied by a deictic-metaphoric gesture (McNeill 1992McNeill, David 1992Hand and Mind: What Gestures Reveal about Thought. Chicago: University of Chicago Press.Google Scholar logo with link to Google ScholarMcNeill, David 1992Hand and Mind: What Gestures Reveal about Thought. Chicago: University of Chicago Press.Google Scholar logo with link to Google Scholar) by which her left flat hand knocks on her head (L15–17; see Figure 5b). This (a) points to the problem – she is not able to remember this by memorization – and (b) conceptualizes her head metaphorically as being the container where memories should be stored – but get lost in her case.

Figures 5a-b.Metaphoric gesture during an appointment at the healthcare center

((interactional space in the beginning of the sequence))

fig5a.svg

Figure 5a

15   HN:   [vai tudo aNOtado;]
            everything will be written down
16   A2:   [aNOˋtar::;       ]
            written down
17   P3:   <<knocking with her left hand at
           her head, laughing> esQUEço minha
           fIlha,>
           I forgot my dear

fig5b.svg

Figure 5b

In the following, a series of pointing or deictic gestures coordinate the joint actions of P3 and the HN in order to make sure that P3 understands the procedure and does not forget when to come back and what she should do before her return (L 26, 30, 42; see Figures 5cf). These gestures are co-orchestrated with repetitions and re-formulations of data and time, and in L20, the head nurse adds a further mnemonic device by mentioning that the date corresponds to the birthday of a common friend named “Bia” (Figure 5c), before the woman repeats the date in L25 again which is confirmed by HN in L26 (Figure 5d). Then, in L28, the woman passes this information to A1 who is sitting on the desk and asks her now about the date although she has been present during this whole conversation. Finally, A1 repeats the date of the appointment herself again to the woman in L34 in order to remind her that she should not make another appointment for the same time, which is added by a syntactically integrated expansion, a kind of “glue-on” increment (Auer 1996Auer, Peter 1996 “On the Prosody and Syntax of Turn-Continuations.” In Prosody in Conversation. Interactional Studies, ed. by Elizabeth Couper-Kuhlen, and Margret Selting, 57–100. Cambridge, New York: Cambridge University Press. Google Scholar logo with link to Google ScholarAuer, Peter 1996 “On the Prosody and Syntax of Turn-Continuations.” In Prosody in Conversation. Interactional Studies, ed. by Elizabeth Couper-Kuhlen, and Margret Selting, 57–100. Cambridge, New York: Cambridge University Press. Google Scholar logo with link to Google Scholar; Couper-Kuhlen and Selting 2018Couper-Kuhlen, Elizabeth, and Margret Selting 2018Interactional Linguistics: Studying Language in Social Interaction. Cambridge: Cambridge University Press.Google Scholar logo with link to Google ScholarCouper-Kuhlen, Elizabeth, and Margret Selting 2018Interactional Linguistics: Studying Language in Social Interaction. Cambridge: Cambridge University Press.Google Scholar logo with link to Google Scholar) in L35. Moreover, by turning from the timetable at the wall and HN to addressing A1at the desk, in L30, P3 is lifting, and rolling her right hand in the air and thereby eventually pointing to a certain point in time while saying assim que o exame tiver PRONto vou lá; (as soon as the test is ready I’ll go there; L30; see Figure 5e). Lastly, in L42–45, A1 is pointing to the papers on the desk in which P3 is concurrently writing down her information in order to make sure, again, that there is no misunderstanding regarding date and time of the appointment, as well as the actions to be taken (L42–45; see Figure 5f).

Figures 5c-f.Deictic gestures during an appointment at the health center

18   A2:   [<<len> ca
           ˊCAL::::ma;>]
            keep calm
19   P3:   [((laughs)) ]
20   HN:   <<looking at the calendar>
           é o aniversÁrio da BIa;>
           it’s Bia’s birthday

fig5c.svg

Figure 5c

22   HN:   no dia dezoito quinta [FEIra;>]
           the eighteenth thursday
23   P3:                         [é.     ]
                                  right
24   A1:   [ˊTÁ:?        ]
             is it
25   P3:   [<<looking at the calendar>
           QUINta feira;>]
           thursday
26   HN:   <<pointing with her left hand at
           the calendar> é.>
           it is

fig5d.svg

Figure 5d

30   P3:   <<lifting and rolling
           her arm, pointing in
           the air> ˊNÃO;=
           no
31         =assim que o exame
           tiver PRONto vou lá;>
           as soon as the test is ready I’ll go
           there
32   HN:   <<taking the papers> é
           tem que levar LÁ;>
           you have to bring it there

fig5e.svg

Figure 5e

42   A1:   <<pointing three times
           with her right
           forefinger onto the
           papers> porque,(-)
           because
43         (-)
44   A1:   ˋAplica reMĖ::diO;=↑né-
            you take your medicine right
45         ↑essas coisas TOdas;>
            all this stuff

fig5f.svg

Figure 5f

Summing up, we can highlight that both sequences showed that the intended physical distance is not always maintained during the interactions of appointment making. This may be, among other things, a consequence of the limited space available, as the healthcare centers in mid-sized cities in Brazil are relatively small. This can also be partially explained by the increased auditory problems, which require reducing social distancing to ensure mutual understanding. This explanation was also provided in the retrospective interviews. As a result, deictic gestures have become prominent. These gestures are co-orchestrated with repetitions and re-formulations of data and time, serving as checks for understanding.

5.Concluding remarks

Our aim in this article was to carry out a fine-grained multimodal analysis of the way Brazilian health care workers interact in their institutional settings according to new affordances imposed by social distancing orders and the use of face masks; measures that to a certain degree might interfere in face-to-face interaction. In this article, we have presented two distinct outcomes from our case study: (a) an emerging format of a ‘routinized control’ constituted by the interaction between healthcare workers and car drivers at city entrance checkpoints, and (b) specific resources for ‘making an appointment’ involving healthcare workers and patients at the local healthcare service. While the first type of interaction was analyzed in terms of its format and characteristics, the second type was analyzed with consideration for the potential changes brought about by the pandemic. Also, while there is no direct comparison with previous interaction practices, there are some insightful observations as well as retrospective comments from the interviews with healthcare workers that we can rely on.

The analysis of the sequences at the checkpoint revealed that participants in these interactions, that is the healthcare agents and drivers, co-build their activities on known activity formats and interactional patterns in order to create new routines. New affordances such as the unusual intrusion in the driver’s space have been attenuated mainly by prosodic means. In this situation, in which health control is the primary issue, social distancing seems to be respected probably due to the interaction’s brief and explicitly pandemic-related character. Concerning the other two instances we analyzed that took place in the healthcare center and build on a previously established action format, namely, making appointments, two implemented strategies were similar to the travel checkpoint situation: First of all, we observed a significant use of deictic gestures in the coordination of interaction,1717.We gave only one example here but this observation is valid for the entire analysis, see Gonçalves (2022)Gonçalves, Sineide 2022Máscaras faciais e distanciamento social: uma análise intercorporeal da fala-em-interação em tempos de COVID-19. PhD dissertation, Federal University of Minas Gerais. https://​repositorio​.ufmg​.br​/handle​/1843​/46706Gonçalves, Sineide 2022Máscaras faciais e distanciamento social: uma análise intercorporeal da fala-em-interação em tempos de COVID-19. PhD dissertation, Federal University of Minas Gerais. https://​repositorio​.ufmg​.br​/handle​/1843​/46706. and, secondly, prosodic cues such as pitch jumps and volume were of great importance in order to guarantee shared understanding. Particularly the deictic gestures seem to point not to a change in quality of the daily routines but rather indicate a rise of ‘empractic language use’, as Bühler (1982 [1934])Bühler, Karl 1982 [1934]Sprachtheorie: Die Darstellungsfunktion der Sprache. Stuttgart: Fischer.Google Scholar logo with link to Google ScholarBühler, Karl 1982 [1934]Sprachtheorie: Die Darstellungsfunktion der Sprache. Stuttgart: Fischer.Google Scholar logo with link to Google Scholar called it or ‘situated practices’, as Goodwin (2003) 2003 “Pointing as Situated Practice.” In Pointing: Where Language, Culture, and Cognition Meet, ed. by Sotaro Kita, 225–250. Mahwah, NJ: Lawrence Erlbaum. Google Scholar logo with link to Google Scholar 2003 “Pointing as Situated Practice.” In Pointing: Where Language, Culture, and Cognition Meet, ed. by Sotaro Kita, 225–250. Mahwah, NJ: Lawrence Erlbaum. Google Scholar logo with link to Google Scholar put it, also combined with object manipulation and integration. In addition to that, we could single out verbal strategies such as reformulation, repetition, as well as mnemonic cues. Despite the appropriate use of clothes and face masks, social distancing was not maintained in these settings in line with the regulation. If this tendency has a mere spatial, auditory, or also cultural background, cannot be answered just based on our results. In case the pandemic in fact presents a state of ‘new normal’ in our societies, microstudies of social order and restricted multimodal talk-in-interaction will change our research agenda significantly in future.

Funding

Ulrike Schröder would like to thank the Coordination for the Improvement of Higher Education Personnel – CAPES (Coordenação de Aperfeiçoamento de Pessoal de Nível Superior), for the senior fellowship Capes-PrInt programme which enabled her research year at the University of Texas at Austin, USA, as well as the University Duisburg-Essen, Germany (2020–2021), CNPq (The National Council for Scientific and Technological Development) for the Fellowship Productivity in Research 2022–2025, as well as CAPES/DAAD for the research funding programme Probral (2023–2026).

Acknowledgements

Sineide Gonçalves would like to thank the Coordination for the Improvement of Higher Education Personnel – CAPES (Coordenação de Aperfeiçoamento de Pessoal de Nível Superior), for her PhD scholarship.

Notes

1.In fact, our interest started with face-to-face interactions during the pandemic and has been extended from the second year on towards intercultural video-mediated interactions as an accelerated development that accompanied pandemic and post-pandemic times. This project has been transformed into the inter-institutional and international project Probral, 2023–2026 (see www​.letras​.ufmg​.br​/icmi), funded by DAAD and CAPES.
2.See also Mondada (2019) 2019 “Contemporary Issues in Conversation Analysis: Embodiment and Materiality, Multimodality and Multisensoriality in Social Interaction.” Journal of Pragmatics 145: 47–62. Google Scholar logo with link to Google Scholar 2019 “Contemporary Issues in Conversation Analysis: Embodiment and Materiality, Multimodality and Multisensoriality in Social Interaction.” Journal of Pragmatics 1451: 47–62. Google Scholar logo with link to Google Scholar, who refers to this turn as ‘corporeal’, ‘intercorporeal’, ‘carnal’, or ‘embodied’.
3.The distinction between communicative and extracommunicative perspectives has been introduced by Gerold Ungeheuer (2004)Ungeheuer, Gerold 2004 “Kommunikative und extrakommunikative Betrachtungsweisen in der Phonetik.” In Sprache und Kommunikation, ed. by Karin Kolb, and H. Walter Schmitz, 22–34. Münster: Nodus Publikationen.Google Scholar logo with link to Google ScholarUngeheuer, Gerold 2004 “Kommunikative und extrakommunikative Betrachtungsweisen in der Phonetik.” In Sprache und Kommunikation, ed. by Karin Kolb, and H. Walter Schmitz, 22–34. Münster: Nodus Publikationen.Google Scholar logo with link to Google Scholar who assumes that every human being experiences communication twice: (1) as a communicator, employing communicative acts to achieve reciprocal understanding, and (2) as a (self-)reflexive observer, categorizing and analyzing the means of communication from an external point of view. This dichotomy has significant methodological implications for any investigation on human interaction conducted by a researcher or an external observer.
4.Intercultural Communication in Multimodal Interaction.
5.The ICMI homepage can be accessed at the following link: http://​www​.letras​.ufmg​.br​/icmi/
6.<www.exmaralda.org>, last accessed on March 26, 2019.
7.The sequence can be acessed at: https://​youtu​.be​/2cbdDX​_UHa0
8.The sequence can be accessed at: https://​youtu​.be​/dP1XVtdJqtI
9.The sequence can be accessed at: https://​youtu​.be​/ubOO0AKqxAE
10.The sequence can be accessed at: https://​youtu​.be​/k1P1nGnkJ30
11.Cf. for high pitch as being related to politeness Ofuka et al. (2000)Ofuka, Etsuko, J. Denis McKeown, Mitch G. Waterman, and Peter J. Roach 2000 “Prosodic Cues for Rated Politeness in Japanese Speech.” Speech Communication 32 (3): 199–217. Google Scholar logo with link to Google ScholarOfuka, Etsuko, J. Denis McKeown, Mitch G. Waterman, and Peter J. Roach 2000 “Prosodic Cues for Rated Politeness in Japanese Speech.” Speech Communication 32 (3): 199–217. Google Scholar logo with link to Google Scholar, Ohara (2001)Ohara, Yumiko 2001 “Finding One’s Voice in Japanese: A Study of the Pitch Levels of L2 Users.” In Multilingualism, Second Language Learning, and Gender, ed. by Aneta Pavlenko, Adrian Blackledge, Ingrid Piller, and Marya Teutsch-Dwyer, 231–256. Berlin, Boston: De Gruyter Mouton. Google Scholar logo with link to Google ScholarOhara, Yumiko 2001 “Finding One’s Voice in Japanese: A Study of the Pitch Levels of L2 Users.” In Multilingualism, Second Language Learning, and Gender, ed. by Aneta Pavlenko, Adrian Blackledge, Ingrid Piller, and Marya Teutsch-Dwyer, 231–256. Berlin, Boston: De Gruyter Mouton. Google Scholar logo with link to Google Scholar, as well as LaPlante and Ambady (2003)Laplante, Debi, and Nalini Ambady 2003 “On How Things Are Said: Voice Tone, Voice Intensity, Verbal Content, and Perceptions of Politeness.” Journal of Language and Social Psychology 22 (4): 434–441. Google Scholar logo with link to Google ScholarLaplante, Debi, and Nalini Ambady 2003 “On How Things Are Said: Voice Tone, Voice Intensity, Verbal Content, and Perceptions of Politeness.” Journal of Language and Social Psychology 22 (4): 434–441. Google Scholar logo with link to Google Scholar. Cf. for strong intonational movement in Brazilian Portuguese and its mitigating effect Schröder and Carneiro Mendes (2019)Schröder, Ulrike, and Mariana Carneiro Mendes 2019 “Unterschiede im Gebrauch und in der Funktion prosodischer Merkmale im deutschen und brasilianischen Sprechen im Kontext des Transkribierens.” In Sprachgebrauch im Kontext. Die deutsche Sprache im Kontakt, Vergleich und in Interaktion mit Lateinamerika/Brasilien, ed. by Thomas Johnen, Mônica Savedra, and Ulrike Schröder, 145–172. Stuttgart: ibidem. Google Scholar logo with link to Google ScholarSchröder, Ulrike, and Mariana Carneiro Mendes 2019 “Unterschiede im Gebrauch und in der Funktion prosodischer Merkmale im deutschen und brasilianischen Sprechen im Kontext des Transkribierens.” In Sprachgebrauch im Kontext. Die deutsche Sprache im Kontakt, Vergleich und in Interaktion mit Lateinamerika/Brasilien, ed. by Thomas Johnen, Mônica Savedra, and Ulrike Schröder, 145–172. Stuttgart: ibidem. Google Scholar logo with link to Google Scholar, as well as Frota et al. (2015)Frota, Sonia, Marisa Cruz, Flaviane Svartman, Gisela Collischonn, Aline Fonseca, Carolina Serra, Pedro Oliveira, and Marina Vigário 2015 “Intonational Variation in Portuguese: European and Brazilian Varieties.” In Intonation in Romance, ed. by Sonia Frota, and Pilar Prieto, 235–283. Oxford: Oxford University Press. Google Scholar logo with link to Google ScholarFrota, Sonia, Marisa Cruz, Flaviane Svartman, Gisela Collischonn, Aline Fonseca, Carolina Serra, Pedro Oliveira, and Marina Vigário 2015 “Intonational Variation in Portuguese: European and Brazilian Varieties.” In Intonation in Romance, ed. by Sonia Frota, and Pilar Prieto, 235–283. Oxford: Oxford University Press. Google Scholar logo with link to Google Scholar.
12.According to Vargas, Cielo, and Trevisan (2010Vargas Ferreira, Fernanda Carla Aparecida Cielo, and Maria Elaine Trevisan 2010 “Medidas vocais acústicas na doença de Parkinson: estudo de casos.” Revista CEFAC 12 (5): 889–898.Google Scholar logo with link to Google ScholarVargas Ferreira, Fernanda Carla Aparecida Cielo, and Maria Elaine Trevisan 2010 “Medidas vocais acústicas na doença de Parkinson: estudo de casos.” Revista CEFAC 12 (5): 889–898.Google Scholar logo with link to Google Scholar, 891), as well as Russo and Behlau (1993)Russo, Iêda, and Mara Behlau 1993Percepção da fala: Análise acústica do português brasileiro. São Paulo: Lovise.Google Scholar logo with link to Google ScholarRusso, Iêda, and Mara Behlau 1993Percepção da fala: Análise acústica do português brasileiro. São Paulo: Lovise.Google Scholar logo with link to Google Scholar, the default value for adult female speakers of Brazilian Portuguese with regard to pitch jumps upward varies between 150 and 250 Hz, and the intensity between 15 and 45 dB.
13.The sequence can be accessed at: https://​youtu​.be​/D18aF9j​_hDo
15.There is a certain degree of difficulty regarding the hearing and understanding, frequently they [the patients] visualize through our mouth, our face. The mask makes this difficult. So we have to talk a little bit louder than normally [...] I use my hands a lot it’s also the look…
16.The sequence can be accessed at: https://​youtu​.be​/EhS0qTH3UbY
17.We gave only one example here but this observation is valid for the entire analysis, see Gonçalves (2022)Gonçalves, Sineide 2022Máscaras faciais e distanciamento social: uma análise intercorporeal da fala-em-interação em tempos de COVID-19. PhD dissertation, Federal University of Minas Gerais. https://​repositorio​.ufmg​.br​/handle​/1843​/46706Gonçalves, Sineide 2022Máscaras faciais e distanciamento social: uma análise intercorporeal da fala-em-interação em tempos de COVID-19. PhD dissertation, Federal University of Minas Gerais. https://​repositorio​.ufmg​.br​/handle​/1843​/46706.
18.Short, adopted version of GAT 2 according to Selting et al. (2011)Selting, Margret, Peter Auer, Dagmar Barth-Weingarten, et al. 2011 “A System for Transcribing Talk-in-Interaction: GAT 2; Translated and Adapted for English by Elizabeth Couper-Kuhlen and Dagmar Barth-Weingarten.” Gesprächsforschung – Online-Zeitschrift zur verbalen Interaktion 12: 1–51. https://​kops​.uni​-konstanz​.de​/handle​/123456789​/38351Selting, Margret, Peter Auer, Dagmar Barth-Weingarten, et al. 2011 “A System for Transcribing Talk-in-Interaction: GAT 2; Translated and Adapted for English by Elizabeth Couper-Kuhlen and Dagmar Barth-Weingarten.” Gesprächsforschung – Online-Zeitschrift zur verbalen Interaktion 121: 1–51. https://​kops​.uni​-konstanz​.de​/handle​/123456789​/38351.

References

Auer, Peter
1996 “On the Prosody and Syntax of Turn-Continuations.” In Prosody in Conversation. Interactional Studies, ed. by Elizabeth Couper-Kuhlen, and Margret Selting, 57–100. Cambridge, New York: Cambridge University Press. Google Scholar logo with link to Google Scholar
Bühler, Karl
1982 [1934]Sprachtheorie: Die Darstellungsfunktion der Sprache. Stuttgart: Fischer.Google Scholar logo with link to Google Scholar
Büscher, Monika
2005 “Social Life under the Microscope?Sociological Research Online 10 (1): 100–123. Google Scholar logo with link to Google Scholar
Calbi, Marta, Nunzio Langiulli, Francesca Ferroni, Martina Montalti, Anna Kolesnikov, Vittorio Gallese, and Maria Alessandra Umiltà
2021 “The Consequences of COVID-19 on Social Interactions: An Online Study on Face Covering.” Scientific Reports 11 (1): 1–10. Google Scholar logo with link to Google Scholar
Couper-Kuhlen, Eizabeth, and Margret Selting
(eds.) 1996Prosody in Conversation: Interactional Studies. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Couper-Kuhlen, Elizabeth, and Margret Selting
2018Interactional Linguistics: Studying Language in Social Interaction. Cambridge: Cambridge University Press.Google Scholar logo with link to Google Scholar
Cuffari, Elena, and Jürgen Streeck
2017 “Taking the World by Hand: How (Some) Gestures Mean.” In Incorporeality. Emerging Socialities in Interaction, ed. by Christian Meyer, Jürgen Streeck, and Jordan Scott, 173–201. New York: Oxford University Press.Google Scholar logo with link to Google Scholar
Deppermann, Arnulf
2013 “Multimodal Interaction from a Conversation Analytic Perspective.” Journal of Pragmatics 46 (1): 1–7. Google Scholar logo with link to Google Scholar
Deppermann, Arnulf, Lorenza Mondada, and Simona Pekarek Doehler
2021 “Early Responses: An Introduction.” Discourse Processes 58 (4): 293–307. Google Scholar logo with link to Google Scholar
Due, Brian L., and Christian Licoppe
2020 “Video-Mediated Interaction (VMI): Introduction to a Special Issue on the Multimodal Accomplishment of VMI Institutional Activities.” Social Interaction. Video-Based Studies of Human Sociality 3 (3). Google Scholar logo with link to Google Scholar
Ekberg, Katie, Stuart Ekberg, Lara Weinglass, and Susan Danby
2021 “Pandemic Morality-in-Action: Accounting for Social Action during the COVID-19 Pandemic.” Discourse and Society 32 (6): 666–688. Google Scholar logo with link to Google Scholar
Enfield, Nick J., and Jack Sidnell
2017 “On the Concept of Action in the Study of Interaction.” Discourse Studies 19 (5): 515–535. Google Scholar logo with link to Google Scholar
Ford, Cecilia E., and Sandra A. Thompson
2010 “Interactional Units in Conversation: Syntactic, Intonational, and Pragmatic Resources for the Management of Turns.” In Interaction and Grammar, ed. by Elinor Ochs, Emanuel Schegloff, and Sandra Thompson, 134–184. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Fox, Barbara
2015 “On the Notion of Pre-request.” Discourse Studies 17 (1): 41–63. Google Scholar logo with link to Google Scholar
Frota, Sonia, Marisa Cruz, Flaviane Svartman, Gisela Collischonn, Aline Fonseca, Carolina Serra, Pedro Oliveira, and Marina Vigário
2015 “Intonational Variation in Portuguese: European and Brazilian Varieties.” In Intonation in Romance, ed. by Sonia Frota, and Pilar Prieto, 235–283. Oxford: Oxford University Press. Google Scholar logo with link to Google Scholar
Giovanelli, Elena, Chiara Valzolgher, Elena Gessa, Michela Todeschini, and Francesco Pavani
2021 “Unmasking the Difficulty of Listening to Talkers with Masks: Lessons from the COVID-19 Pandemic.” i-Perception 12 (2): 1–11. Google Scholar logo with link to Google Scholar
Gonçalves, Sineide
2022Máscaras faciais e distanciamento social: uma análise intercorporeal da fala-em-interação em tempos de COVID-19. PhD dissertation, Federal University of Minas Gerais. https://​repositorio​.ufmg​.br​/handle​/1843​/46706
Goodwin, Charles
2000 “Action and Embodiment within Situated Human Interaction.” Journal of Pragmatics 32: 1489–1522. Google Scholar logo with link to Google Scholar
2003 “Pointing as Situated Practice.” In Pointing: Where Language, Culture, and Cognition Meet, ed. by Sotaro Kita, 225–250. Mahwah, NJ: Lawrence Erlbaum. Google Scholar logo with link to Google Scholar
2007 “Participation, Stance and Affect in the Organization of Activities.” Discourse and Society 18 (1): 53–73. Google Scholar logo with link to Google Scholar
Hakulinen, Auli, and Margret Selting
2005Syntax and Lexis in Conversation: Studies on the Use of Linguistic Resources in Talk-in-Interaction. Amsterdam, Philadelphia: John Benjamins. https://​benjamins​.com​/catalog​/sidag​.17.
Heritage, John
1998 “Oh-Prefaced Responses to Inquiry.” Language in Society 27 (3): 291–334. Google Scholar logo with link to Google Scholar
Katila, Julia, Yumei Gan, and Marjorie H. Goodwin
2020 “Interaction Rituals and ‘Social Distancing’: New Haptic Trajectories and Touching from a Distance in the Time of COVID-19”. Discourse Studies 22 (4): 418–440. Google Scholar logo with link to Google Scholar
Kendon, Adam
2004Gesture: Visible Action as Utterance. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Laplante, Debi, and Nalini Ambady
2003 “On How Things Are Said: Voice Tone, Voice Intensity, Verbal Content, and Perceptions of Politeness.” Journal of Language and Social Psychology 22 (4): 434–441. Google Scholar logo with link to Google Scholar
McNeill, David
1992Hand and Mind: What Gestures Reveal about Thought. Chicago: University of Chicago Press.Google Scholar logo with link to Google Scholar
2005Gesture and Thought. Chicago: University of Chicago Press. Google Scholar logo with link to Google Scholar
Meyer, Christian, Jürgen Streeck, and Jordan Scott
(eds.) 2017Intercorporeality: Emerging Socialities in Interaction. New York: Oxford University Press. Google Scholar logo with link to Google Scholar
Mheidly, Nour, Mohamad Y. Fares, Hussein Zalzale, and Jawad Fares
2020 “Effect of Face Masks on Interpersonal Communication during the COVID-19 Pandemic.” Frontiers in Public Health 1–6. Google Scholar logo with link to Google Scholar
Mondada, Lorenza
2012 “The Conversation Analytic Approach to Data Collection.” In The Handbook of Conversation Analysis, ed. by Jack Sidnell, and Tanya Stivers, 32–56. Oxford, UK: Wiley-Blackwell. Google Scholar logo with link to Google Scholar
2013 “Conversation Analysis: Talk and Bodily Resources for the Organization of Social Interaction.” In Body – Language – Communication. An International Handbook on Multimodality in Human Interaction, ed. by Cornelia Müller, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill, and Silvana Teßendorf, 218–227. Berlin, Boston: De Gruyter Mouton. Google Scholar logo with link to Google Scholar
2019 “Contemporary Issues in Conversation Analysis: Embodiment and Materiality, Multimodality and Multisensoriality in Social Interaction.” Journal of Pragmatics 145: 47–62. Google Scholar logo with link to Google Scholar
Mondada, Lorenza, Julia Bänninger, Sofian A. Bouaouina, Guillaume Gauthier, Philipp Hänggi, Mizuki Koda, Hanna Svensson, and Burak S. Tekin
2020a “Doing Paying during the Covid-19 Pandemic.” Discourse Studies 22 (6): 720–752. Google Scholar logo with link to Google Scholar
Mondada, Lorenza, Julia Bänninger, Sofian A. Bouaouina, Laurent Camus, Guillaume Gauthier, Philipp Hänggi, Mizuki Koda, Hanna Svensson, and Burak S. Tekin
2020b “Human Sociality in the Times of the Covid-19 Pandemic: A Systematic Examination of Change in Greetings.” Journal of Sociolinguistics 24 (4): 441–468. Google Scholar logo with link to Google Scholar
Müller, Cornelia, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill, and Silvana Teßendorf
(eds) 2013Body – Language – Communication: An International Handbook on Multimodality in Human Interaction. Volume 1. Berlin, Boston: De Gruyter Mouton. Google Scholar logo with link to Google Scholar
Nevile, Maurice
2015 “The Embodied Turn in Research on Language and Social Interaction.” Research on Language and Social Interaction 48 (2): 121–151. Google Scholar logo with link to Google Scholar
Ofuka, Etsuko, J. Denis McKeown, Mitch G. Waterman, and Peter J. Roach
2000 “Prosodic Cues for Rated Politeness in Japanese Speech.” Speech Communication 32 (3): 199–217. Google Scholar logo with link to Google Scholar
Ohara, Yumiko
2001 “Finding One’s Voice in Japanese: A Study of the Pitch Levels of L2 Users.” In Multilingualism, Second Language Learning, and Gender, ed. by Aneta Pavlenko, Adrian Blackledge, Ingrid Piller, and Marya Teutsch-Dwyer, 231–256. Berlin, Boston: De Gruyter Mouton. Google Scholar logo with link to Google Scholar
Russo, Iêda, and Mara Behlau
1993Percepção da fala: Análise acústica do português brasileiro. São Paulo: Lovise.Google Scholar logo with link to Google Scholar
Schröder, Ulrike
2017 “Multimodal Metaphors as Cognitive Pivots for the Construction of Cultural Otherness in Talk.” Intercultural Pragmatics 14 (4): 493–524. Google Scholar logo with link to Google Scholar
2020 “Talking about Intercultural Experiences.” International Journal of Language and Culture 7 (1): 15–37. Google Scholar logo with link to Google Scholar
Schröder, Ulrike, and Jürgen Streeck
2022 “Cultural Concept, Movement, and Way of Life: Jeitinho in Words and Gestures.” Intercultural Pragmatics 19 (4): 427–457. Google Scholar logo with link to Google Scholar
Schröder, Ulrike, and Mariana Carneiro Mendes
2019 “Unterschiede im Gebrauch und in der Funktion prosodischer Merkmale im deutschen und brasilianischen Sprechen im Kontext des Transkribierens.” In Sprachgebrauch im Kontext. Die deutsche Sprache im Kontakt, Vergleich und in Interaktion mit Lateinamerika/Brasilien, ed. by Thomas Johnen, Mônica Savedra, and Ulrike Schröder, 145–172. Stuttgart: ibidem. Google Scholar logo with link to Google Scholar
Schröder, Ulrike, Anna Ladilova, Sineide Gonçalves, and Fernanda Roque Amendoreira
submitted. “Perspectivas multimodais sobre a comunicação com máscaras faciais em tempos de COVID-19.”
Schmidt, Thomas, and Kai Wörner
2009 “EXMARaLDA–Creating, Analysing and Sharing Spoken Language Corpora for Pragmatic Research. Pragmatics 19 (4): 565–582. Google Scholar logo with link to Google Scholar
Selting, Margret
2007 “Lists as Embedded Structures and the Prosody of List Construction as an Interactional Resource.” Journal of Pragmatics 39 (3): 483–526. Google Scholar logo with link to Google Scholar
Selting, Margret, and Elizabeth Couper-Kuhlen
2001Studies in Interactional Linguistics. Amsterdam, Philadelphia: John Benjamins. Google Scholar logo with link to Google Scholar
Selting, Margret, Peter Auer, Dagmar Barth-Weingarten, et al.
2011 “A System for Transcribing Talk-in-Interaction: GAT 2; Translated and Adapted for English by Elizabeth Couper-Kuhlen and Dagmar Barth-Weingarten.” Gesprächsforschung – Online-Zeitschrift zur verbalen Interaktion 12: 1–51. https://​kops​.uni​-konstanz​.de​/handle​/123456789​/38351
Sidnell, Jack
2010Conversation Analysis: An Introduction. Malden, Oxford, West Sussex: Wiley-Blackwell.Google Scholar logo with link to Google Scholar
Streeck, Jürgen
2017Self-Making Man: A Day of Action, Life, and Language. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
2019 “Gesture Research.” In Handbook of Pragmatics, ed. by Jan-Ola Östman, and Jef Verschueren, p. 3–30. Amsterdam, Philadelphia: John Benjamins.Google Scholar logo with link to Google Scholar
Ungeheuer, Gerold
2004 “Kommunikative und extrakommunikative Betrachtungsweisen in der Phonetik.” In Sprache und Kommunikation, ed. by Karin Kolb, and H. Walter Schmitz, 22–34. Münster: Nodus Publikationen.Google Scholar logo with link to Google Scholar
Vargas Ferreira, Fernanda Carla Aparecida Cielo, and Maria Elaine Trevisan
2010 “Medidas vocais acústicas na doença de Parkinson: estudo de casos.” Revista CEFAC 12 (5): 889–898.Google Scholar logo with link to Google Scholar

AppendixTranscription convetions GAT 21818.Short, adopted version of GAT 2 according to Selting et al. (2011)Selting, Margret, Peter Auer, Dagmar Barth-Weingarten, et al. 2011 “A System for Transcribing Talk-in-Interaction: GAT 2; Translated and Adapted for English by Elizabeth Couper-Kuhlen and Dagmar Barth-Weingarten.” Gesprächsforschung – Online-Zeitschrift zur verbalen Interaktion 12: 1–51. https://​kops​.uni​-konstanz​.de​/handle​/123456789​/38351Selting, Margret, Peter Auer, Dagmar Barth-Weingarten, et al. 2011 “A System for Transcribing Talk-in-Interaction: GAT 2; Translated and Adapted for English by Elizabeth Couper-Kuhlen and Dagmar Barth-Weingarten.” Gesprächsforschung – Online-Zeitschrift zur verbalen Interaktion 121: 1–51. https://​kops​.uni​-konstanz​.de​/handle​/123456789​/38351.

[ ] overlap and simultaneous talk
= fast, immediate continuation with a new turn or segment (latching)
and_uh cliticizations within units
hm_hm bi-syllabic tokens
(.) micro pause, up to 0.2 sec.
(-) short pause of 0.2–0.5 sec.
(--) intermediary pause of 0.5–0.8 sec.
(2.0) measured pause of 2.0 sec.
:, ::, ::: lengthening (0.2–0.5 sec.; 0.5–0.8 sec.; 0.8–1.0 sec.)
((laughs)) non-verbal vocal actions and events
<<laughing> > para-verbal and non-verbal action as accompanying speech with indication of scope
<<acc> accelerando
(may i) assumed wording
(i say/let’s say) possible alternatives
ºhh hhº in- and outbreaths
(xxx) one unintelligible syllable
acCENT focus accent
accEnt secondary accent
ac!CENT! extra strong accent
? rising to high final pitch movement of intonation unit
, rising to mid final pitch movement of intonation unit
level final pitch movement of intonation unit
; falling to mid final pitch movement of intonation unit falling to low final pitch movement of intonation unit
ˆSO rising-falling accent pitch movement
ˇSO falling-rising accent pitch movement
´SO rising accent pitch movement
`SO falling accent pitch movement
pitch upstep
pitch downstep

Address for correspondence

Ulrike Schröder

Faculty of Humanities

Federal University of Minas Gerais

Av. Antônio Carlos, 6627

31270–901 Belo Horizonte

MG – Brasil

[email protected]

Biographical notes

Prof. Dr. Ulrike Schröder obtained her Venia Legendi in communication studies at the University of Duisburg-Essen, Germany, in 2012 and her doctorate’s degree in 2003, at the same institution. She has been working as a Full Professor for German Studies and Linguistics at the Federal University of Minas Gerais since 2006. Her reasearch areas comprise conversation analysis, interactional linguistics, intercultural pragmatics, gesture studies and cognitive linguistics.

Prof. Dr. Sineide Gonçalves obtained her doctoral degree in 2022 from the Federal University of Minas Gerais – UFMG. She has been serving as a Visiting Professor of Portuguese Language and Literature at the Federal Institute of Minas Gerais since 2022. Her research areas encompass interactional linguistics, conversation analysis, gesture studies, and prosody.

 
Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue