Article In: Functions of Language: Online-First Articles
Establishment and application of gesture-pragmatic corpus of chinese kindergarten teachers (G-PCCKT)
This content is being prepared for publication; it may be subject to changes.
Abstract
This study develops the Gesture-Pragmatic Corpus of Chinese Kindergarten Teachers (G-PCCKT) using ELAN to
investigate teachers’ gesture-pragmatic functions. The corpus construction involves transcribing speech, annotating
multifunctional gestures through a custom Functional Annotation Scheme based on an Integrated Functional
Categorization of Gesture, and coding three pragmatic aspects: demonstratives, illocutionary forces, and
question-initiated sequences. As a reliable tool for data retrieval and analysis, the G-PCCKT enables multifaceted investigation
into the pragmatic functions of gestures used by Chinese kindergarten teachers, including: (i) clarifying deictic references, (ii)
reinforcing illocutionary force, and (iii) facilitating question formulation and sequence organization. Preliminary results
indicate that: (i) teachers’ gesture use varies with different types of demonstratives to aid children’s comprehension; (ii)
gestures previously regarded as “meaningless” reveal performative significance when examined in pragmatic context; and (iii)
gestures support teachers in managing classroom pacing by smoothly transitioning between question-initiated sequences.
Article outline
- 1.Introduction
- 1.1Defining pragmatics: Linguistic and gestural perspectives
- 1.1.1Linguistic definition of pragmatics
- 1.1.2Gestural definition of pragmatics
- 1.2Studies of teachers’ gestures from pragmatic perspectives
- 1.3Gesture-pragmatic corpus: A new method to explore gesture function
- 1.1Defining pragmatics: Linguistic and gestural perspectives
- 2.Gesture-pragmatic corpus of Chinese kindergarten teachers (G-PCCKT)
- 2.1The G-PCCKT dataset
- 2.2ELAN and annotation scheme
- 3.An integrated functional categorization of gesture and gesture annotation scheme
- 3.1Referential gestures
- 3.2Pragmatic gestures
- 3.3Speech transcription and gesture annotation scheme
- 3.3.1Speech transcription
- 3.3.2Gesture annotation scheme
- 4.Preliminary applications, results and findings
- 4.1Gestures clarifying deictic demonstratives
- 4.2Gestures reinforcing illocutionary forces
- 4.3Gestures facilitating the organization of question-initiated sequences
- 4.3.1Gestures assisting question posing
- 4.3.2Gestures facilitating sequence organization
- 5.Discussion and conclusion
- Acknowledgements
- Note
References
References (79)
Alduais, Ahmed, Issa Al-Qaderi, Najla Alfadda & Hind Alfadda. 2022. Pragmatics:
Mapping evidence on enhancing children’s use of linguistic and non-linguistic capacities for interactive
communication. Children 9(9). 1318.
Al Okla, Nour. 2018. Verbal
and non-verbal refusal strategies in English: Refusing promotions. Arab World English
Journal 9(1). 321–334.
Archer, Dawn, Karin Aijmer & Anne Wichmann. 2012. Pragmatics:
An Advanced Resource Book for
Students. London: Routledge.
Barros, Camila & Saulo Santos. 2022. A
protocol for comparing gesture and prosodic boundaries in multimodal
corpora. In Vládia Pinheiro, Pablo Gamallo, Raquel Amaro, Carolina Scarton, Fernando Batista, Diego Silva, Catarina Magro & Hugo Pinto (eds.), Computational
processing of the portuguese
language, 313–322. Cham: Springer.
Bateman, Amanda. 2015. Conversation
Analysis and early childhood education: The co-production of knowledge and
relationships. Farnham: Ashgate.
Bavelas, Janet Beavin. 1990. Nonverbal and social
aspects of discourse in face-to-face interaction. Text &
Talk 10(1). 5–8.
. 1994. Gestures as part of speech:
Methodological implications. Research on Language and Social
Interaction 27(3). 201–221.
Bavelas, Janet Beavin, Nicole Chovil, Linda Coates & Lori Roe. 1995. Gestures
specialized for dialogue. Personality and Social Psychology
Bulletin 21(4). 394–405.
Bavelas, Janet Beavin, Nicole Chovil, Douglas A. Lawrie & Allan Wade. 1992. Interactive
gestures. Discourse
Processes 15(4). 469–489.
Bavelas, Janet Beavin & Nicole Chovil. 2000. Visible
acts of meaning: An integrated message modal of language in face-to-face dialogue. Journal of
Language and Social
Psychology 19(2). 163–194.
Bezemer, Jeff. 2014. Multimodal
transcription: A case study. In Sigrid Norris & Carmen Daniela Maier (eds.), Interactions,
images and
texts, 155–169. Berlin: Mouton.
Bressem, Jana & Cornelia Müller. 2014. The
family of Away gestures: Negation, refusal, and negative
assessment. In Cornelia Müller, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill & Jana Bressem (eds.), 1592–1604.
Bühler, Karl. 2011. Theory
of language: The representational function of
language. Amsterdam: John Benjamins.
Calbris, Geneviève. 2011. Elements
of meaning in gesture. Amsterdam: John Benjamins.
Campisi, Emanuela & Asli Özyürek. 2013. Iconicity
as a communicative strategy: Recipient design in multimodal demonstrations for adults and
children. Journal of
Pragmatics 47(1). 14–27.
Chen, Yaoyao & Svenja Adolphs. (2022). Towards
a corpus-based description of speech-gesture units of meaning: The case of the circular
gesture. International Journal of Corpus
Linguistics 2(28). 172–201.
Chui, Kawai. 2014. Mimicked
gestures and the joint construction of meaning in conversation. Journal of
Pragmatics 701. 68–85.
Cienki, Alan. 2016. Gesture
in pragmatics. In Alessandro Capone & Jacob L. Mey (eds.), Interdisciplinary
studies in pragmatics, culture and
society, 139–166. London: Routledge.
Clark, Herbert H. & Meredyth A. Krych. 2004. Speaking
while monitoring addressees for understanding. Journal of Memory and
Language 50(1). 62–81.
Cooperrider, Kensy Andrew. 2011. Reference in action: Links
Between pointing and language. San Diego, CA: University of California PhD Thesis.
Dalgren, Sara. 2017. Questions
and answers, a seesaw and embodied action: How a preschool teacher and children accomplish educational
practice. In Amanda Bateman & Amelia Church (eds.), Children’s
knowledge-in-interaction: Studies in Conversation
Analysis, 37–56. Singapore: Springer.
Dargue, Nicole & Naomi Sweller. 2018. Donald
Duck’s garden: The effects of observing iconic reinforcing and contradictory gestures on narrative
comprehension. Journal of Experimental Child
Psychology 1751. 96–107.
Deshmukh, Richa S., Tricia A. Zucker, Sherine R. Tambyraja, Jill M. Pentimonti, Ryan P. Bowles & Laura M. Justice. 2019. Teachers’
use of questions during shared book reading: Relations to child responses. Early Childhood
Research Quarterly 491. 59–68.
Diessel, Holger. 2006. Demonstratives,
joint attention, and the emergence of grammar. Cognitive
Linguistics 17(4). 463–489.
Duran, Derya, Salla Kurhila & Olcay Sert. 2019. Word search sequences in teacher-student interaction in an English as medium of instruction context. International Journal of Bilingual Education and Bilingualism 25(2). 502–521.
Ekman, Paul. & Wallace V. Friesen. 1969. The
repertoire of nonverbal behavior: Categories, origins, usage, and
coding. Semiotica 1(1). 49–98.
Enfield, N. J., Sotaro Kita & J. P. de Ruiter. 2007. Primary
and secondary pragmatic functions of pointing gestures. Journal of
Pragmatics 39(10). 1722–1741.
Evaldsson, Ann-Carita & Helen Melander. 2017. Managing
disruptive student conduct: Negative emotions and accountability in reproach-response
sequences. Linguistics and
Education 371. 73–86.
Fang, Yuqing. 2008. A
practical Chinese grammar. Beijing: Beijing Language and Culture University Press.
Filipi, A. 2019. Interactional
practices in language teaching and learning: Understandings and applications gained through conversation
analysis. In Yenni Rozimela, Havid Ardi & Affandi Arianto (eds.), Proceedings
of the Seventh International Conference on Languages and Arts (ICLA
2018), 479–484. Dordrecht: Atlantis Press.
Flood, Virginia J. 2021. The secret multimodal life of
IREs: Looking more closely at representational gestures in a familiar questioning
sequence. Linguistics and
Education 631. 100913.
Grice, H. Paul. 1975. Logic and
conversation. In Peter Cole & Jerry Morgan (eds.), Syntax
and semantics. Vol. 3, 41–58. New York, NY: Academic Press.
Gullberg, Marianne. 1998. Gesture
as a communication strategy in second language discourse: A study of learners of French and
Swedish. Lund: LUP.
2009. Referential practice: Language and
lived space among the Maya. Chicago, IL: University of Chicago Press.
Haviland, John B. 2000. Pointing, gesture spaces, and
mental maps. In David McNeill (ed.), Language
and
gesture, 13–46. Cambridge: CUP.
Jefferson, Gail. 2004. Glossary
of transcript symbols with an introduction. In Gene H. Lerner (ed.). Conversation
Analysis studies from the first
generation, 13–31. Amsterdam: John Benjamins.
Kendon, Adam. 1995. Gestures
as illocutionary and discourse structure markers in Southern Italian conversation. Journal of
Pragmatics 23(3). 247–279.
. 2017. Pragmatic
functions of
gestures. Gesture 16(2). 157–175.
Kendon, Adam & Laura Versante. 2003. Pointing
by hand in ‘Neapolitan’. In Sotaro Kita (ed.), Pointing:
Where language, culture, and cognition
meet, 109–137. Mahwah, NJ: Erlbaum.
Kipp, Michael, Michael Neff & Irene Albrecht. 2007. An
annotation scheme for conversational gestures: How to economically capture timing and
form. Lang Resources &
Evaluation 411. 325–339.
Kok, Kasper I. 2017. Functional and temporal
relations between spoken and gestured components of language. International Journal of Corpus
Linguistics 22(1). 1–26.
Lauzon, Virginie Fasel & Evelyne Berger. 2015. The
multimodal organization of speaker selection in classroom interaction. Linguistics and
Education 311. 14–29.
Legg, Catherine. 2020. A
properly pragmatist pragmatics: Peircean reflections on the distinction between semantics and
pragmatics. Pragmatics &
Cognition 27(2). 387–407.
Li, Xiaoting. (2014). Leaning
and recipient intervening questions in Mandarin conversation. Journal of
Pragmatics 671. 34–60.
Lopez-Ozieblo, Renia. 2018. Disagreeing
without a ‘no’: How teachers indicate disagreement in a Hong Kong classroom. Journal of
Pragmatics 1371. 1–18.
Lücking, Andy, Kristen Bergman, Florian Hahn, Stefan Kopp & Hannes Rieser. 2012. Data-based
analysis of speech and gesture: The Bielefeld Speech and Gesture Alignment corpus (SaGA) and its
applications. Journal of Multimodal User
Interfaces 71. 5–18.
Luke, Kang-Kwong. 2019. Chinese
conversation analysis: New method, new data, new insights. In Chris Shei (ed.), The
Routledge handbook of Chinese Discourse
Analysis, 21–35. London: Routledge.
Lwin, Soe Marlar. 2016. It’s story time!: Exploring
the potential of multimodality in oral storytelling to support children’s vocabulary
learning. Literacy 50(2). 72–82.
Macoun, Alice. & Naomi Sweller. 2016. Listening
and watching: The effects of observing gesture on preschoolers’ narrative
comprehension. Cognitive
Development 401. 68–81.
Muramoto, Naoko. 1999. Gesture in Japanese language instruction: The case of error correction. In L. Kathy Heilenman (ed.), Research Issues and Language Program Direction, 143–175. Boston, MA: Heinle & Heinle Publishers.
McNeill, David. 1992. Hand
and mind: What gestures reveal about thought. Chicago, IL: University of Chicago Press.
Mondada, Lorenza. 2018. Multiple
temporalities of language and body in interaction: Challenges for transcribing
multimodality. Research on Language and Social
Interaction 51(1). 85–106.
Müller, Cornelia. 2004. The
Palm-Up-Open-Hand: A case of a gesture family? In Cornelia Müller & Roland Posner (eds.), The
semantics and pragmatics of everyday
gestures, 233–256. Berlin: Weidler.
. 2017. How
gestures achieve cohesion in discourse. In R. Breckinridge Church, Martha W. Alibali & Spencer D. Kelly (eds.), Why
gesture? How the hands function in speaking, thinking and
communicating, 267–284. Amsterdam: John Benjamins.
O’Keeffe, Anne, Brian Clancy & Svenja Adolphs. 2011. Introducing
pragmatics in
use. London: Routledge.
Peng, Xin & Wei Zhang. 2019. Talk
and gesture in storytelling sequences in Mandarin conversation. Chinese Language and
Discourse 10(2). 133–157.
Ristimäki, Hanna-Leena, Sanni Tiitinen, Pirjo Juvonen-Posti & Johanna Ruusuvuori. 2020. Collaborative
decision-making in return-to-work negotiations. Journal of
Pragmatics 1701. 189–205.
Rühlemann, Christoph. 2019. Corpus
linguistics for pragmatics: A guide for
research. London: Routledge.
Schönfelder, Nora. 2024. Multimodal
repetitions in children’s co-construction of arguments. European Journal of Psychology of
Education 39(3). 1759–1781.
Streeck, Jürgen. 2008. Depicting
by
gesture. Gesture 8(3). 285–301.
. 2009. Gesturecraft:
The manu-facture of meaning. Amsterdam: John Benjamins.
Tabensky, Alexis. 2014. Gestures,
postures, gaze, and other body movements in the 2nd language classroom
interaction. In Cornelia Müller, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill & Jana Bressem (eds.), 1426–1432.
Tai, Kevin W. H. & Nahal Khabbazbashi. 2019. The
mediation and organization of gestures in vocabulary instructions: A microgenetic analysis of interactions in a
beginning-level adult ESOL classroom. Language and
Education 33(5). 445–468.
Valenzeno, Laura, Martha W. Alibali & Roberta Klatzky. 2003. Teachers’
gestures facilitate students’ learning: A lesson in symmetry. Contemporary Educational
Psychology 28(2). 187–204.
Verschueren, Jef. 2022. The
pragmatic perspective. In Jef Verschueren & Jan-Ola Östman (eds.), Handbook
of Pragmatics: Manual. 2nd
edn., 1–26. Amsterdam: John Benjamins.
Wu, Jianfeng. 2015. Research
on the relationship between speech acts and Chinese sentence
types. Shanghai: Shanghai Jiao Tong University Press.
Zellers, Margret, David House & Simon Alexanderson. 2016. Prosody
and hand gesture at turn boundaries in Swedish. In Jon Barnes, Alejna Brugos, Stefanie Shattuck-Hufnagel and Nanette Veilleux (eds.), Proceedings
of Speech
Prosody 20161, 831–835. Boston, MA: International Speech Communication Association.