Cover not available

Article In: Gesture: Online-First Articles

Phonological working memory but not beat gestures affect L2 word stress perception

ORCiD logo with link | Radboud University
ORCiD logo with link | Radboud University
ORCiD logo with link | Radboud University
This content is being prepared for publication; it may be subject to changes.
Abstract
Acquiring second language (L2) prosody, specifically stress, is challenging for learners. While beat gestures reinforce prosodic cues in a native language (L1), their role in L2 stress perception and its interaction with cognitive individual differences is underexplored. This study investigates if beat gestures facilitate L2 stress perception and how this relates to learners’ visuospatial, phonological, and executive working memory (WM). Twenty-four native Dutch speakers completed an L2 Stress Perception Task. Mixed-effects modeling revealed that participants with better phonological WM showed higher stress identification accuracy, corroborating its importance in L2 acquisition. However, no benefit of beat gestures was found for either stress identification accuracy or reaction times. Executive and visuospatial WM showed no main effects, nor did any of the WM components interact with the gesture condition. Our findings highlight the importance of incorporating cognitive individual difference measures, as they may have a greater impact than the gesture effect itself.
Article outline
  • Introduction
    • Word stress
    • Beat gestures
    • Working memory
      • The Phonological/Executive model
      • Working memory in multimodal and L2 stress processing
    • The present study
  • Methods
    • Participants
    • Materials
      • L2 Stress perception task
        • Task design
        • Stimulus words
        • Stimulus videos
      • Working memory tests
    • Procedure
    • Statistical analysis
      • Data preprocessing
      • Mixed-effects modeling
        • Accuracy
        • Reaction times
  • Results
    • Descriptives
    • Mixed-effects models
      • Accuracy
      • Reaction times
  • Discussion
    • Beat gestures did not enhance L2 Spanish stress perception
    • No interaction between gesture condition and working memory
    • Stress perception benefited from PWM
    • Limitations
  • Conclusion
  • Acknowledgements
  • Notes
  • References
References (64)
References
Altmann, H. (2006). The perception and production of second language stress: A cross-linguistic experimental study [Ph.D. Dissertation, University of Delaware]. Retrieved January 24, 2024, from [URL]
Arvaniti, A. (2020). The phonetics of prosody. In A. Arvaniti (Ed.), Oxford research encyclopedia of linguistics. Oxford University Press. Google Scholar logo with link to Google Scholar
Baddeley, A. D., & Hitch, G. (1974). Working memory. In G. H. Bower (Ed.), Psychology of learning and motivation (pp. 47–89, Vol. 8). Academic Press. Google Scholar logo with link to Google Scholar
Baills, F., & Prieto, P. (2021). Embodying rhythmic properties of a foreign language through hand-clapping helps children to better pronounce words. Language Teaching Research, 136216882098671. Google Scholar logo with link to Google Scholar
Baills, F., Zhang, Y., & Prieto, P. (2018). Hand-clapping to the rhythm of newly learned words improves L2 pronunciation: Evidence from Catalan and Chinese learners of French. Speech Prosody 2018, 498–502. Google Scholar logo with link to Google Scholar
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48. Google Scholar logo with link to Google Scholar
Bosker, H. R., & Peeters, D. (2021). Beat gestures influence which speech sounds you hear. Proceedings of the Royal Society B, 288(1943), 20202419. Google Scholar logo with link to Google Scholar
Bujok, R., Maran, M., Meyer, A. S., & Bosker, H. R. (2025). Beat gestures facilitate lexical access in constraining sentence contexts. Journal of Experimental Psychology: Learning, Memory, and Cognition. Google Scholar logo with link to Google Scholar
Bujok, R., Meyer, A. S., & Bosker, H. R. (2024). Audiovisual perception of lexical stress: Beat gestures and articulatory cues. Language and Speech, 68(1), 181–203. Google Scholar logo with link to Google Scholar
Darcy, I., Park, H., & Yang, C.-L. (2015). Individual differences in L2 acquisition of English phonology: The relation between cognitive abilities and phonological processing. Learning and Individual Differences, 40, 63–72. Google Scholar logo with link to Google Scholar
de Bree, E. H. (2007). Dyslexia and phonology: A study of the phonological abilities of Dutch children at-risk of dyslexia. LOT, 155. [URL]
Dörnyei, Z., & Skehan, P. (2008). Individual differences in second language learning. In C. J. Doughty & M. H. Long (Eds.), The handbook of second language acquisition (pp. 589–630). Wiley. Google Scholar logo with link to Google Scholar
Gluhareva, D., & Prieto, P. (2017). Training with rhythmic beat gestures benefits L2 pronunciation in discourse-demanding situations. Language Teaching Research, 21(5), 609–631. Google Scholar logo with link to Google Scholar
Hoetjes, M., & van Maastricht, L. (2020). Using gesture to facilitate L2 phoneme acquisition: The importance of gesture and phoneme complexity. Frontiers in Psychology, 11, 575032. Google Scholar logo with link to Google Scholar
Honbolygó, F., Kóbor, A., & Csépe, V. (2019). Cognitive components of foreign word stress processing difficulty in speakers of a native language with non-contrastive stress. International Journal of Bilingualism, 23(2), 366–380. Google Scholar logo with link to Google Scholar
Hummel, K. M. (2009). Aptitude, phonological memory, and second language proficiency in nonnovice adult learners. Applied Psycholinguistics, 30(2), 225–249. Google Scholar logo with link to Google Scholar
Jackson, D. O. (2020). Working memory and second language development: A complex, dynamic future? Studies in Second Language Learning and Teaching, 10(1), 89–109. [URL].
Jesse, A., & McQueen, J. M. (2014). Suprasegmental lexical stress cues in visual speech can guide spoken-word recognition. Quarterly Journal of Experimental Psychology (2006), 67(4), 793–808. Google Scholar logo with link to Google Scholar
Juffs, A., & Harrington, M. (2011). Aspects of working memory in L2 learning. Language Teaching, 44(2), 137–166. Google Scholar logo with link to Google Scholar
Kelly, S. D., & Lee, A. L. (2012). When actions speak too much louder than words: Hand gestures disrupt word learning when phonetic demands are high. Language and Cognitive Processes, 27(6), 793–807. Google Scholar logo with link to Google Scholar
Krahmer, E., & Swerts, M. (2007). The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57(3), 396–414. Google Scholar logo with link to Google Scholar
Leonard, T., & Cummins, F. (2011). The temporal relation between beat gestures and speech. Language and Cognitive Processes, 26(10), 1457–1471. Google Scholar logo with link to Google Scholar
Li, P., Baills, F., & Prieto, P. (2020). Observing and producing durational hand gestures facilitates the pronunciation of novel vowel-length contrasts. Studies in Second Language Acquisition, 42(5), 1015–1039. Google Scholar logo with link to Google Scholar
Li, S. (2019). Six decades of language aptitude research. In Z. Wen, P. Skehan, A. Biedroń, S. Li & R. L. Sparks (Eds.), Language aptitude (pp. 78–96). Routledge. Google Scholar logo with link to Google Scholar
Linck, J. A., Osthus, P., Koeth, J. T., & Bunting, M. F. (2014). Working memory and second language comprehension and production: a meta-analysis. Psychonomic Bulletin & Review, 21(4), 861–883. Google Scholar logo with link to Google Scholar
Llanes-Coromina, J., Prieto, P., & Rohrer, P. L. (2018). Brief training with rhythmic beat gestures helps L2 pronunciation in a reading aloud task. Speech Prosody 2018, 498–502. Google Scholar logo with link to Google Scholar
Makowski, D., Ben-Shachar, M. S., Patil, I., & Lüdecke, D. (2021). Automated results reporting as a practical tool to improve reproducibility and methodological best practices adoption. CRAN. [URL]
McNeill, D. (1992). Hand and mind: What gestures reveal about thought. University of Chicago Press.Google Scholar logo with link to Google Scholar
Mora, J. C., & Darcy, I. (2023). Individual differences in attention control and the processing of phonological contrasts in a second language. Phonetica, 80(3–4), 153–184. Google Scholar logo with link to Google Scholar
Neurobehavioral Systems, Inc. (2024a). Presentation Cognitive Experiments III v3. Retrieved May 10, 2024, from [URL]
. (2024b). Presentation Cognitive Experiments IV v2. Retrieved May 10, 2024, from [URL]
Özer, D., & Göksun, T. (2020). Visual-spatial and verbal abilities differentially affect processing of gestural vs. spoken expressions. Language, Cognition and Neuroscience, 35(7), 896–914. Google Scholar logo with link to Google Scholar
Ping, R., & Goldin-Meadow, S. (2010). Gesturing saves cognitive resources when talking about nonpresent objects. Cognitive Science, 34(4), 602–619. Google Scholar logo with link to Google Scholar
Posit Team. (2024). RStudio: Integrated development environment for R. Posit Software, PBC. Boston, MA. [URL]
Pouw, W., de Jonge-Hoekstra, L., Harrison, S. J., Paxton, A., & Dixon, J. A. (2021). Gesture–speech physics in fluent speech and rhythmic upper limb movements. Annals of the New York Academy of Sciences, 1491(1), 89–105. Google Scholar logo with link to Google Scholar
R Core Team. (2022). R: A language and environment for statistical computing. R Foundation for Statistical Computing. Vienna, Austria. [URL]
Reinisch, E., Jesse, A., & McQueen, J. M. (2010). Early use of phonetic information in spoken word recognition: Lexical stress drives eye movements immediately. Quarterly Journal of Experimental Psychology (2006), 63(4), 772–783. Google Scholar logo with link to Google Scholar
Rohrer, P. L., Bujok, R., van Maastricht, L., & Bosker, H. R. (2024). The timing of beat gestures affects lexical stress perception in Spanish. Proceedings of Speech Prosody 2024. Google Scholar logo with link to Google Scholar
Rohrer, P. L., Bujok, R., Van Maastricht, L., & Bosker, H. R. (2025). From “I dance” to “she danced” with a flick of the hands: Audiovisual stress perception in Spanish. Psychonomic Bulletin & Review. Google Scholar logo with link to Google Scholar
Sabourin, L., Leclerc, J.-C., Lapierre, M., Burkholder, M., & Brien, C. (2016). The language background questionnaires in L2 research: Teasing apart the variables. In L. Hracs (Ed.), Proceedings of the 2016 Annual Conference of the Canadian Linguistics Association. Retrieved April 1, 2024, from [URL]
Schubotz, L., Holler, J., Drijvers, L., & Özyürek, A. (2021). Aging and working memory modulate the ability to benefit from visible speech and iconic gestures during speech-in-noise comprehension. Psychological Research, 85(5), 1997–2011. Google Scholar logo with link to Google Scholar
Schwab, S., Giroud, N., Meyer, M., & Dellwo, V. (2020). Working memory and not acoustic sensitivity is related to stress processing ability in a foreign language: An ERP study. Journal of Neurolinguistics, 55, 100897. Google Scholar logo with link to Google Scholar
Skehan, P. (1989). Individual differences in second language learning. Routledge. Retrieved December 20, 2020, from [URL]
Stepanov, A., Kodrič, K. B., & Stateva, P. (2020). The role of working memory in children’s ability for prosodic discrimination. PloS One, 15(3), e0229857. Google Scholar logo with link to Google Scholar
Thompson, L. A. (1995). Encoding and memory for visible speech and gestures: A comparison between young and older adults. Psychology and Aging, 10(2), 215–228. Google Scholar logo with link to Google Scholar
Thompson, L. A., & Guzman, F. A. (1999). Some limits on encoding visible speech and gestures using a dichotic shadowing task. The Journals of Gerontology: Series B, 54(6), P347–9. Google Scholar logo with link to Google Scholar
Thomson, R. (2022). The relationship between L2 speech perception and production. In T. M. Derwing, M. J. Munro & R. Thomson (Eds.), The Routledge handbook of second language acquisition and speaking (pp. 370–385). Routledge Taylor & Francis Group. Google Scholar logo with link to Google Scholar
van Maastricht, L., Hoetjes, M., & van Drie, E. (2019a). Do gestures during training facilitate L2 lexical stress acquisition by Dutch learners of Spanish? Proceedings of the 15th International Conference on Auditory-Visual Speech Processing (AVSP2019). Retrieved May 29, 2023, from [URL].
van Maastricht, L., Hoetjes, M., & van der Heijden, L. (2022). Learning L2 Prosody using Gestures: The role of individual differences related to musicality. Speech Prosody 2022, 718–722. Google Scholar logo with link to Google Scholar
van Maastricht, L., Krahmer, E., & Swerts, M. (2016a). Native speaker perceptions of (non)native prominence patterns: Effects of deviance in pitch accent distributions on accentedness, comprehensibility, intelligibility, and nativeness. Speech Communication, 83, 21–33. Google Scholar logo with link to Google Scholar
(2016b). Prominence patterns in a second language: Intonational transfer from Dutch to Spanish and vice versa. Language Learning, 66(1), 124–158. Google Scholar logo with link to Google Scholar
van Maastricht, L., Krahmer, E., Swerts, M., & Prieto, P. (2019b). Learning direction matters: A study on L2 rhythm acquisition by Dutch learners of Spanish and Spanish learners of Dutch. Studies in Second Language Acquisition, 41(1), 87–121. Google Scholar logo with link to Google Scholar
van Maastricht, L., Zee, T., Krahmer, E., & Swerts, M. (2021). The interplay of prosodic cues in the l2: How intonation, rhythm, and speech rate in speech by Spanish learners of Dutch contribute to l1 Dutch perceptions of accentedness and comprehensibility. Speech Communication, 133, 81–90. Google Scholar logo with link to Google Scholar
Wen, Z. (2019). Working memory as language aptitude: The Phonological/Executive Model. In Z. Wen, P. Skehan, A. Biedroń, S. Li & R. L. Sparks (Eds.), Language aptitude (pp. 187–214). Routledge. Google Scholar logo with link to Google Scholar
(2023). Phonological and executive working memory. In Z. Wen, A. Biedroń & R. L. Sparks (Eds.), Cognitive individual differences in second language acquisition (pp. 97–124). De Gruyter Mouton. Google Scholar logo with link to Google Scholar
Wen, Z., Juffs, A., & Winke, P. (2020). Measuring working memory. In P. Winke & T. Brunfaut (Eds.), The Routledge handbook of second language acquisition and language testing (pp. 167–176). Routledge. Google Scholar logo with link to Google Scholar
Wen, Z., & Li, S. (2019). Working memory in L2 learning and processing. In J. W. Schwieter & A. Benati (Eds.), The Cambridge handbook of language learning (pp. 365–389). Cambridge University Press. Google Scholar logo with link to Google Scholar
Wen, Z., Skehan, P., Biedroń, A., Li, S., & Sparks, R. L. (Eds.). (2019). Language aptitude. Routledge. Google Scholar logo with link to Google Scholar
Woods, D. L., Kishiyamaa, M. M., Lund, E. W., Herron, T. J., Edwards, B., Poliva, O., Hink, R. F., & Reed, B. (2011). Improving digit span assessment of short-term verbal memory. Journal of Clinical and Experimental Neuropsychology, 33(1), 101–111. Google Scholar logo with link to Google Scholar
Wu, Y. C., & Coulson, S. (2014). Co-speech iconic gestures and visuo-spatial working memory. Acta Psychologica, 153, 39–50. Google Scholar logo with link to Google Scholar
Wu, Y. C., Müller, H. M., & Coulson, S. (2022). Visuospatial working memory and understanding co-speech iconic gestures: Do gestures help to paint a mental picture? Discourse Processes, 59(4), 275–297. Google Scholar logo with link to Google Scholar
Zhang, Y., Baills, F., & Prieto, P. (2020). Hand-clapping to the rhythm of newly learned words improves L2 pronunciation: Evidence from training Chinese adolescents with French words. Language Teaching Research, 24(5), 666–689. Google Scholar logo with link to Google Scholar
Zhu, Y., & Mok, P. (2022). The role of prosody across languages. In T. M. Derwing, M. J. Munro & R. Thomson (Eds.), The Routledge handbook of second language acquisition and speaking. Routledge Taylor & Francis Group. Google Scholar logo with link to Google Scholar
Mobile Menu Logo with link to supplementary files background Layer 1 jbe-platform.quadraat-sans-bold jbe-platform.quadraat-sans-bold-dark jbe-platform.quadraat-sans-bold-light jbe-platform.quadraat-sans-bold prag Twitter_Logo_Blue