Cover not available
Part of
Complexity, Accuracy and Fluency in Learner Corpus Research
Edited by Agnieszka Leńko-Szymańska and Sandra Götz
[Studies in Corpus Linguistics 104] 2022
► pp. 209–240

Interaction between grammatical accuracy and syntactic complexity at different proficiency levels

Insights from a learner corpus

 | University of Antwerp | Université Saint-Louis
 | University of Antwerp
This learner corpus study tracks the development and interactional dynamics between grammatical accuracy (GrA) and syntactic complexity (SC) at four Common European Framework proficiency levels (intermediate and advanced levels B1/B2/C1/C2). Data from the International Corpus of Learner English (Granger et al. 2020) were error-tagged and submitted to the automatic L2 Syntactic Complexity Analyzer (Lu 2010). Interaction between B1 and B2 is characterised by a competitive relationship between GrA and SC, with the most marked improvement displayed in accuracy. Development between B2 and C1 displays subtle shifts, with GrA improving slightly and SC showing mild signs of reorganisation. Between C1 and C2, a more supportive relationship appears: SC shows the most marked signs of development, with GrA continuing to subtly improve.
Keywords: grammatical accuracy, syntactic complexity, interactional dynamics, proficiency levels
Article outline
  • 1.Introduction and study rationale
  • 2.Construct definitions: Grammatical accuracy and syntactic complexity
  • 3.The dynamic relationship between L2 accuracy and complexity
  • 4.Is more syntactically complex better?
  • 5.Data and methodology
    • 5.1Learner corpus data
    • 5.2Grammatical accuracy and syntactic complexity indices
    • 5.3Study design
  • 6.Results
    • 6.1Mapping the grammatical accuracy and syntactic complexity constructs
    • 6.2Capturing dynamic developmental patterns
  • 7.Conclusion and avenues for further research
  • Notes
  • References
  • Appendix
Published online: 1 December 2022
DOI logo
https://doi.org/10.1075/scl.104.09the
References (69)
References
Abdel Latif, Muhammad M. Mahmoud. 2013. What do we mean by writing fluency and how can it be validly measured? Applied Linguistics 34(1): 99–105. DOI logoGoogle Scholar
Alexopoulou, Theodora, Michel, Marije, Murakami, Akira & Meurers, Detmar. 2017. Task effects on linguistic complexity and accuracy. A large-scale learner corpus analysis employing natural language processing techniques. Language Learning 67(1): 180–208. DOI logoGoogle Scholar
Biber, Douglas & Conrad, Lauren. 2009. Register, Genre, and Style. Cambridge: CUP. DOI logoGoogle Scholar
Biber, Douglas, Gray, Bethany & Poonpon, Kornwipa. 2011. Should we use characteristics of conversation to measure grammatical complexity in L2 writing development? TESOL Quarterly 45(1): 5–35. DOI logoGoogle Scholar
Brand, Christiane & Götz, Sandra. 2011. Fluency versus accuracy in advanced spoken learner language: A multi-method approach. International Journal of Corpus Linguistics 16(2): 255–275. DOI logoGoogle Scholar
Bulté, Bram & Housen, Alex. 2014. Conceptualizing and measuring short-term changes in L2 writing complexity. Journal of Second Language Writing 26(4): 42–65. DOI logoGoogle Scholar
. 2012. Defining and operationalizing L2 complexity. In Dimensions of L2 Performance and Proficiency [Language Learning & Language Teaching 32], Alex Housen, Folkert Kuiken & Ineke Vedder (eds), 21–46. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Chan, HuiPing, Verspoor, Marjolijn & Vahtrick, Louisa. 2015. Dynamic development in speaking vs. writing in identical twins. Language Learning 65(2): 298–325. DOI logoGoogle Scholar
Chen, Xiaobin & Meurers, Detmar. 2016. CTAP: A web-based tool supporting automatic complexity analysis. In Proceedings of The Workshop on Computational Linguistics for Linguistic Complexity, Dominique Brunato, Felice Dell’Orletta, Giulia Venturi, Thomas François & Philippe Blache (eds), 113–119. Osaka: The COLING 2016 Organizing Committee.Google Scholar
Council of Europe. 2001. Common European Framework of Reference for Languages: Learning, Teaching, Assessment. Strasbourg: Council of Europe.Google Scholar
Crossley, Scott & McNamara, Danielle. 2014. Does writing development equal writing quality? A computational investigation of syntactic complexity in L2 learners. Journal of Second Language Writing 26: 66–79. DOI logoGoogle Scholar
Dagneaux, Estelle, Denness, Sharon & Granger Sylviane. 1998. Computer-aided error analysis. System: An International Journal of Educational Technology and Applied Linguistics 26(2): 163–174. DOI logoGoogle Scholar
Dagneaux, Estelle, Denness, Sharon, Granger, Sylviane, Meunier, Fanny, Neff, JoAnne, & Thewissen, Jennifer. 2008. Error Tagging Manual Version 1.3. Centre for English Corpus Linguistics. Université catholique de Louvain, Louvain-la-Neuve. Unpublished manual.Google Scholar
de Bot, Kees & Larsen-Freeman, Diane. 2011. Researching second language development from a dynamic systems theory perspective. In A Dynamic Approach to Second Language Development: Methods and Techniques [Language Learning and Language Teaching 29], Marjolijn Verspoor, Kees de Bot & Wander Lowie (eds), 5–24. Amsterdam: John Benjamins. DOI logoGoogle Scholar
De Clercq, Bastien & Housen, Alex. 2019. The development of morphological complexity: A cross-linguistic study of L2 French and English. Second Language Research 35(1): 71–98. DOI logoGoogle Scholar
de Graaff, Rick. 2019. You’ve got to crack a few eggs to make an omelette. Linguistic complexity and instruction in SLA: What’s in it for SLA? Instructed Second Language Acquisition 3(2): 249–258. DOI logoGoogle Scholar
de Leeuw, Jan & Mair, Patrick. 2009. Multidimensional Scaling Using Majorization: SMACOF in R. Journal of Statistical Software 31(3): 1–30. DOI logoGoogle Scholar
Díez-Bedmar, María Belén. 2021. Error analysis. In The Routledge Handbook of Second Language Acquisition and Corpora, Nicole Tracy-Ventura & Magali Paquot (eds), 90–104. New York NY: Routledge.Google Scholar
Ellis, Rod & Yuan, Fangyuan. 2004. The effects of planning on fluency, complexity and accuracy in second language narrative writing. Studies in Second Language Acquisition 26(1): 59–84. DOI logoGoogle Scholar
Fogel, Alan. 2011. Theoretical and applied dynamic systems research in developmental science. Child Developmental Perspectives 5: 267–272. DOI logoGoogle Scholar
Foster, Pauline & Skehan, Peter. 1996. The influence of planning and task type on second language performance. Studies in Second Language Acquisition 18(3): 299–324. DOI logoGoogle Scholar
Garside, Roger & Smith, Nicholas. 1997. A hybrid grammatical tagger: CLAWS4. In Corpus Annotation: Linguistic Information from Computer Text Corpora, Roger Garside, Geoffrey Leech & Anthony McEnery (eds), 102–121. London: Longman. DOI logoGoogle Scholar
Götz, Sandra. 2013. Fluency in Native and Nonnative English Speech [Studies in Corpus Linguistics 53]. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Granger, Sylviane, Dupont, Maïté, Meunier, Fanny, Naets, Hubert & Paquot, Magali. 2020. The International Corpus of Learner English, Version 3. Louvain-la-Neuve: Presses universitaires de Louvain.Google Scholar
Hasko, Victoria. 2013. Capturing the dynamics of second language development via learner corpus research: A very long engagement. The Modern Language Journal 97(1): 1–10. DOI logoGoogle Scholar
Housen, Alex, De Clercq, Bastien, Kuiken, Folkert & Vedder, Ineke. 2019. Multiple approaches to complexity in second language research. Second Language Research 35(1): 3–21. DOI logoGoogle Scholar
Housen, Alex, Kuiken Folkert & Vedder, Ineke. 2012. Complexity, accuracy, fluency. International Journal of Applied Linguistics 23(2): 1–20. DOI logoGoogle Scholar
Housen, Alex & Kuiken, Folkert. 2009. Complexity, accuracy, and fluency in Second Language Acquisition. Applied Linguistics 30(4): 461–473. DOI logoGoogle Scholar
Jin, Tan, Lu, Xiaofei & Ni, Jing. 2020. Syntactic complexity in adapted teaching materials: Differences among grade levels and implications for benchmarking. The Modern Language Journal 104(1): 192–208. DOI logoGoogle Scholar
Kuiken, Folkert, Housen, Alex, Vedder, Ineke & De Clercq, Bastien. 2019. Variation in syntactic complexity: Introduction. International Journal of Applied Linguistics 29(2): 161–170. DOI logoGoogle Scholar
Kuiken, Folkert & Vedder, Ineke. 2019. Investigating teachers’ perceptions of syntactic complexity in L2 academic writing. Instructed Second Language Acquisition 3(2): 228–248. DOI logoGoogle Scholar
Kyle, Kristopher. 2016. Measuring Syntactic Development in L2 Writing: Fine Grained Indices of Syntactic Complexity and Usage-based Indices of Syntactic Sophistication. PhD Dissertation, Georgia State University.
Kyle, Kristopher & Crossley, Scott. 2018. Measuring syntactic complexity in L2 writing using fine-grained clausal and phrasal indices. The Modern Language Journal 102(2): 333–349. DOI logoGoogle Scholar
Lambert, Craig & Kormos, Judit. 2014. Complexity, accuracy and fluency in task-based L2 research: Toward more developmentally based measures of second language acquisition. Applied Linguistics 35(5): 607–614. DOI logoGoogle Scholar
Larsen-Freeman, Diane. 2018. Second Language Acquisition, WE, and language as a complex adaptive system (CAS). World Englishes 37(1): 80–92. DOI logoGoogle Scholar
. 2009. Adjusting expectations: The study of complexity, accuracy and fluency in second language acquisition. Applied Linguistics 30(4): 579–589. DOI logoGoogle Scholar
. 2006. The emergence of complexity, fluency, and accuracy in the oral and written production of five Chinese learners of English. Applied Linguistics 27(4): 590–619. DOI logoGoogle Scholar
Lennon, Paul. 1991. Error: Some problems of definition, identification, and distinction. Applied Linguistics 12(2): 180–196. DOI logoGoogle Scholar
Lowie, Wander, Michel, Marije, Keijzer, Merel & Steinkrauss, Rasmus. 2020. Usage-Based Dynamics in Second Language Development. Bristol: Multilingual Matters. DOI logoGoogle Scholar
Lowie, Wander & Verspoor, Marjolijn. 2007. A Dynamic Systems Theory approach to second language acquisition. Bilingualism: Language and Cognition 10(1): 7–21. DOI logoGoogle Scholar
Lu, Xiaofei. 2017. Automated measurement of syntactic complexity in corpus-based L2 writing research and implications for writing assessment. Language Testing 34(4): 493–511. DOI logoGoogle Scholar
. 2012. The relationship of lexical richness to the quality of ESL learners’ oral narratives. The Modern Language Journal 96(2): 190–208. DOI logoGoogle Scholar
. 2011. A corpus-based evaluation of syntactic complexity measures as indices of college-level ESL writers’ language development. TESOL Quarterly 45(1): 36–62. DOI logoGoogle Scholar
. 2010. Automatic analysis of syntactic complexity in second language writing. International Journal of Corpus Linguistics 15(4): 36–62. DOI logoGoogle Scholar
Mair, Patrick, Groenen, Patrick J. F. & de Leeuw, Jan. 2021. More on multidimensional scaling in R: Smacof version 2. Journal of Statistical Software. <[URL]> (12 February 2022)
McNamara, Danielle, Graesser, Arthur, McCarthy, Philip & Cai, Zhiqiang. 2014. Automated Evaluation of Text and Discourse with Coh-Metrix. Cambridge: CUP. DOI logoGoogle Scholar
Meunier, Fanny. 2016. Introduction to the LONGDALE project. In Studies in Learner Corpus Linguistics: Research and Applications for Foreign Language Teaching and Assessment, Erik Castello, Katherine Ackerley & Francesca Coccetta (eds), 123–126. Berlin: Peter Lang.Google Scholar
Michel, Marije, Murakami, Akira, Alexopoulou, Theodora & Meurers, Detmar. 2019. Effects of task type on morphosyntactic complexity: Evidence from a large learner corpus of A1 to C2 writings. Instructed Second Language Acquisition 3(2): 124–152. DOI logoGoogle Scholar
Norris, John & Ortega, Lourdes. 2009. Towards an organic approach to investigating CAF in instructed SLA: The case of complexity. Applied Linguistics 30(4): 555–578. DOI logoGoogle Scholar
Ortega, Lourdes. 2015. Syntactic complexity in L2 writing: Progress and expansion. Journal of Second Language Writing 29: 82–94. DOI logoGoogle Scholar
Pallotti, Gabriele. 2015. A simple view of linguistic complexity. Second Language Research 31(1): 117–134. DOI logoGoogle Scholar
. 2009. CAF: Defining, refining and differentiating constructs. Applied Linguistics 30(4): 590–601. DOI logoGoogle Scholar
Paquot, Magali. 2019. The phraseological dimension in interlanguage complexity research. Second Language Research 35(1): 121–145. DOI logoGoogle Scholar
Plakans, Lia, Gebril, Ata & Bilki, Zeynep. 2019. Shaping a score: Complexity, accuracy, and fluency in integrated writing performances. Language Testing 36(2): 161–179. DOI logoGoogle Scholar
Polio, Charlene & Shea, Mark. 2014. An investigation into current measures of linguistic accuracy in second language writing research. Journal of Second Language Writing 26(1): 10–27. DOI logoGoogle Scholar
Polio, Charlene & Yoon, Hyung-Jo. 2018. The reliability and validity of automated tools for examining variation in syntactic complexity across genres. International Journal of Applied Linguistics 28(1): 165–188. DOI logoGoogle Scholar
Rosmawati, Rosmawati. 2014. Dynamic development of complexity and accuracy: A case study in second language academic writing. Australian Review of Applied Linguistics 37(2): 75–100. DOI logoGoogle Scholar
Skehan, Peter. 2009. Modelling second language performance: Integrating complexity, accuracy, fluency, and lexis. Applied Linguistics 30(4): 510–532. DOI logoGoogle Scholar
Skehan, Peter & Foster, Pauline. 2012. Complexity, accuracy, fluency and lexis in task-based performance: A synthesis of the Ealing research In Dimensions of L2 performance and Proficiency [Language Learning & Language Teaching 32], Alex Housen, Folkert Kuiken & Ineke Vedder (eds), 199–220. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Spoelman, Marianne & Verspoor, Marjolijn. 2010. Dynamic patterns in development of accuracy and complexity: A longitudinal case study in the acquisition of Finnish. Applied Linguistics 31(4): 532–553. DOI logoGoogle Scholar
Thelen, Esther & Smith, Linda B. 1994. A Dynamic Systems Approach to the Development of Cognition and Action. Cambridge MA: The MIT Press.Google Scholar
Thewissen, Jennifer. 2021. Accuracy. In The Routledge Handbook of Second Language Acquisition and Corpora, Nicole Tracy-Ventura & Magali Paquot (eds), 305–317. New York NY: Routledge.Google Scholar
. 2015. Accuracy across Proficiency Levels: A Learner Corpus Approach. Louvain-la-Neuve: Presses universitaires de Louvain.Google Scholar
Thewissen, Jennifer & Anishchanka, Alena. 2019. An integrative approach to L2 accuracy and complexity development. Paper presented at the 5th Learner Corpus Research Conference. 12–14 September 2019. University of Warsaw, Poland.
Verspoor, Marjolijn, Schmid, Monika & Xu, Xiaoyan. 2012. A dynamic usage based perspective on L2 writing. Journal of Second Language Writing 21: 239–263. DOI logoGoogle Scholar
Van Waes, Luuk & Leijten, Mariëlle. 2015. Fluency in writing: A multidimensional perspective on writing fluency applied to L1 and L2. Computers and Composition 38: 79–95. DOI logoGoogle Scholar
Vyatkina, Nina & Housen, Alex. 2021. Complexity. In The Routledge Handbook of Second Language Acquisition and Corpora, Nicole Tracy-Ventura & Magali Paquot (eds), 318–330. New York NY: Routledge.Google Scholar
Yang, Weiwei, Lu, Xiaofei, Cushing Weigle, Sarah. 2015. Different topics, different discourse: Relationships among writing topic, measures of syntactic complexity, and judgements of writing quality. Journal of Second Language Writing 28: 53–67. DOI logoGoogle Scholar
Yu, Hanjing & Lowie, Wander. 2020. Dynamic paths of complexity and accuracy in second language speech: A longitudinal case study of Chinese learners. Applied Linguistics 41(6): 855–877. DOI logoGoogle Scholar