Cover not available
Article published In:
English Text Construction
Vol. 12:2 (2019) ► pp.265–289

Beyond proficiency

Linguistic features of exceptional writing

| King Mongkut’s University of Technology Thonburi
| King Mongkut’s University of Technology Thonburi
Many studies have investigated the correlations between linguistic features and human judgements of writing quality. These studies usually investigate either proficient student writing or exceptional literary writing. The current study attempts to bridge these two perspectives by comparing proficient writing to award-winning exceptional writing using movie reviews written by bloggers and Pulitzer Prize winners. A range of linguistic features representing syntactic complexity, lexical complexity, and lexical cohesion were analyzed using both automated and interpretive methods. It is found that some, but not all, of the trends seen in writing development studies continue on to exceptional writing, with lexical sophistication and lexical cohesion through conceptual associations making the largest contributions to the differences between proficient and exceptional writers.
Keywords: movie reviews, lexical cohesion, lexical complexity, syntactic complexity, writing quality
Article outline
  • 1.Introduction
    • 1.1Quantitative analyses of linguistic features
    • 1.2Interpretive analyses of linguistic features
    • 1.3Comparing quantitative and interpretive approaches
  • 2.Methodology
    • 2.1Data collection
    • 2.2Data analysis
      • 2.2.1Syntactic complexity
      • 2.2.2Lexical complexity
      • 2.2.3Lexical cohesion
    • 2.3Automation and correlations
  • 3.Results
    • 3.1Syntactic complexity
    • 3.2Lexical complexity
    • 3.3Lexical cohesion
  • 4.Discussion
    • 4.1Interpretative analysis of linguistic features
  • References
Published online: 1 October 2019
DOI logo
https://doi.org/10.1075/etc.00029.tow
References (39)
References
Beers, Scott F. & William E. Nagy. 2009. Syntactic complexity as a predictor of adolescent writing quality: Which measures? Which genre? Reading and Writing 22 (2): 185–200. DOI logoGoogle Scholar
Berninger, Virginia W., Robert D. Abbott, William Nagy & Joanne Carlisle. 2010. Growth in phonological, orthographic, and morphological awareness in grades 1 to 6. Journal of Psycholinguistic Research 39 (2): 141–163. DOI logoGoogle Scholar
Bulté, Bram & Alex Housen. 2014. Conceptualizing and measuring short-term changes in L2 writing complexity. Journal of Second Language Writing 261: 42–65. DOI logoGoogle Scholar
Connor, Ulla. 1990. Linguistic/rhetorical measures for international persuasive student writing. Research in the Teaching of English: 67–87.Google Scholar
Connor-Linton, Jeff & Charlene Polio. 2014. Comparing perspectives on L2 writing: Multiple analyses of a common corpus. Journal of Second Language Writing 261: 1–9. DOI logoGoogle Scholar
Crowhurst, Marion. 1983. Syntactic complexity and writing quality: A review. Canadian Journal of Education/Revue Canadienne de L’education: 1–16.Google Scholar
Crossley, Scott A. & Danielle S. McNamara. 2010. Cohesion, coherence, and expert evaluations of writing proficiency. In Proceedings of the 32nd Annual Conference of the Cognitive Science Society, Stellan Ohlsson & Richard Catrambone (eds). Cognitive Science Society, 984–989.Google Scholar
Crossley, Scott. A. & Danielle S. McNamara. 2011. Understanding expert ratings of essay quality: Coh-Metrix analyses of first and second language writing. International Journal of Continuing Engineering Education and Life-Long Learning 21 (2): 170–191. DOI logoGoogle Scholar
Crossley, Scott A. & Danielle S. McNamara. 2012. Predicting second language writing proficiency: The roles of cohesion and linguistic sophistication. Journal of Research in Reading 35 (2): 115–135. DOI logoGoogle Scholar
Crossley, Scott A., Jennifer L. Weston, Susan T. McLain & Danielle S. McNamara. 2011. The development of writing proficiency as a function of grade level: A linguistic analysis. Written Communication 281: 282–311. DOI logoGoogle Scholar
Cruse, Alan. 2011. Meaning in language: An introduction to semantics and pragmatics. Oxford UK: Oxford University.Google Scholar
Culpeper, Jonathan. 2002. Computers, language and characterisation: An Analysis of six characters in Romeo and Juliet. In Conversation in Life and in Literature: Papers from the ASLA Symposium, Association Suedoise de Linguistique Appliquee (ASLA) 15, Ulla Melander-Marttala, Carin Ostman & Merja Kyto (eds). Uppsala, Sweden: Universitetstryckeriet, 11–30.Google Scholar
Engber, Cheryl A. 1995. The relationship of lexical proficiency to the quality of ESL compositions. Journal of Second Language Writing 4 (2): 139–155. DOI logoGoogle Scholar
Ferris, Dana R. 1994. Lexical and syntactic features of ESL writing by students at different levels of L2 proficiency. TESOL Quarterly 28 (2): 414–420. DOI logoGoogle Scholar
Fischer-Starcke, Bettina. 2010. Corpus linguistics in literary analysis: Jane Austen and her contemporaries. London and New York: Continuum.Google Scholar
Graesser, Arthur C., Danielle S. McNamara, Max M. Louwerse & Zhiqiang Cai. 2004. Coh-Metrix: Analysis of text on cohesion and language. Behavior Research Methods, Instruments, and Computers 361: 193–202. DOI logoGoogle Scholar
Grant, Leslie & April Ginther. 2000. Using computer-tagged linguistic features to describe L2 writing differences. Journal of Second Language Writing 9 (2): 123–145. DOI logoGoogle Scholar
Hoey, Michael. 2005. Lexical priming: A new theory of words and language. London and New York: Routledge.Google Scholar
Hornaday, Ann. 2012. Adolescent love among eccentrics [Web blog post]. <[URL]> (Last accessed on 17 November 2013).
Jin, Wenjun. 2001. A quantitative study of cohesion in Chinese graduate students’ writing: Variations across genres and proficiency levels. Paper presented at the Symposium on Second Language Writing, Purdue University, West Lafayette, Indiana, USA, 15–16 September, 2000.
Louis, Annie & Ani Nenkova. 2011. Automatic identification of general and specific sentences by leveraging discourse annotations. Proceedings of 5th International Joint Conference on Natural Language Processing. Thailand: Asian Foundation of Natural Language Processing, 605–613.Google Scholar
. 2013a. A corpus of science journalism for analyzing writing quality. Dialogue and Discourse 4 (2): 87–117. DOI logoGoogle Scholar
. 2013b. What makes writing great? First experiments on article quality prediction in the science journalism domain. Transactions of the Association for Computational Linguistics 11: 341–352. DOI logoGoogle Scholar
Lu, Xiaofei. 2010. Automatic analysis of syntactic complexity in second language writing. International Journal of Corpus Linguistics 151: 474–496. DOI logoGoogle Scholar
. 2012. The relationship of lexical richness to the quality of ESL learners’ oral narratives. Modern Language Journal 96 (2): 190–208. DOI logoGoogle Scholar
Luke. (2012). Moonrise Kingdom [Web blog post]. <[URL]> (Last accessed on 29 September 2013).
Mahlberg, Michaela. 2007. Corpus stylistics: Bridging the gap between linguistic and literary studies. In Text, discourse and corpora: Theory and analysis, Michael Hoey, Michaela Mahlberg, Michael Stubbs & Wolfgang Teubert (eds). London UK: Continuum, 219–246.Google Scholar
McCutchen, Deborah & Charles A. Perfetti. 1982. Coherence and connectedness in the development of discourse production. Text 2 (1–3): 113–140. DOI logoGoogle Scholar
McGrath, R. E., & Meyer, G. J. 2006. When effect sizes disagree: the case of r and d. Psychological Methods 11(4), 386–401. DOI logoGoogle Scholar
McNamara, Danielle. S., Scott A. Crossley & Philip M. McCarthy. 2010. Linguistic features of writing quality. Written Communication 27 (1): 57–86. DOI logoGoogle Scholar
Ortega, Lourdes. 2003. Syntactic complexity measures and their relationship to L2 proficiency: A research synthesis of college-level L2 writing. Applied Linguistics 24 (4): 492–518. DOI logoGoogle Scholar
. 2015. Syntactic complexity in L2 writing: Progress and expansion. Journal of Second Language Writing 291: 82–94. DOI logoGoogle Scholar
Read, John. 2000. Assessing vocabulary. Cambridge UK: Cambridge University Press. DOI logoGoogle Scholar
Shaughnessy, M. P. 1979. Errors and expectations: A guide for the teacher of basic writing. Oxford: Oxford University Press.Google Scholar
Stubbs, Michael. 2005. Conrad in the computer: Examples of quantitative stylistic methods. Language and Literature 14 (1): 5–24. DOI logoGoogle Scholar
The Pulitzer Prizes: Honoring Excellence in Journalism and the Arts. (n.d.). <[URL]> (Last accessed on 10 November 2013).
van Peer, Willie (ed). 2008. The quality of literature: Linguistic studies in literary evaluation 41. Amsterdam, Netherlands: John Benjamins Publishing. DOI logoGoogle Scholar
Widdowson, Henry George. 1992. Practical stylistics: An approach to poetry. Oxford UK: Oxford University Press.Google Scholar
Wolfe-Quintero, Kate, Shunji Inagaki & Hae-Young Kim. 1998. Second language development in writing: Measures of fluency, accuracy, and complexity. Honolulu: University of Hawai’i at Manoa.Google Scholar