To automated generation of test questions on the basis of error annotations in EFL essays
A time-saving tool?
Olga Vinogradova | National Research University Higher School of Economics, Moscow
The paper presents computer tools that were designed to increase the pedagogical value of a learner corpus for teachers and learners of English as a foreign language. The corpus used in the study is a collection of essays written by Russian learners of English – students from four different cities in Russia, studying at different Bachelor programmes at the Higher School of Economics. The paper describes how the tools we offer make use of manually annotated errors for the process of automated generation of questions for English tests, what editing the generated tests requires, and in the final section there is a discussion to what degree this process appears to be useful for EFL instructors.
Article outline
1.Introduction
1.1Previous research in corpus annotation
1.2Description of the learner corpus and annotation practices adopted in it
2.Benefits of error annotations in REALEC for teaching and learning English
2.1Pedagogical directions in using a learner corpus in university EFL classes
2.2REALEC English Test Maker: Related works, the main principles and stages of work of the program
2.3REALEC English Test Maker: Special cases
2.4RETM (REALEC English Test Maker): Editing automatically generated questions
2009Semi-automatic test case generation from business process models. In Proceedings of the 11th Symposium on Programming Languages and Software Tools and 7th Nordic Workshop on Model Driven Software Engineering, 5–18. Tampere, Finland: Tampere University of Technology. [URL]> (15February 2018).
Bayerl, Petra S.
2007Identifying sources of disagreement: Generalizability theory in manual annotation studies. Computational Linguistics 33(1): 3–8.
2018Automated Error Detection in English Examination Essays Written by Russian Students. BA dissertation, School of Linguistics, Research University Higher School of Economics, Moscow.
2014Establishing a standardised procedure for building learner corpora. Journal of Applied Language Studies 8(3): 5–20.
Granger, Sylviane
2003The International Corpus of Learner English: A new resource for foreign language learning and teaching and second language acquisition research. TESOL Quarterly 37(3): 538–546.
Granger, Sylviane
2004Computer learner corpus research: Current status and future prospects. In Applied Corpus Linguistics: A Multidimensional Perspective, Ulla Connor & Thomas A. Upton (eds), 123–145. Amsterdam: Rodopi.
Gierl, Mark J. & Haladyna, Thomas M.
2012Automatic Item Generation: Theory and Practice. New York NY: Routledge.
2007Assisting cloze test making with a web application. In Proceedings of SITE 2007--Society for Information Technology & Teacher Education International Conference, Roger Carlsen, Karen McFerrin, Jerry Price, Roberta Weber & Dee Anna Willis (eds), 2807–2814. Chesapeake VA: AACE. [URL]> (25February 2018).
Hovy, Eduard & Lavid, Julia
2010Towards a ‘Science’ of corpus annotation: A new methodological challenge for corpus linguistics. International Journal of Translation 22(1): 13–36.
Huddleston, Rodney & Pullum, Geoffrey K.
2002The Cambridge Grammar of the English Language. Cambridge: CUP.
Leech, Geoffrey
2015Adding linguistic annotation. In Developing Linguistic Corpora: A Guide to Good Practice. Oxford: Oxbow Books.
Lyashevskaja, Olga & Plungian, Vladimir
2003Morphological annotation in Russian National Corpus: A theoretical feedback. In 5th International Conference on Formal Description of Slavic Languages (FDSL-5). Frankfurt: Peter Lang.
Plugian, Vladimir
2005Zachem nuzhen Natsional’ny korpus russkogo yazyka? Neformal’noye vvedeniye (Why do we need Russian National Corpus? Informal introduction). In Russian National Corpus: 2003–2005, 6–20. Moscow: Indrik. [URL]> (25February 2018).
Proshina, Zoya G. & Eddy, Anna A.
2017Russian English: History, Functions, and Features. Cambridge: CUP.
Saraceni, Mario
2015World Englishes: A Critical Analysis. London: Bloomsbury.
Vinogradova, Olga
2016The role and applications of expert error annotation in a corpus of English learner texts. In Computational Linguistics and Intellectual Technologies (Proceedings of International Conference “Dialogue 2016”) issue 15(22), 740–751.
Vinogradova, Olga, Lyashevskaya, Olga & Panteleeva, Irina
2017Multi-level student essay feedback in a learner corpus. In Computational Linguistics and Intellectual Technologies (Papers from the Annual conference “Dialogue”) Issue 16(23), Vol. 1, 382–396. Moscow: RSUH.
Vinogradova, Olga & Login, Nikita
2017The design of tests with multiple choice questions automatically generated from essays in a learner corpus. Higher School of Economics Research PaperNo. WP BRP 60/LNG/201713December 2017 <[URL]> (25February 2018)
Cited by
Cited by 1 other publications
Login, Nikita
2023. Distractor Generation for Lexical Questions Using Learner Corpus Data. Journal of Linguistics/Jazykovedný casopis 74:1 ► pp. 345 ff.
This list is based on CrossRef data as of 20 march 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.