Cover not available
Part of
Research Methods in the Study of L2 Writing Processes
Edited by Rosa M. Manchón and Julio Roca de Larios
[Research Methods in Applied Linguistics 5] 2023
► pp. 161–182

Chapter 8
Using keystroke logging for studying L2 writing processes

| Lund University * | Kristianstad University 1
| University of Gothenburg #
| Lund University *

This chapter presents an overview of keystroke logging. The chapter includes a general rationale for why and when the method is appropriate, how the technique works, and pros and cons with different methodological combinations of keystroke logging. Further, the chapter briefly outlines some previous L2 writing keystroke logging studies to illustrate the type of questions that can be addressed by this data collection technique. Finally, we discuss some methodological challenges and suggest best practices for using the method.

Article outline
  • Introduction
  • Introducing keystroke logging
    • How does keystroke logging work?
  • Research questions addressed in keystroke logging L2 writing studies
    • Research questions focusing on factors moderating pausing behavior
    • Research questions focusing on revision
    • Research questions focusing on writing fluency
    • Research questions with an educational focus
  • Methodological challenges
    • Challenge 1: Choosing hardware
    • Challenge 2: Choosing the keystroke logging program
    • Challenge 3: Choosing settings and procedure
    • Challenge 4: Choosing analyses
    • Challenge 5: Interpreting the findings
  • Best practices
    • Explore writing processes
    • Choose a program that suits your needs
    • Consider orthography
    • Keep variables constant and include baseline tasks
  • Future avenues
  • References
Published online: 23 October 2023
DOI logo
https://doi.org/10.1075/rmal.5.08joh
References
Abdel Latif, M. M.
(2008) A state-of-the-art review of the real-time computer-aided study of the writing process. International Journal of English Studies, 8(1), 29–50. Retrieved on 27 April 2023 from [URL]Google Scholar
Alves, R. A., Castro, S. L., de Sousa, L., & Strömqvist, S.
(2007) Influence of keyboarding skill on pause- execution cycles in written composition. In M. Torrance, L. Van Waes, & D. Galbraith (Eds.), Writing and cognition: Research and applications (pp. 55–65). Elsevier. DOI logoGoogle Scholar
Barkaoui, K.
(2019) What can L2 writers’ pausing behavior tell us about their L2 writing processes? Studies in Second Language Acquisition, 41, 529–554. DOI logoGoogle Scholar
Bowen, N. E. J. A., & Thomas, N.
(2020) Manipulating texture and cohesion in academic writing: A keystroke logging study. Journal of Second Language Writing, 50. DOI logoGoogle Scholar
Bowen, N. E. J. A., Thomas, N., & Vandermeulen, N.
(2022) Exploring feedback and regulation in online writing classes with keystroke logging. Computers and Composition, 63. DOI logoGoogle Scholar
Carl, M.
(2012) Translog – II: A program for recording user activity data for empirical reading and writing research. InProceedings of the Eight International Conference on Language Resources and Evaluation, European Language Resources Association (ELRA). Retrieved on 27 April 2023 from [URL]
Chenoweth, N. A., & Hayes, J. R.
(2001) Fluency in writing: Generating text in L1 and L2. Written Communication, 18, 80–98. DOI logoGoogle Scholar
Chukharev-Hudalainen, E.
(2019) Empowering automated writing evaluation with keystroke logging. In E. Lindgren, Y. Knospe, & K. P. Sullivan (Eds.), Observing writing: insights from keystroke logging and handwriting (pp. 125–142). Brill.Google Scholar
Conijn, R., Cook, C., van Zaanen, M., & Van Waes, L.
(2022) Early prediction of writing quality using keystroke logging. International Journal of Artificial Intelligence in Education, 32, 835–866. DOI logoGoogle Scholar
Galbraith, D., & Vedder, I.
(2019) Methodological advances in investigating L2 writing processes. Studies in Second Language Acquisition, 41, 633–645. DOI logoGoogle Scholar
Gunnarsson, C.
(2006) Fluidité, complexité et morphosyntaxe dans la production écrite en FLE (Études Romanes de Lund 78, doctoral dissertation). Lund University.
Hayes, J. R., & Flower, L.
(1980) Identifying the organisation of the writing process. In L. W. Gregg & E. R. Steinberg (Eds.), Cognitive processes in writing (pp. 3–30). Lawrence Erlbaum Associates.Google Scholar
Kellogg, R. T.
(1996) A model of working memory in writing. In C. M. Levy & S. E. Ransdell (Eds.), The science of writing (pp. 57–71). Lawrence Erlbaum Associates.Google Scholar
Kim, M., Tian, Y. Crossley, S. A.
(2021) Exploring the relationships among cognitive and linguistic resources, writing processes, and written products in second language writing. Journal of Second Language Writing, 53. DOI logoGoogle Scholar
Leijten, M., & Van Waes, L.
(2013) Keystroke logging in writing research: Using Inputlog to analyze and visualize writing processes. Written Communication, 30, 358–392. DOI logoGoogle Scholar
Leijten, M., Van Waes, L., Schriver, K., & Hayes, J. R.
(2014) Writing in the work-place: Constructing documents using multiple digital sources. Journal of Writing Research, 5(3), 285–337. DOI logoGoogle Scholar
Levy, C. M., & Ransdell, S.
(1994) Computer-aided protocol analysis of writing processes. Behavior Research Methods, Instruments, & Computers, 26(2), 219–223. DOI logoGoogle Scholar
Lindgren, E., Spelman Miller, K., & Sullivan, K. P. H.
(2008) Development of fluency and revision in L1 and L2 writing in Swedish high school years eight and nine. International Journal of Applied Linguistics, 156, 133–151. DOI logoGoogle Scholar
Lindgren, E., & Sullivan, K. P. H.
(2006) Analysing on-line revision. In K. P. H. Sullivan & E. Lindgren (Eds.), Computer keystroke-logging and writing: Methods and applications (pp. 157–188). Elsevier. DOI logoGoogle Scholar
Lindgren, E., & Sullivan, K.
(Eds.) (2019) Observing writing: Insights from keystroke logging and handwriting. Brill. DOI logoGoogle Scholar
Lu, X., & Révész, A.
(2021) Revising in a non-alphabetic language: The multi-dimensional and dynamic nature of online revisions in Chinese as a second language. System, 100. DOI logoGoogle Scholar
Lykke Jakobsen, A.
(1999) Logging target text production with Translog. In Hansen, G. (Ed.), Probing the process in translation: Methods and results (pp 9–20). Samfundslitteratur.Google Scholar
Palviainen, Å., Kalaja, P., & Mäntylä, K.
(2012) Development of L2 writing: Fluency and proficiency. AFinLA-E: Soveltavan Kielitieteen Tutkimuksia, 4, 47–59.Google Scholar
Ramírez Maraver, R.
(2021) L1 and L2 language processing in written production and perception: Null objects in English, Portuguese and Spanish (Unpublished MA thesis), Lund University.
Révész, A., & Michel, M.
(2019) State of scholarship. Introduction. Studies in Second Language Acquisition 41, 491–501. DOI logoGoogle Scholar
Révész, A., Kourtali, N. E., & Mazgutova, D.
(2017) Effects of task complexity on L2 writing behaviors and linguistic complexity. Language Learning, 67, 208–241. DOI logoGoogle Scholar
Severinson Eklundh, K. S., & Kollberg, P.
(1992) Translating keystroke records into a general notation for the writing process (IPLab-59). Department of Numerical Analysis and Computing Science, Royal Institute of Technology, Stockholm.Google Scholar
Simpson, S., & Torrance, M.
(2007) EyeWrite (Version 5.1). Unpublished report, Nottingham Trent University, SR Research.Google Scholar
Spelman Miller, K.
(2006a) Pausing, productivity and the processing of topic in online writing. In K. P. H. Sullivan & E. Lindgren (Eds.), Computer keystroke logging and writing: Methods and applications (pp. 131–156). Elsevier. DOI logoGoogle Scholar
(2006b) The pausological study of written language production. In K. P. H. Sullivan & E. Lindgren (Eds.), Computer keystroke logging and writing: Methods and applications (pp. 11–30). Elsevier. DOI logoGoogle Scholar
Spelman Miller, K., Lindgren, E. & Sullivan. K. P. H.
(2008) The psycholinguistic dimension in second language writing: Opportunities for research and pedagogy using computer keystroke logging. TESOL Quarterly, 42(3), 433–454. [URL]. DOI logoGoogle Scholar
Spelman Miller, K., & Sullivan, K. P. H.
(2006) Keystroke logging: An introduction. In K. P. H. Sullivan & E. Lindgren (Eds.), Computer keystroke logging and writing methods and applications (pp. 1–9). Elsevier.Google Scholar
Stevenson, M., Schoonen, R., & de Glopper, K.
(2006) Revising in two languages: A multi-dimensional comparison of online writing revisions in L1 and FL. Journal of Second Language Writing, 15(3), 201–233. DOI logoGoogle Scholar
Strömqvist, S., Holmqvist, K., Johansson, V., Karlsson, H., & Wengelin, Å.
(2006) What Keystroke logging can reveal about writing. In K. P. H. Sullivan & E. Lindgren (Eds.) Computer keystroke logging: Methods and applications (pp. 45–71). Elsevier. DOI logoGoogle Scholar
Strömqvist, S., & Karlsson, H.
(2001) ScriptLog for windows – User’s manual. Technical report, Department of Linguistics, Lund University and Centre for Reading Research, University College of Stavanger.Google Scholar
Strömqvist, S., & Malmsten, L.
(1997) Scriptlog Pro 1.04 – user’s manual. Department of Linguistics, University of Gothenburg.Google Scholar
Sullivan, K. P. H., & Lindgren, E.
(Eds) (2006) Computer keystroke logging and writing: Methods and applications. Elsevier. DOI logoGoogle Scholar
Thorson, H.
(2000) Using the computer to compare foreign- and native-language writing processes: A statistical and case study approach. Modern Language Journal, 84, 55–70. DOI logoGoogle Scholar
Tiryakioglu, G., Peters, E., Verschaffel, L., Sullivan, K., & Lindgren, E.
(2019) The effect of L2 proficiency level on composing processes of EFL learners: Data from keystroke loggings, think alouds and questionnaires. In E. Lindgren & K. Sullivan (Eds.). Observing writing: Insights from keystroke logging and handwriting (pp. 212 – 235). Brill. DOI logoGoogle Scholar
Usoof, H. A., Leblay, C. & Caporossi, G.
2020 GenoGraphiX-Log version 2.0 user guide, Les Cahiers du GERAD.Google Scholar
Vandermeulen, N., Leijten, M., & Van Waes, L.
(2020) Reporting writing process feedback in the classroom: Using keystroke logging data to reflect on writing processes. Journal of Writing Research, 12(1), 109–140. DOI logoGoogle Scholar
Van Waes, L., Leijten, M., Lindgren, E., & Wengelin, Å.
(2016) Keystroke logging in writing research. Analyzing online writing processes. In C. A. MacArthur, S. Graham, & J. Fitzgerald (Eds.), Handbook of writing research (pp. 410–426). Guilford Publications.Google Scholar
Van Waes, L., Leijten, M., Roeser, J. Olive, T., & Grabowski, J.
(2021) Measuring and assessing typing skills in writing research. Journal of Writing Research, 13(1), 107–153. DOI logoGoogle Scholar
Wengelin, A.
(2006) Examining pauses in writing: Theory, methods and empirical data. In K. P. H. Sullivan & E. Lindgren (Eds.), Computer key-stroke logging: Methods and applications (pp. 107–130). Elsevier. DOI logoGoogle Scholar
Wengelin, Å., Frid, J., Johansson, R., Johansson, V.
(2019) Combining keystroke logging with other methods: Towards an experimental environment for writing process research. In E. Lindgren & K. Sullivan (Eds.). Observing writing: Insights from keystroke logging and handwriting (pp. 30–49). Brill.Google Scholar
Wengelin, Å., & Johansson, V.
(2023) Investigating writing processes with keystroke logging. In O. Kruse, C. Rapp, C. M. Anson, K. Benetos, E. Cotos, A Devitt, & A. Shibani. (Eds.) Digital writing technologies: Impact on theory, research, and practice in higher education. Springer. DOI logoGoogle Scholar
Xu, C.
(2018) Understanding online revisions in L2 writing: A computer keystroke-log perspective. System, 78, 104–114. DOI logoGoogle Scholar
Xu, C., & Ding, Y.
(2014) An exploratory study of pauses in computer-assisted EFL writing. Language Learning & Technology, 18(3), 80–96. [URL]Google Scholar
Xu, C., & Qi, Y.
(2017) Analyzing pauses in computer-assisted EFL writing: A computer-keystroke-log perspective. Journal of Educational Technology and Society, 20, 24–34. [URL]Google Scholar