Cover not available
Part of
Research Methods in the Study of L2 Writing Processes
Edited by Rosa M. Manchón and Julio Roca de Larios
[Research Methods in Applied Linguistics 5] 2023
► pp. 183–200

Chapter 9
Using eye tracking to study digital writing processes

| Lund University * | Kristianstad University 1
| Lund University *
| University of Gothenburg #

This chapter presents an overview of eye tracking combined with tools for capturing digital writing (foremost keystroke logging). This includes a general rationale for why eye tracking is relevant for research on writing processes, how the technique works, and pros and cons of different eye trackers and methodological designs. The chapter describes previous L1 and L2 writing studies which have used eye tracking to illustrate the type of questions that can be addressed by this technique. Finally, some methodological challenges are highlighted and best practices are suggested. It is emphasized that information of writers’ visual attention can enrich real-time writing studies, but that the researcher must pose research questions and opt for designs bearing in mind the advantages and limitations of the technique.

Article outline
  • Introduction
  • Introducing eye tracking technology
    • How does eye tracking work?
    • Eye tracking and writing research
  • Research questions addressed in eye tracking writing studies
    • Theoretical frameworks as a source for research questions
    • Research questions addressing reading during writing
  • Methodological challenges
    • Challenge 1: Choosing eye tracker for your purpose
    • Challenge 2: Compensating for the dynamic writer and the dynamic text
    • Challenge 3: Choosing method for capturing writing processes
    • Challenge 4: Asking questions and drawing conclusions from eye tracking studies
  • Best practices in using eye tracking in writing studies
  • Future avenues
  • Notes
  • References
Published online: 23 October 2023
DOI logo
https://doi.org/10.1075/rmal.5.09joh
References
Alamargot, D., Caporossi, G., Chesnet, D., & Ros, C.
(2011) What makes a skilled writer? Working memory and audience awareness during text composition. Learning and Individual Differences 21, 505–516. DOI logoGoogle Scholar
Alamargot, D., Chesnet, D., Dansac, C., & Ros, C.
(2006) Eye and pen: A new device for studying reading during writing. Behavior Research Methods, Instruments, & Computers, 38(2), 287–299. DOI logoGoogle Scholar
Alves, F., Pagano, A., & Da Silva, I.
(2010) A new window on translator’s cognitive activity: Methodological issues in the combined use of eye tracking, key logging and retrospective protocols. In I. Mees, F. Alves, & S. Göpferich (Eds.), Methodology, technology and innovation in translation process research (pp. 267–292). Samfundslitteratur.Google Scholar
Andersson, B., Dahl, J., Holmqvist, K., Holsanova, J., Johansson, V., Karlsson, H., Strömqvist, S., Tufvesson, S., & Wengelin, Å.
(2006) Combining keystroke logging with eye tracking. In L. Van Waes, M. Leijten, & C. Neuwirth (Eds.), Writing and digital media (pp. 166–172). Elsevier.Google Scholar
Barkaoui, K.
(2019) What can L2 writers’ pausing behavior tell us about their L2 writing processes? Studies in Second Language Acquisition, 41, 529–554. DOI logoGoogle Scholar
Beers, S. F., Quinlan, T., & Harbaugh, A. G.
(2010) Adolescent students’ reading during writing behaviors and relationships with text quality: An eyetracking study. Reading and Writing, 23, 743–775. DOI logoGoogle Scholar
Chukharev-Hudilainen, E., Saricaoglu, A., Torrance, M., & Feng, H.
(2019) Combined deployable keystroke logging and eyetracking for investigating L2 writing fluency. Studies in Second Language Acquisition, 41(3), 583–604. DOI logoGoogle Scholar
Conklin, K., & Pellicer-Sánchez, A.
(2016) Using eye- tracking in applied linguistics and second language research. Second Language Research, 32(3), 453–467. DOI logoGoogle Scholar
Conklin, K., Pellicer-Sánchez, A., & Carrol, G.
(2018) Eye tracking: A guide for applied linguistics research. Cambridge University Press. DOI logoGoogle Scholar
De Smet, M. J. R., Leijten, M., & Van Waes, L.
(2018) Exploring the process of reading during writing using eye tracking and keystroke logging. Written Communication, 35(4), 411–447. DOI logoGoogle Scholar
Drijbooms, E., Groen, M. A., Alamargot, D., & Verhoeven, L.
(2019) Online management of text production from pictures: A comparison between fifth graders and undergraduate students. Psychological Research, 84, 2311–2324. DOI logoGoogle Scholar
Engbert, R., Longtin, A., & Kliegl, R.
(2002) A dynamical model of saccade generation in reading based on spatially distributed lexical processing. Vision Research, 42(5), 621–636. DOI logoGoogle Scholar
Galbraith, D., & Vedder, I.
(2019) Methodological advances in investigating L2 writing processes. Studies in Second Language Acquisition 41, 633–645. DOI logoGoogle Scholar
Gánem-Gutiérrez, G. A., & Gilmore, A.
(2018) Tracking the real-time evolution of a writing event: Second language writers at different proficiency levels. Language Learning, 68, 469–506. DOI logoGoogle Scholar
Godfroid, A.
(2020) Eye tracking in second language acquisition and bilingualism. Routledge.Google Scholar
Godfroid, A., & Hui, B.
(2020) Five common pitfalls in eye tracking research. Second Language Research, 36(3), 277–305. DOI logoGoogle Scholar
Godfroid, A., & Spino, L. A.
(2015) Reconceptualizing reactivity of think-alouds and eye tracking: Absence of evidence is not evidence of absence. Language Learning, 65(4), 896–928. DOI logoGoogle Scholar
Godfroid, A., Winke, P., & Conklin, K.
(2020) Exploring the depths of second language processing with eye tracking: An introduction. Second Language Research, 36(3), 243–255. DOI logoGoogle Scholar
Hacker, D. J., Keener, M. C., & Kircher, J. C.
(2017) TRAKTEXT: Investigating writing processes using eye-tracking technology. Methodological Innovations, 10(2), 1–18. DOI logoGoogle Scholar
Hayes, J. R.
(1996) A new framework for understanding cognition and affect in writing. In C. M. Levy & S. E. Ransdell (Eds.), The science of writing: Theories, methods, individual differences, and applications (pp. 1–27). Lawrence Erlbaum Associates.Google Scholar
Hayes, J. R., & Flower, L.
(1980) Identifying the organisation of the writing process. In L. W. Gregg & E. R. Steinberg (Eds.), Cognitive processes in writing (pp. 3–30). Lawrence Erlbaum Associates.Google Scholar
Holmqvist, K., Holsanova, J., Johansson V. & Strömqvist, S.
(2004) Perceiving and producing the Frog Story. In D. Ravid & H. Bat-Zeev Shyldkrot (Eds.), Perspectives on language and language development. Essays in honor of Ruth A. Berman (pp. 293–306). Kluwer.Google Scholar
Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., & Van de Weijer, J.
(2011) Eye tracking: A comprehensive guide to methods and measures. Oxford University Press.Google Scholar
Holmqvist, K., Nyström, M., & Mulvey, F.
(2012) Eye tracker data quality: What it is and how to measure it. Proceedings of the Symposium on Eye Tracking Research and Applications (pp. 45–52). DOI logoGoogle Scholar
Johansson, R., Wengelin, Å., Johansson, V., & Holmqvist, K.
(2010) Looking at the keyboard or the monitor: Relationship with text production processes. Reading and Writing, 23(7), 835–851. DOI logoGoogle Scholar
Just, M. A., & Carpenter, P. A.
(1980) A theory of reading: From eye fixations to comprehension. Psychological Review 87, 329–54. DOI logoGoogle Scholar
Kellogg, R. T.
(1996) A model of working memory in writing. In C. M. Levy & S. E. Ransdell (Eds.), The science of writing (pp. 57–71). Lawrence Erlbaum Associates.Google Scholar
Larsson, L., Nyström, M., Andersson, R., & Stridh, M.
(2015) Detection of fixations and smooth pursuit movements in high-speed eye tracking data. Biomedical Signal Processing and Control, 18, 145–152. DOI logoGoogle Scholar
Leijten, M., & Van Waes, L.
(2013) Keystroke logging in writing research: Using Inputlog to analyze and visualize writing processes. Written Communication, 30, 358–392. DOI logoGoogle Scholar
Leijten, M., Van Waes, L., Schrijver, I., Bernolet, S., & Vangehuchten, L.
(2019) Mapping master’s students’ use of external sources in source-based writing in L1 and L2. Studies in Second Language Acquisition, 41, 555–582. DOI logoGoogle Scholar
Leijten, M., Van Waes, L., Schriver, K., & Hayes, J. R.
(2014) Writing in the work-place: Constructing documents using multiple digital sources. Journal of Writing Research, 5(3), 285–337. DOI logoGoogle Scholar
Lindgren, E., & Sullivan, K.
(Eds.) (2019) Observing writing: Insights from keystroke logging and handwriting. Brill. DOI logoGoogle Scholar
Manchón, R. M., Roca de Larios, J., & Murphy, L.
(2000) An approximation to the study of backtracking in L2 writing. Learning and Instruction, 10(1), 13–35. DOI logoGoogle Scholar
Matsuhashi, A.
(1981) Pausing and planning: The tempo of written discourse production. Research in the Teaching of English, 15, 113–134. [URL]Google Scholar
Michel, M. Révész, A., Lu, X, Kourtali, N. -E., Lee, M. & Borges, L.
(2020) Investigating L2 writing processes across independent and integrated tasks: A mixed-methods study. Second Language Research, 36(3), 307–334. DOI logoGoogle Scholar
Nottbusch, G.
(2010) Grammatical planning, execution, and control in written sentence production. Reading and Writing, 23(7), 777–801. DOI logoGoogle Scholar
Posner, M. I.
(1980) Orienting of attention. Quarterly Journal of Experimental Psychology, 32, 3–25. DOI logoGoogle Scholar
Rayner, K.
(1998) Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124(3), 372–422. DOI logoGoogle Scholar
Rayner, K., Pollatsek, A., Ashby, J., & Clifton Jr., C.
(2012) The psychology of reading. Psychology Press. DOI logoGoogle Scholar
Révész, A., & Michel, M.
(2019) Introduction to the special issue. Studies in Second Language Acquisition, 41, 491–501. DOI logoGoogle Scholar
Révész, A., Michel, M., & Lee, M.
(2017) Investigating IELTS Academic Writing Task 2: Relationships between cognitive writing processes, text quality, and working memory. British Council, Cambridge English Language Assessment and IDP.
(2019) Exploring second language writers’ pausing and revision behaviors: A mixed-methods study. Studies in Second Language Acquisition, 41(3), 605–631. DOI logoGoogle Scholar
Semmelmann, K., & Weigelt, S.
(2018) Online webcam-based eye tracking in cognitive science: A first look. Behavior Research Methods, 50(2), 451–465. DOI logoGoogle Scholar
Shintani, N., & Ellis, R.
(2013) The comparative effect of direct written corrective feedback and metalinguistic explanation on learners’ explicit and implicit knowledge of the English indefinite article. Journal of Second Language Writing, 22(3), 286–306. DOI logoGoogle Scholar
Simpson, S., & Torrance, M.
(2007) EyeWrite (Version 5.1). Unpublished report, Nottingham Trent University, SR Research.
Smith, B.
(2012) Eye tracking as a measure of noticing: A study of explicit recasts in SCMC. Language Learning & Technology, 16(3), 53–81. [URL]Google Scholar
Spelman Miller, K., Lindgren, E. & Sullivan. K. P. H.
(2008) The psycholinguistic dimension in second language writing: Opportunities for research and pedagogy using computer keystroke logging. TESOL Quarterly, 42(3), 433–454. DOI logoGoogle Scholar
Torrance, M., Johansson, R., Johansson, V., & Wengelin, Å.
(2016) Reading during the composition of multi-sentence texts: An eye-movement study. Psychological Research, 80, 729–743. DOI logoGoogle Scholar
Torrance, M., & Nottbusch, G.
(2012) Written production of single words and simple sentences. In V.W. Berninger (Ed.), Past, present, and future contributions of cognitive writing research to cognitive psychology. Psychology Press.Google Scholar
Van Waes, L., Leijten, M., & Quinlan, T.
(2010) Reading during sentence composing and error correction: A multilevel analysis of the influences of task complexity. Reading and Writing, 23(7), 803–834. DOI logoGoogle Scholar
Van Waes, L., Leijten, M., Roeser, J. Olive, T., & Grabowski, J.
(2021) Measuring and assessing typing skills in writing research. Journal of Writing Research, 13(1), 107–153. DOI logoGoogle Scholar
Wengelin, Å., Frid, J., Johansson, R., & Johansson, V.
(2019) Combining keystroke logging with other methods: Towards an experimental environment for writing process research. In E. Lindgren & K. Sullivan (Eds.), Observing writing: Insights from keystroke logging and handwriting (pp. 30–49). Brill.Google Scholar
Wengelin, Å., Johansson, R., & Johansson, V.
(2014) Expressive writing in Swedish 15-year-olds with reading and writing difficulties. In B. Arfé, J. Dockrell, & V.W. Berninger (Eds.), Writing development and instruction in children with hearing, speech and oral language difficulties (pp. 242–269). Oxford University Press. DOI logoGoogle Scholar
Wengelin, Å., Torrance, M., Holmqvist, K., Simpson, S., Galbraith, D., Johansson, V., & Johansson, R.
(2009) Combined eye tracking and keystroke-logging methods for studying cognitive processes in text production. Behavior Research Methods, 41(2), 337–351. DOI logoGoogle Scholar