Chapter 9
Using eye tracking to study digital writing processes
This chapter presents an overview of eye tracking
combined with tools for capturing digital writing (foremost keystroke
logging). This includes a general rationale for why eye tracking is relevant
for research on writing processes, how the technique works, and pros and
cons of different eye trackers and methodological designs. The chapter
describes previous L1 and L2 writing studies which have used eye tracking to
illustrate the type of questions that can be addressed by this technique.
Finally, some methodological challenges are highlighted and best practices
are suggested. It is emphasized that information of writers’ visual
attention can enrich real-time writing studies, but that the researcher must
pose research questions and opt for designs bearing in mind the advantages
and limitations of the technique.
Article outline
- Introduction
- Introducing eye tracking technology
- How does eye tracking work?
- Eye tracking and writing research
- Research questions addressed in eye tracking writing studies
- Theoretical frameworks as a source for research questions
- Research questions addressing reading during writing
- Methodological challenges
- Challenge 1: Choosing eye tracker for your purpose
- Challenge 2: Compensating for the dynamic writer and the dynamic
text
- Challenge 3: Choosing method for capturing writing processes
- Challenge 4: Asking questions and drawing conclusions from eye tracking
studies
- Best practices in using eye tracking in writing studies
- Future avenues
-
Notes
-
References
References (54)
References
Alamargot, D., Caporossi, G., Chesnet, D., & Ros, C. (2011). What
makes a skilled writer? Working memory and audience awareness during
text composition. Learning and
Individual
Differences 21, 505–516. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Alamargot, D., Chesnet, D., Dansac, C., & Ros, C. (2006). Eye
and pen: A new device for studying reading during
writing. Behavior Research Methods,
Instruments, &
Computers, 38(2), 287–299. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Alves, F., Pagano, A., & Da Silva, I. (2010). A
new window on translator’s cognitive activity: Methodological issues
in the combined use of eye tracking, key logging and retrospective
protocols. In I. Mees, F. Alves, & S. Göpferich (Eds.), Methodology,
technology and innovation in translation process
research (pp. 267–292). Samfundslitteratur.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Andersson, B., Dahl, J., Holmqvist, K., Holsanova, J., Johansson, V., Karlsson, H., Strömqvist, S., Tufvesson, S., & Wengelin, Å. (2006). Combining
keystroke logging with eye
tracking. In L. Van Waes, M. Leijten, & C. Neuwirth (Eds.), Writing
and digital
media (pp. 166–172). Elsevier.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Barkaoui, K. (2019). What
can L2 writers’ pausing behavior tell us about their L2 writing
processes? Studies in Second Language
Acquisition, 41, 529–554. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Beers, S. F., Quinlan, T., & Harbaugh, A. G. (2010). Adolescent
students’ reading during writing behaviors and relationships with
text quality: An eyetracking
study. Reading and
Writing, 23, 743–775. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Chukharev-Hudilainen, E., Saricaoglu, A., Torrance, M., & Feng, H. (2019). Combined
deployable keystroke logging and eyetracking for investigating L2
writing fluency. Studies in Second
Language
Acquisition, 41(3), 583–604. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Conklin, K., & Pellicer-Sánchez, A. (2016). Using
eye- tracking in applied linguistics and second language
research. Second Language
Research, 32(3), 453–467. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Conklin, K., Pellicer-Sánchez, A., & Carrol, G. (2018). Eye
tracking: A guide for applied linguistics
research. Cambridge University Press. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
De Smet, M. J. R., Leijten, M., & Van Waes, L. (2018). Exploring
the process of reading during writing using eye tracking and
keystroke logging. Written
Communication, 35(4), 411–447. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Drijbooms, E., Groen, M. A., Alamargot, D., & Verhoeven, L. (2019). Online
management of text production from pictures: A comparison between
fifth graders and undergraduate
students. Psychological
Research, 84, 2311–2324. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Engbert, R., Longtin, A., & Kliegl, R. (2002). A
dynamical model of saccade generation in reading based on spatially
distributed lexical
processing. Vision
Research, 42(5), 621–636. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Galbraith, D., & Vedder, I. (2019). Methodological
advances in investigating L2 writing
processes. Studies in Second Language
Acquisition 41, 633–645. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Gánem-Gutiérrez, G. A., & Gilmore, A. (2018). Tracking
the real-time evolution of a writing event: Second language writers
at different proficiency
levels. Language
Learning, 68, 469–506. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Godfroid, A. (2020). Eye
tracking in second language acquisition and
bilingualism. Routledge.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Godfroid, A., & Hui, B. (2020). Five
common pitfalls in eye tracking
research. Second Language
Research, 36(3), 277–305. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Godfroid, A., & Spino, L. A. (2015). Reconceptualizing
reactivity of think-alouds and eye tracking: Absence of evidence is
not evidence of absence. Language
Learning, 65(4), 896–928. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Godfroid, A., Winke, P., & Conklin, K. (2020). Exploring
the depths of second language processing with eye tracking: An
introduction. Second Language
Research, 36(3), 243–255. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Hacker, D. J., Keener, M. C., & Kircher, J. C. (2017). TRAKTEXT:
Investigating writing processes using eye-tracking
technology. Methodological
Innovations, 10(2), 1–18. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Hayes, J. R. (1996). A
new framework for understanding cognition and affect in
writing. In C. M. Levy & S. E. Ransdell (Eds.), The
science of writing: Theories, methods, individual differences, and
applications (pp. 1–27). Lawrence Erlbaum Associates.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Hayes, J. R., & Flower, L. (1980). Identifying
the organisation of the writing
process. In L. W. Gregg & E. R. Steinberg (Eds.), Cognitive
processes in
writing (pp. 3–30). Lawrence Erlbaum Associates.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Holmqvist, K., Holsanova, J., Johansson V. & Strömqvist, S. (2004). Perceiving
and producing the Frog
Story. In D. Ravid & H. Bat-Zeev Shyldkrot (Eds.), Perspectives
on language and language development. Essays in honor of Ruth A.
Berman (pp. 293–306). Kluwer.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., & Van de Weijer, J. (2011). Eye
tracking: A comprehensive guide to methods and
measures. Oxford University Press.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Holmqvist, K., Nyström, M., & Mulvey, F. (2012). Eye
tracker data quality: What it is and how to measure
it. Proceedings of the Symposium on
Eye Tracking Research and
Applications (pp. 45–52). ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Johansson, R., Wengelin, Å., Johansson, V., & Holmqvist, K. (2010). Looking
at the keyboard or the monitor: Relationship with text production
processes. Reading and
Writing, 23(7), 835–851. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Just, M. A., & Carpenter, P. A. (1980). A
theory of reading: From eye fixations to
comprehension. Psychological
Review 87, 329–54. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Kellogg, R. T. (1996). A
model of working memory in
writing. In C. M. Levy & S. E. Ransdell (Eds.), The
science of
writing (pp. 57–71). Lawrence Erlbaum Associates.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Larsson, L., Nyström, M., Andersson, R., & Stridh, M. (2015). Detection
of fixations and smooth pursuit movements in high-speed eye tracking
data. Biomedical Signal Processing
and
Control, 18, 145–152. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Leijten, M., & Van Waes, L. (2013). Keystroke
logging in writing research: Using Inputlog to analyze and visualize
writing processes. Written
Communication, 30, 358–392. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Leijten, M., Van Waes, L., Schrijver, I., Bernolet, S., & Vangehuchten, L. (2019). Mapping
master’s students’ use of external sources in source-based writing
in L1 and L2. Studies in Second
Language
Acquisition, 41, 555–582. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Leijten, M., Van Waes, L., Schriver, K., & Hayes, J. R. (2014). Writing
in the work-place: Constructing documents using multiple digital
sources. Journal of Writing
Research, 5(3), 285–337. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Lindgren, E., & Sullivan, K. (Eds.). (2019). Observing
writing: Insights from keystroke logging and
handwriting. Brill. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Manchón, R. M., Roca de Larios, J., & Murphy, L. (2000). An
approximation to the study of backtracking in L2
writing. Learning and
Instruction, 10(1), 13–35. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Matsuhashi, A. (1981). Pausing
and planning: The tempo of written discourse
production. Research in the Teaching
of
English, 15, 113–134. [URL]![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Michel, M. Révész, A., Lu, X, Kourtali, N. -E., Lee, M. & Borges, L. (2020). Investigating
L2 writing processes across independent and integrated tasks: A
mixed-methods study. Second Language
Research, 36(3), 307–334. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Nottbusch, G. (2010). Grammatical
planning, execution, and control in written sentence
production. Reading and
Writing, 23(7), 777–801. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Posner, M. I. (1980). Orienting
of attention. Quarterly Journal of
Experimental
Psychology, 32, 3–25. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Rayner, K. (1998). Eye
movements in reading and information processing: 20 years of
research. Psychological
Bulletin, 124(3), 372–422. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Rayner, K., Pollatsek, A., Ashby, J., & Clifton Jr., C. (2012). The
psychology of reading. Psychology Press. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Révész, A., & Michel, M. (2019). Introduction
to the special issue. Studies in
Second Language
Acquisition, 41, 491–501. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Révész, A., Michel, M., & Lee, M. (2017). Investigating
IELTS Academic Writing Task 2: Relationships between
cognitive writing processes, text quality, and working
memory. British Council, Cambridge English Language Assessment and IDP.
Révész, A., Michel, M., & Lee, M. (2019). Exploring
second language writers’ pausing and revision behaviors: A
mixed-methods study. Studies in
Second Language
Acquisition, 41(3), 605–631. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Semmelmann, K., & Weigelt, S. (2018). Online
webcam-based eye tracking in cognitive science: A first
look. Behavior Research
Methods, 50(2), 451–465. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Shintani, N., & Ellis, R. (2013). The
comparative effect of direct written corrective feedback and
metalinguistic explanation on learners’ explicit and implicit
knowledge of the English indefinite
article. Journal of Second Language
Writing, 22(3), 286–306. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Simpson, S., & Torrance, M. (2007). EyeWrite (Version
5.1). Unpublished
report, Nottingham Trent University,
SR Research.
Smith, B. (2012). Eye
tracking as a measure of noticing: A study of explicit recasts in
SCMC. Language Learning &
Technology, 16(3), 53–81. [URL]![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Spelman Miller, K., Lindgren, E. & Sullivan. K. P. H. (2008). The
psycholinguistic dimension in second language writing: Opportunities
for research and pedagogy using computer keystroke
logging. TESOL
Quarterly, 42(3), 433–454. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Torrance, M., Johansson, R., Johansson, V., & Wengelin, Å. (2016). Reading
during the composition of multi-sentence texts: An eye-movement
study. Psychological
Research, 80, 729–743. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Torrance, M., & Nottbusch, G. (2012). Written
production of single words and simple
sentences. In V.W. Berninger (Ed.), Past,
present, and future contributions of cognitive writing research to
cognitive psychology. Psychology Press.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Van Waes, L., Leijten, M., & Quinlan, T. (2010). Reading
during sentence composing and error correction: A multilevel
analysis of the influences of task
complexity. Reading and
Writing, 23(7), 803–834. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Van Waes, L., Leijten, M., Roeser, J. Olive, T., & Grabowski, J. (2021). Measuring
and assessing typing skills in writing
research. Journal of Writing
Research, 13(1), 107–153. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Wengelin, Å., Frid, J., Johansson, R., & Johansson, V. (2019). Combining
keystroke logging with other methods: Towards an experimental
environment for writing process
research. In E. Lindgren & K. Sullivan (Eds.), Observing
writing: Insights from keystroke logging and
handwriting (pp. 30–49). Brill.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Wengelin, Å., Johansson, R., & Johansson, V. (2014). Expressive
writing in Swedish 15-year-olds with reading and writing
difficulties. In B. Arfé, J. Dockrell, & V.W. Berninger (Eds.), Writing
development and instruction in children with hearing, speech and
oral language
difficulties (pp. 242–269). Oxford University Press. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Wengelin, Å., Torrance, M., Holmqvist, K., Simpson, S., Galbraith, D., Johansson, V., & Johansson, R. (2009). Combined
eye tracking and keystroke-logging methods for studying cognitive
processes in text
production. Behavior Research
Methods, 41(2), 337–351. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)