Chapter 12
Investigating cognitive processes during writing tests
Methodological considerations when triangulating data from eye
tracking, keystroke logging, and stimulated recalls
The purpose of this chapter is to critically discuss
some of the key issues when investigating writing processes for the purposes
of foreign language assessment research – a branch of research that
currently tends to triangulate synchronous observational data (e.g., eye
tracking, keystroke logging) with asynchronous data from stimulated verbal
recalls or text analysis. We will discuss a range of methodological
considerations that should be taken into account when researching foreign
language writing processes in the context of language tests and beyond. We
will exemplify and critically discuss key issues related to three of the
methods predominantly used in this strand of research: eye tracking,
keystroke logging, and stimulated recalls. We will illustrate these issues
and decision-making processes at the various stages of research by
critically reflecting on the lessons learned from two research projects of
this kind conducted by the authors.
Article outline
- Introduction
- Rationales and aims of process-tracing methods in language testing
research
- Overview of research programme
- Methodological decisions taken, challenges experienced, and solutions
adopted
- Systematising elicitation procedures for stimulated recalls
- Defining pause length thresholds
- Interpreting keystroke-logging data
- Interpreting stimulated recall data
- Comparing writing processes across languages
- Conclusion
-
References