Cover not available
Article published In:
Cognitive Translation and Interpreting Studies in the Early Twenty First Century
Edited by Adolfo M. García, Edinson Muñoz and Néstor Singer
[Translation, Cognition & Behavior 6:2] 2023
► pp. 164–186

Wearable eye trackers

Methodological challenges, opportunities and perspectives for sight interpreting/translation

ORCID logo | Dalian Maritime University
ORCID logo | University of Copenhagen
ORCID logo | Queen’s University Belfast
Sight interpreting/translation (SiT) refers to the mode of communication in which source language information is received via reading and target language output is produced either in oral form or sign language. The cognitive aspect of SiT has been examined empirically with participant-, product-, and process-oriented methods, as well as multi-method approaches. Previous SiT research has benefitted from eye tracking technology due to the dominance of visual input during SiT. However, previous studies have used screen-based eye trackers, where stimuli are confined to the screen, and the potential impact of elements beyond the screen cannot be captured, leading to an oversight of the interactional aspect of SiT. Thus, we suggest wearable eye trackers in future SiT studies to thoroughly explore the underlying cognitive mechanisms of this modality. Moreover, we argue that future SiT studies can benefit from triangulating eye tracking data with subjective data, such as interviews, to better understand SiT.
Keywords: sight interpreting/translation, wearable eye tracker, methodology, cognitive studies
Article outline
  • 1.Introduction
    • 1.1Cognitive SiT studies with participant-oriented methods
    • 1.2Cognitive SiT studies with product-oriented methods
    • 1.3Cognitive SiT studies with process-oriented methods
    • 1.4Cognitive SiT studies with multi-method approaches
  • 2.Wearable eye tracking equipment
    • 2.1Technological principles, types of equipment and indicators
    • 2.2Assumptions and hypotheses
  • 3.SiT and eye tracking glasses – reflections on data collection, management and analysis
    • 3.1Collecting eye tracking data for SiT studies
    • 3.2Managing eye tracking data in SiT studies
    • 3.3Combining eye tracking with other methods in SiT
  • 4.Wearable eye trackers in SiT: Potential and methodological considerations
    • 4.1The future of SiT and wearable eye trackers
  • Note
  • References
Published online: 7 March 2024
DOI logo
https://doi.org/10.1075/tcb.00084.xia
References (55)
References
Agrifoglio, Marjorie. 2004. “Sight Translation and Interpreting: A Comparative Analysis of Constraints and Failures.” Interpreting 6 (1): 43–67. DOI logoGoogle Scholar
Alves, Fabio, Adriana Pagano, and Igor Da Silva. 2011. “Towards an Investigation of Reading Modalities in/for Translation: An Exploratory Study Using Eye-tracking Data.” In Cognitive Explorations of Translation, edited by Sharon O’Brien, 175–196. London: Continuum International Publishing Group.Google Scholar
Blignaut, Pieter. 2009. “Fixation Identification: The Optimum Threshold for a Dispersion Algorithm.” Attention, Perception, & Psychophysics 71 (4): 881–895. DOI logoGoogle Scholar
Chang, Huei-Fang. 2008. “A Study on GITI Students’ ST Difficulty & Performance.” Spectrum: Studies in Language, Literature, Translation, and Interpretation 21: 61–83.Google Scholar
Chen, Sijia. 2017. “The Construct of Cognitive Load in Interpreting and its Measurement.” Perspectives 25 (4): 640–657. DOI logoGoogle Scholar
Chen, Sijia, Jan-Louis Kruger, and Stephen Doherty. 2021. “Reading Patterns and Cognitive Processing in an Eye-tracking Study of Note-reading in Consecutive Interpreting.” Interpreting 23 (1): 76–102. DOI logoGoogle Scholar
Chiang, Heien-Kun, Feng-Lan Kuo, and Wei-Chun Chen. 2009. “Exploring Pausing Patterns in Two-Way Sight Translation.” Spectrum: Studies in Language, Literature, Translation, and Interpretation 51: 155–168.Google Scholar
Chmiel, Agnieszka, Przemysław Janikowski, and Anna Cieślewicz. 2020. “The Eye or the Ear?: Source Language Interference in Sight Translation and Simultaneous Interpreting.” Interpreting 22 (2): 187–210. DOI logoGoogle Scholar
Dragsted, Barbara, and Inge G. Hansen. 2009. “Exploring Translation and Interpreting Hybrids. The Case of Sight Translation.” Meta: Journal des Traducteurs/Meta: Translators’ Journala 54 (3): 588–604. DOI logoGoogle Scholar
Ehrlich, Susan F., and Keith Rayner. 1981. “Contextual Effects on Word Perception and Eye Movements During Reading.” Journal of Verbal Learning and Verbal Behavior 20 (6): 641–655. DOI logoGoogle Scholar
Fang, Jing, and Jihong Wang. 2022. “Student Interpreters’ Strategies in Dealing with Unfamiliar Words in Sight Translation.” Translation & Interpreting 14 (1): 42–65. DOI logoGoogle Scholar
Fang, Jing, Xiaomin Zhang, and Haidee Kotze. 2022. “The Effects of Training on Reading Behaviour and Performance in Sight Translation: A Longitudinal Study Using Eye-Tracking.” Perspectives 31 (4): 1–17.Google Scholar
Gile, Daniel. 2009. Basic Concepts and Models for Interpreter and Translator Training. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Gorszczyńska, Paula. 2020. “Disfluencies in Sight Translation Vis-à-Vis Dominating Text Function: A Pilot Study Based on English-Polish Sight Translation Performed by Professional Interpreters.” Beyond Philology 17 (4): 95–130. DOI logoGoogle Scholar
Havnen, Randi. 2019. “Multimodal and Interactional Aspects of Sight Translation–A Critical Review.” FITISPos International Journal 6 (1): 91–106. DOI logoGoogle Scholar
He, Yan, and Yinying Hu. 2022. “Functional Connectivity Signatures Underlying Simultaneous Language Translation in Interpreters and Non-Interpreters of Mandarin and English: An fNIRS Study.” Brain Sciences 12 (2): 273. Accessed January 3, 2023. DOI logoGoogle Scholar
Ho, Chen-En. 2017. An Integrated Eye-Tracking Study into the Cognitive Process of English-Chinese Sight Translation: Impacts of Training and Experience. PhD Thesis, National Taiwan Normal University, Taipei.
. 2022. “Sight Translation/Interpreting.” Encyclopedia of Translation and Interpreting. Accessed December 10, 2022. [URL]
Ho, Chen-En, andJie-Li Tsai. 2020. “How does Training Shape English-Chinese Sight Translation Behaviour?: An Eyetracking Study.” Translation, Cognition & Behavior 3 (1): 1-24.Google Scholar
Ho, Chen-En, Kristian T. Hvelplund, and Yao Xiao. (Under review). “Exploring Interpreters’ Situation Awareness in Sight Interpreting/Translation Tasks.” Translation and Interpreting Studies.
Holmqvist, Kenneth., Marcus Nyström, Richard Andersson, Richard Dewhurst, Halszka Jarodzka, and Joost van de Weijer. 2011. Eye Tracking: A Comprehensive Guide to Methods and Measures. New York: Oxford University Press.Google Scholar
Hvelplund, Kristian T. 2014. “Eye Tracking and the Translation Process: Reflections on the Analysis and Interpretation of Eye-Tracking Data.” In Minding Translation, ed. by Ricardo Muñoz Martín, special issue of MonTI. Monografías de Traducción e Interpretación 11: 201–223.Google Scholar
Inhoff, Albrecht W., and Keith Rayner. 1986. “Parafoveal Word Processing During Eye Fixations in Reading: Effects of Word Frequency.” Perception & Psychophysics 40 (6): 431–439. DOI logoGoogle Scholar
Jakobsen, Arnt L., and Kristian T. H. Jensen. 2008. “Eye Movement Behaviour across Four Different Types of Reading Task.” In Looking at Eyes: Eye-Tracking Studies of Reading and Translation Processing, edited by Susanne Göpferich, Arnt L. Jakobsen, and Inger M. Mees, 103–124. Copenhagen: Samfundslitteratur.Google Scholar
Jiménez Ivars, Amparo. 2008. “Sight Translation and Written Translation. A Comparative Analysis of Causes of Problems, Strategies and Translation Errors within the PACTE Translation Competence Model.” FORUM. Revue internationale d’interprétation et de traduction/International Journal of Interpretation and Translation 6 (2): 79–104. Accessed February 15, 2023. DOI logoGoogle Scholar
Just, Marcel A., and Patricia A. Carpenter. 1980. “A Theory of Reading: From Eye Fixations to Comprehension.” Psychological Review, 87 (4): 329–354. Accessed March 1, 2023. DOI logoGoogle Scholar
Kokanova, Elena S., Maya M. Lyutyanskaya, and Anna S. Cherkasova. 2018. “Eye Tracking Study of Reading and Sight Translation.” SHS Web of Conferences, 50 (01080). Accessed January 8, 2023. DOI logoGoogle Scholar
Korpal, Paweł. 2012. “On Language-Pair Specificity in Sight Translation: An Eye-Tracking Study.” In Übersetzen in die Zukunft, edited by Wolfram Baur, Sylvia Kalina, Felix Mayer, and Jutta Witzel, 522–530. Berlin: BDÜ Fachverlag.Google Scholar
Lambert, Sylvie. 2004. “Shared Attention During Sight Translation, Sight Interpretation and Simultaneous Interpretation.” Meta: Journal des Traducteurs/Meta: Translators’ Journal 49 (2): 294–306. DOI logoGoogle Scholar
Lee, Jieun. 2012. “What Skills Do Student Interpreters Need to Learn in Sight Translation Training?” Meta: Journal des Traducteurs/Meta: Translators’ Journal 57 (3): 694–714. DOI logoGoogle Scholar
Lijewska, Agnieszka, Agnieszka Chmiel, and Albrecht W. Inhoff. 2022. “Stages of Sight Translation: Evidence from Eye Movements.” Applied Psycholinguistics 43 (5): 997–1018. Accessed January 3, 2023. DOI logoGoogle Scholar
Ma, Xingcheng, Dechao Li, and Yu-Yin Hsu. 2021. “Exploring the Impact of Word Order Asymmetry on Cognitive Load During Chinese–English Sight Translation.” Target 33 (1): 103–131. Accessed January 3, 2023. DOI logoGoogle Scholar
Ma, Xingcheng, Dechao Li, Jie-Li Tsai, and Yu-Yin Hsu. 2022. “An Eye-Tracking Based Investigation into Reading Behavior During Chinese-English Sight Translation: The Effect of Word Order Asymmetry.” Translation & Interpreting 14 (1): 66–83. DOI logoGoogle Scholar
O’Brien, Sharon. 2009. “Eye Tracking in Translation Process Research: Methodological Challenges and Solutions.” In Methodology, Technology and Innovation in Translation Process Research: A Tribute to Arnt Lykke Jakobsen, edited by Inger M. Mees, Fabio Alves, and Susanne Göpferich, 251–266. Copenhagen: Samfundslitteratur.Google Scholar
Pedersen, Emile S., and Helle V. Dam. 2017. “Short-Term Memory in the Production Phase of Sight Translation.” HERMES-Journal of Language and Communication in Business 27 (52): 93–105. DOI logoGoogle Scholar
Pontrandolfo, Gianluca. 2016. “Sight Translation in Healthcare Settings: A Case-Study.” In Translating Orality, ed. by Cesáreo Calvo Rigual, and Nicoletta Spinolo, special issue of MonTI. Monografías de Traducción e Interpretación (3): 367–398. Accessed January 8, 2023. DOI logoGoogle Scholar
Posner, Michael I. 1980. “Orienting of Attention.” Quarterly Journal of Experimental Psychology 32 (1): 3–25. Accessed March 15, 2023. DOI logoGoogle Scholar
Pupil Labs. 2023a. “Products.” Accessed March 1, 2023. [URL]
Pupil Labs. 2023b. “Pupil Core.” Accessed March 1, 2023. [URL]
Rayner, Keith. 1998. “Eye Movements in Reading and Information Processing: 20 Years of Research.” Psychological Bulletin 124 (3): 372–422. DOI logoGoogle Scholar
Saldanha, Gabriela, and Sharon O’Brien. 2014. Research Methodologies in Translation Studies. Routledge. DOI logoGoogle Scholar
Seeber, Kilian G. 2013. “Cognitive Load in Simultaneous Interpreting: Measures and Methods.” Target 25 (1): 18–32. DOI logoGoogle Scholar
Setton, Robin, and Andrew Dawrant. 2016. Conference Interpreting: A Complete Course. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Shreve, Gregory M., Isabel Lacruz, and Erik Angelone. 2010. “Cognitive Effort, Syntactic Disruption, and Visual Interference in a Sight Translation Task.” In Translation and Cognition, edited by Gregory M. Shreve, and Erik Angelone, 63–84. Amsterdam: John Benjamins. DOI logoGoogle Scholar
. 2011. “Sight Translation and Speech Disfluency. Performance Analysis as a Window to Cognitive Translation Processes.” In Methods and Strategies of Process Research, edited by Cecilia Alvstad, Adelina Hild, and Elisabet Tiselius, 93–120. Amsterdam: John Benjamins. DOI logoGoogle Scholar
SMI. n.d. “SMI Eye Tracking Glasses.” Accessed March 1, 2023. [URL]
Su, Wenchao. 2020. Eye-Tracking Processes and Styles in Sight Translation. Singapore: Springer. DOI logoGoogle Scholar
Tiselius, Elisabet, and Kayle Sneed. 2020. “Gaze and Eye Movement in Dialogue Interpreting: An Eye-Tracking Study.” Bilingualism: Language and Cognition 23 (4): 780–787. DOI logoGoogle Scholar
Tobii. 2023a. “Tobii Pro Glasses 3.” Accessed March 1, 2023. [URL]
. 2023b. “Tobii Eye Tracking Whitepaper.” Accessed March 1, 2023. [URL]
Vargas-Urpi, Mireia. 2019. “Sight Translation in Public Service Interpreting: A Dyadic or Triadic Exchange?” The Interpreter and Translator Trainer 13 (1): 1–17. Accessed July 9, 2023. DOI logoGoogle Scholar
Wallot, Sebastian, Geoff Hollis, and Marieke van Rooij. 2013. “Connected Text Reading and Differences in Text Reading Fluency in Adult Readers.” PLoS ONE 8 (8): e71914. Accessed July 3, 2023. DOI logoGoogle Scholar
Wang, Zishan, Julien Epps, and Siyuan Chen. 2021. “An Investigation of Automatic Saccade and Fixation Detection from Wearable Infrared Cameras.” 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC), October 17–20, 2021, 2250–2257. IEEE. Accessed July 3, 2023. DOI logoGoogle Scholar