Cover not available
Article published In:
Cognitive Translation and Interpreting Studies in the Early Twenty First Century
Edited by Adolfo M. García, Edinson Muñoz and Néstor Singer
[Translation, Cognition & Behavior 6:2] 2023
► pp. 187–210

Cognition and behaviour of reception in museum spaces

A critical review of eye tracking research on museum translation (2010–2022)

ORCID logo | Tianjin University of Finance and Economics | Durham University
ORCID logo | Oxford University
ORCID logo | Durham University
In recent years, there has been a growing interest in translation studies within museum settings, enabling museums to enhance visitor engagement and create a more meaningful visiting experience. Within cognitive translation studies, the use of eye tracking technology has emerged as a widely adopted method for investigating translators’ allocation of visual attention and cognitive resources. However, the application of eye tracking in museum translation studies has received limited attention. This study provides a critical review of the utilisation of eye tracking to examine visitors’ perception and reception in museum settings from both behavioural and cognitive perspectives. The article begins by selecting and categorising the reviewed papers. It then describes the methods employed for collecting and analysing eye movement data, followed by summaries and critical comments on the findings from the existing literature. This article further evaluates the reliability, validity, and practicality of existing eye tracking research in museum translation, and finally proposes the potential directions for future cognitive translation studies in museums.
Keywords: museum translation, eye tracking, critical review, multimodality, cognitive translation studies
Article outline
  • 1.Introduction
  • 2.Methods
    • 2.1Research questions
    • 2.2Selection of the reviewed papers
    • 2.3Categorisation of the reviewed papers
    • 2.4Data analysis
  • 3.Results
    • 3.1Data collecting methods
    • 3.2Eye movement data analysis
    • 3.3Findings reported in the reviewed papers
      • 3.3.1Findings on six types of intermodal translation
        • Type one: Interaction between objects and written texts
        • Type two: Interaction between objects and audio description
        • Type three: Interaction between objects and digital devices
        • Type four: Interaction between written texts and digital devices
        • Type five: Interaction between different digital devices
        • Type six: Interaction between paper materials and digital devices
      • 3.3.2Findings on three types of intramodal translation
        • Type one: Interaction between written texts and audio description
        • Type two: Interlingual translation
        • Type three: Interaction between objects
  • 4.Discussion: Reliability, validity, and practicality of eye tracking research on museum translation
    • 4.1Reliability
    • 4.2Validity
    • 4.3Practicality
  • 5.Directions for future cognitive translation studies in museums
  • 6.Conclusion
  • References
Published online: 7 March 2024
DOI logo
https://doi.org/10.1075/tcb.00085.xu
References (59)
References
Bal, Mieke. 2011. “Exposing the Public.” In A Companion to Museum Studies, edited by Sharon Macdonald, 525–542. Oxford: Wiley-Blackwell.Google Scholar
Bitgood, Stephen. 2013. Attention and Value: Keys to Understanding Museum Visitors. Walnut Creek: Left Coast Press.Google Scholar
Black, Graham. 2005. The Engaging Museum: Developing Museums for Visitor Involvement. London: Routledge. DOI logoGoogle Scholar
Buquet, Coralie, Jacques Charlier, and Vincent Paris. 1988. “Museum Application of an Eye Tracker.” Medical & Biological Engineering & Computing 261: 277–281. DOI logoGoogle Scholar
Di Giovanni, Elena. 2020. “Eye Tracking and the Museum Experience in Italy.” Altre Modernità 241: 10–24. DOI logoGoogle Scholar
Dondi, Piercarlo, Porta, Marco, Angelo Donvito, and Giovanni Volpe. 2021. “A Gaze-based Interactive System to Explore Artwork Imagery.” Journal on Multimodal User Interfaces 161: 55–67. DOI logoGoogle Scholar
Duchowski, Andrew T. 2002. “A Breadth-first Survey of Eye Tracking Applications.” Behavior Research Methods, Instruments, & Computers: A Journal of the Psychonomic Society 34 (4): 455–470. DOI logoGoogle Scholar
Falk, John H. and Lynn D. Dierking. 1992. The Museum Experience. Walnut Creek: Left Coast Press.Google Scholar
. 2000. Learning from Museums: Visitor Experiences and the Making of Meaning. Walnut Creek: Alta Mira Press.Google Scholar
. 2013. Museum Experience Revisited. Walnut Creek: Left Coast Press.Google Scholar
Federici, Federico Marco, and Walker, Callum. 2018. “A Mapping Exercise: Eye Tracking and Translation.” In Eye Tracking and Multidisciplinary Studies on Translation, edited by Callum Walker and Federico Marco Federici, 11–29. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Frisch, Juliette. 2011. “How Can We Define the Role of Language in Museum Interpretation.” In Museum Gallery Interpretation and Material Culture, edited by Juliette Frisch, 97–105. New York: Routledge.Google Scholar
Garbutt, Michael, Scott East, Branka Spehar, Vicente Estrada-Gonzalez, Brooke Carson-Ewart, and Josephine Touma. 2020. “The Embodied Gaze: Exploring Applications for Mobile Eye Tracking in the Art Museum.” Visitor Study 23 (1): 82–100. DOI logoGoogle Scholar
García, Adolfo M. 2014. “The Interpreter Advantage Hypothesis: Preliminary Data Patterns and Empirically Motivated Questions.” Translation and Interpreting Studies 91: 219–238. DOI logoGoogle Scholar
Hall, Edward T. 1966. The Hidden Dimension. New York: Doubleday.Google Scholar
Hooper-Greenhill, Eilean. 2000. Museums and the Interpretation of Visual Culture, 1st ed. London: Routledge. DOI logoGoogle Scholar
Hsieh, Yu-Ling, Ming-Feng Lee, Guey-Shya Chen, and Wei-Jie Wang. 2022. “Application of Visitor Eye Movement Information to Museum Exhibit Analysis.” Sustainability 14 (11): 6932. DOI logoGoogle Scholar
Hutchinson, Rachel S., and Alison F. Eardley. 2019. “Museum Audio Description: The Problem of Textual Fidelity.” Perspectives 27 (1): 42–57. DOI logoGoogle Scholar
. 2021. “Inclusive Museum Audio Guides: ‘Guided Looking’ through Audio Description Enhances Memorability of Artworks for Sighted Audiences.” Museum Management and Curatorship 361: 427–446. DOI logoGoogle Scholar
ICOM. 2022. “ICOM Approves a New Museum Definition.” Accessed 28 August 2022. [URL]
Jakobson, Roman. 1959. “On Linguistic Aspects of Translation.” In On Translation, edited by Reuben A. Brower, 232–239. Cambridge, MA: Harvard University Press.Google Scholar
Kaindl, Klaus. 2020. “A Theoretical Framework for a Multimodal Conception of Translation.” In Translation and Multimodality, edited by Monica Boria, Ángeles Carreres, María Noriega-Sánchez, and Marcus Tomalin, 49–70. London: Routledge.Google Scholar
Kastner, Sabine, and Mark A. Pinsk. 2004. “Visual Attention as A Multilevel Selection Process.” Cognitive, Affective, & Behavioral Neuroscience 41: 483–500. DOI logoGoogle Scholar
Koliou, Adamantia. 1997. “Foreign Languages and Their Role in Access to Museums.” Museum Management and Curatorship 16 (1): 71–76. DOI logoGoogle Scholar
Komarac, Tanja, Đurđana Ozretić Došen, and Vatroslav Škare. 2014. “Museum Marketing and Virtual Museums in 21st Century: Can Museums Survive without it?” 5th EMAC Regional Conference – Marketing Theory Challenges in Emerging Markets. Katowice, Poland. DOI logoGoogle Scholar
Krogh-Jespersen, Sheila, Kimberly A. Quinn, William L. D. Krenzer, Christine Nguyen, Jana Greenslit, and C. Aaron Price. 2020. “Exploring the Awe-some: Mobile Eye Tracking Insights into Awe in a Science Museum.” PLoS ONE 15 (9): e0239204. DOI logoGoogle Scholar
Liao, Min-Hsiu. 2018. “Museums and Creative Industries: The Contribution of Translation Studies.” The Journal of Specialised Translation 291: 45–62. [URL]
. 2019. “Translating Multimodal Texts in Space: A Case Study of St Mungo Museum of Religious Life and Art.” Linguistica Antverpiensia New Series–Themes in Translation Studies 17 1: 84–98. [URL]. DOI logo
. 2020. “Translating Trauma: Time Journey in a Memorial Museum.” In Translation and Time: Migration, Culture and Identity, edited by James St. André, 126–141. Kent, Ohio: Kent State University Press.Google Scholar
. 2021. “A Journey Home? Cultural Back-translation of Ethnographic Artefacts in Museums.” In Translation – Art Communication – Museum, edited by Barbara Ahrens, Silvia Hansen-Schirra, Monika Krein-Kühle, Michael Schreiber, and Ursula Wienen, 99–115. Berlin: Frank & Timme.Google Scholar
. 2021. “Christianity on Display: A Semiotic Study of Two Museums of World Religions (Glasgow, Taipei).” Church, Communication and Culture 6 (2): 383–401. DOI logoGoogle Scholar
Liao, Min-Hsiu, and Phil Bartie. 2022. “Translating Heritage: A Study of Visitors’ Experiences Mediated through Multilingual Audio Guides in Edinburgh Castle.” Journal of Heritage Tourism 17 (3): 283–295. DOI logoGoogle Scholar
Mandolesi, Serena, Danilo Gambelli, Simona Naspetti, and Raffaele Zanoli. 2022. “Exploring Visitors’ Visual Behavior Using Eye Tracking: The Case of the ‘Studiolo Del Duca ’” Journal of Imaging 8 (1): 8. DOI logoGoogle Scholar
Marina, Manfredi. 2021. “Professional Museum Translators for Promoting Multilingualism and Accessible Texts: Translation Practices in Some Italian Museums and a Proposal.” Journal of Translation Studies 1 (1): 59–86. DOI logoGoogle Scholar
Mayer, Richard E. 2005. “Cognitive Theory of Multimedia Learning.” In The Cambridge Handbook of Multimedia Learning, edited by Richard E. Mayer, 31–48. Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Mayr, Eva, Kristin Knipfer, and Daniel Wessel. 2009. “In-Sights into Mobile Learning: An Exploration of Mobile Eye Tracking Methodology for Learning in Museums.” In Researching Mobile Learning: Frameworks, Tools and Research Designs, edited by Giasemi Vavoula, Norbert Pachler, and Agnes Kukulska-Hulme, 189–204. Oxford: Peter Lang.Google Scholar
McManus, Paulette. 1991. “Making Sense of Exhibits.” In Museum Languages: Objects and Texts, edited by Gaynor Kavanagh, 33–46. Leicester: Leicester University Press. DOI logoGoogle Scholar
Milekic, Slavko. 2003. “The More You Look the More You Get: Intention-based Interface Using Gaze Tracking.” In Museums and the Web: Selected Papers from Museums and the Web 03, edited by David Bearman and Jennifer Trant. Pittsburgh: Archives & Museum Informatics. [URL]
. 2010. “Gaze Tracking and Museums: Current Research and Implications.” In Museums and the Web 2010: Proceedings, edited by Jennifer Trant and David Bearman. Toronto: Archives & Museum Informatics. [URL]
Morantes, Paola Patricia Parra, Sonia Andrea Peñarete, Giovanny Arbelaez, Mauricio Camargo, and Laurent Dupont. 2016. “Understanding Museum Visitors’ Experience through an Eye Tracking Study and a Living Lab Approach.” 22nd ICE/IEEE International Technology Management Conference. Trondheim: Norway. DOI logoGoogle Scholar
Neather, Robert. 2008. “Translating Tea: On the Semiotics of Interlingual Practice in the Hong Kong Museum of Teaware.” Meta 53 (1): 218–240. DOI logoGoogle Scholar
. 2021. “Museums as Translation Zones.” In The Routledge Handbook of Translation and Globalization, edited by Esperança Bielsa and Dionysios Kapsaskis, 306–319. Cham: Springer.Google Scholar
Ng, Tzi-Dong Jeremy, Xiao Hu, and Ying Peng Que. 2022. “Towards Multi-modal Evaluation of Eye tracked Virtual Heritage Environment.” LAK22: 12th International Learning Analytics and Knowledge Conference, 451–457. DOI logoGoogle Scholar
Nitzke, Jean. 2021. “The Processing of Website Contents in Native and Nonnative Language.” In Translation, Interpreting, Cognition: The Way out of the Box, edited by Tra&Co Group, 105–113. Berlin: Language Science. DOI logoGoogle Scholar
Paivio, Allan. 1979. Imagery and Verbal Processes. 1st ed. New York: Psychology Press. DOI logoGoogle Scholar
Raffi, Francesca. 2017. “Full Access to Cultural Spaces (FACS): Mapping and Evaluating Museum Access Services Using Mobile Eye Tracking Technologies.” Ars Aeterna 9 (2): 18–37. DOI logoGoogle Scholar
Rainoldi, Mattia, Barbara Neuhofer, and Mario Jooss. 2018. “Mobile Eyetracking of Museum Learning Experiences.” In Information and Communication Technologies in Tourism 2018, edited by Brigitte Stangl and Juho Pesonen, 473–485. Cham: Springer. DOI logoGoogle Scholar
Rainoldi, Mattia, Chung-En Yu, and Barbara Neuhofer. 2020. “The Museum Learning Experience Through the Visitors’ Eyes: An Eye Tracking Exploration of the Physical Context.” In Eye Tracking in Tourism, edited by Mattia Rainoldi and Mario Jooss, 183–199. Cham: Springer. DOI logoGoogle Scholar
Reitstätter, Luise, Karolin Galter, and Flora Bakondi. 2022. “Looking to Read: How Visitors Use Exhibit Labels in the Art Museum.” Visitor Studies 25 (2): 127–150. DOI logoGoogle Scholar
Rentschler, Ruth, and Anne-Marie Hede. 2007. Museum Marketing: Competing in the Global Marketplace. Oxford: Butterworth-Heinemann.Google Scholar
Schiele, Bernard. 1995. “Text in the Exhibition Medium.” In Text in the Exhibition Medium, edited by Alexandre Blais, 33–47. La Société Des Musées Québécois: Musée de la civilisation.Google Scholar
Schwan, Stephan, Melissa Gussmann, Peter Gerjets, Axel Drecoll, and Albert Feiber. 2020. “Distribution of Attention in a Gallery Segment on the National Socialists’ Führer Cult: Diving Deeper into Visitors’ Cognitive Exhibition Experiences Using Mobile Eye Tracking.” Museum Management and Curatorship 35 (1): 71–88. DOI logoGoogle Scholar
Severin, Werner. 1967. “Another Look at Cue Summation.” AV Communication Review 15 (4): 233–245. DOI logoGoogle Scholar
Smith, Jeffrey K., and Smith, Lisa F. 2001. “Spending Time on Art.” Empirical Studies of the Arts 19 (2): 229–236. DOI logoGoogle Scholar
Smith, Lisa F., Jeffrey K. Smith and Pablo P. L. Tinio. 2017. “Time Spent Viewing Art and Reading Labels.” Psychology of Aesthetics, Creativity, and the Arts 11 (1): 77–85. DOI logoGoogle Scholar
Spinzi, Cinzia. 2019. “A Cross-Cultural Study of Figurative Language in Museum Audio Descriptions. Implications for Translation.” Lingue e Linguaggi 331: 303–316. DOI logoGoogle Scholar
Sturge, Kate. 2007. Representing Others: Translation, Ethnography and Museum. Manchester: St Jerome Publishing.Google Scholar
Szarkowska, Agnieszka, Izabela Krejtz, Krzysztof Krejtz, and Andrew Duchowski. 2013. “Harnessing the Potential of Eyetracking for Media Accessibility.” In Translation Studies and Eye Tracking Analysis, edited by Sambor Grucza, Monika Pluzyczka, and Justyna Zajac, 153–183. Oxford: Peter Lang.Google Scholar
Yang, Jing, and Cyrus Yin-Ho Chan. 2019. “Audio-augmented Museum Experiences with Gaze Tracking.” Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia 461, 1–5. DOI logoGoogle Scholar
Cited by (1)

Cited by one other publication

Pierroux, Palmyre
2024. Innovating visitor research within museums: Concepts, tools and practices. Multimodality & Society 4:3 ► pp. 275 ff. DOI logo

This list is based on CrossRef data as of 27 september 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.