Evaluating audio description and emotional engagement for BPS visitors in a museum context
An experimental perspective
Museums face a particular challenge in enabling blind and partially sighted (BPS) visitors to engage emotionally with the narrative(s) they present. In collaboration with a world-leading tourist attraction (Titanic Belfast) and the Royal National Institute of Blind People (RNIB), we have applied several different approaches for improving emotional engagement for BPS visitors. This paper addresses the critical challenge of how to obtain reliable evidence for evaluating the emotional response of BPS visitors to the museum’s audio description (AD) and overall experience. We consider six different methods for measuring emotional engagement, and consider their potential for providing reliable experimental evidence. Based on BPS-user feedback, we present a qualitative comparison of these methods, uniquely all applied to the same museum context.
Article outline
- 1.Introduction
- 2.Background
- 2.1Importance of accessibility in museums
- 2.2Current solutions for enhancing emotional engagement
- 2.3Current methods for evaluating emotional responses
- 3.Our research context: Three projects with Titanic Belfast
- 3.1Project 1 – An analysis of BPS visitor experience
- 3.2Project 2 – The ‘Story to journey to smart map’ (SJSM) approach
- 3.3Project 3 – A voice-driven interactive audio-descriptive guide
- 4.Measuring AD and emotional engagement and experimental analysis
- 4.1Questionnaires
- 4.2In-tour questions
- 4.3Focus groups
- 4.4EEG
- 4.5A Tactile Self-Assessment Manikin (T-SAM)
- 4.6On-the-fly interaction usage statistics
- 4.7Qualitative comparison of the six methods
- 5.Conclusions
-
References
References (46)
References
“Audio Description: No Woman, No Cry – In the Gallery | Tate.” n.d. Accessed September 25, 2021. [URL]
Bedford, Leslie. 2001. “Storytelling: The Real Work of Museums.” Curator: The Museum Journal 44 (1): 27–34. 

Bedigan, Kirsten M. 2016. “Developing Emotions: Perceptions of Emotional Responses in Museum Visitors.” Mediterranean Archaeology and Archaeometry 16 (5): 87–95. 

Bradley, Margaret M., and Peter J. Lang. 1994. “Measuring Emotion: The Self-Assessment Semantic Differential Manikin and the Semantic Differential.” Journal of Behavior Therapy and Experimental Psychiatry 25 (1): 49–59. 

Bruner, Jerome. 1990. Acts of Meaning. Cambridge: Harvard University Press.
Bynion, Teah-Marie, and Matthew T. Feldner. 2017. “Self-Assessment Manikin.” In Encyclopedia of Personality and Individual Differences, edited by Virgil Zeigler-Hill and Todd K. Shackelford, 4654–56. Cham: Springer Nature Switzerland AG. 

Caro, Marina Ramos. 2016. “Testing Audio Narration: The Emotional Impact of Language in Audio Description.” Perspectives: Studies in Translatology 24 (4): 606–34. 

Chmiel, Agnieszka, and Iwona Mazur. 2012. “AD Reception Research: Some Methodological Considerations.” In Emerging Topics in Translation: Audio Description, 57–80. Trieste: EUT. [URL]
Cock, Matthew, Molly Bretton, Anna Fineman, Richard France, Claire Madge, and Melanie Sharpe. 2018. “State of Museum Access 2018 Does Your Museum Website Welcome and Inform Disabled Visitors?” VocalEyes, Stage TEXT and Autism in Museums. [URL]
Díaz-Cintas, Jorge, and Agnieszka Szarkowska. 2020. “Introduction: Experimental Research in Audiovisual Translation–Cognition, Reception, Production.” Journal of Specialised Translation, no. 331: 3–16. [URL]
Eardley, Alison F., Louise Fryer, Rachel Hutchinson, Matthew Cock, Peter Ride, and Joselia Neves. 2017. “Enriched Audio Description: Working towards an Inclusive Museum Experience.” In Inclusion, Disability and Culture: An Ethnographic Perspective Traversing Abilities and Challenges, edited by Santoshi Halder and Lori Czop Assaf, 195–207. Cham: Springer Nature Switzerland AG. 

Ekandem, Joshua I., Timothy A. Davis, Ignacio Alvarez, Melva T. James, and Juan E. Gilbert. 2012. “Evaluating the Ergonomics of BCI Devices for Research and Experimentation.” Ergonomics 55 (5): 592–98. 

Falk, John H., and Lynn D. Dierking. 2016. The Museum Experience. New York: Routledge. 

Fryer, Louise, and Jonathan Freeman. 2014. “Can You Feel What I’m Saying? The Impact of Verbal Information on Emotion Elicitation and Presence in People with a Visual Impairment.” In In Challenging Presence: Proceedings of the 15th International Conference on Presence, edited by Anna Felnhofer and Oswald D. Kothgassner, 99–107. Wien: facultas.wuv Universitäts.
Gillham, Bill. 2008. Developing a Questionnaire. London: Continuum International Publishing Group.
Greco, Gian Maria. 2018. “The Nature of Accessibility Studies.” Journal of Audiovisiual Translation 1 (1): 205–32. [URL]. 
Greco, Gian Maria. 2019. “Towards a Pedagogy of Accessibility : The Need for Critical Learning Spaces in Media Accessibility Education and Training.” Linguistica Antverpiensia, New Series–Themes in Translation Studies 181: 23–46.
“Home | Easy Access for Social Inclusion Training (EASIT).” n.d. Accessed September 25, 2021. [URL]
Hutchinson, Rachel S., and Alison F. Eardley. 2019. “Museum Audio Description: The Problem of Textual Fidelity.” Perspectives: Studies in Translation Theory and Practice 27 (1): 42–57. 

Hutchinson, Rachel S., and Alison F. Eardley. 2020. “The Accessible Museum: Towards an Understanding of International Audio Description Practices in Museums.” Journal of Visual Impairment and Blindness 114 (6): 475–87. 

Hutchinson, Rachel S., and Alison F. Eardley. 2021. “Inclusive Museum Audio Guides: ‘Guided Looking’ through Audio Description Enhances Memorability of Artworks for Sighted Audiences.” Museum Management and Curatorship 36 (4), 427–46. 

Iturregui-Gallardo, Gonzalo, and Jorge Luis Méndez-Ulrich. 2020. “Towards the Creation of a Tactile Version of the Self-Assessment Manikin (T-SAM) for the Emotional Assessment of Visually Impaired People.” International Journal of Disability, Development and Education 67 (6): 657–74. 

Krosnick, Jon A., and Stanley Presser. 2010. “Question and Questionnaire Design.” In The Handbook of Survey Research, edited by Peter Marsden and James Wright, 263–312. Bingley: Emerald Group Publishing Limited.
Krueger, Richard A. 1997. Analyzing and Reporting Focus Group Results. London: Sage Publications.
Lang, Peter J., Margaret M. Bradley, and Bruce N. Cuthbert. 2008. International Affective Picture System (IAPS): Affective Ratings of Pictures and Instruction Manual. University of Florida, Gainesville. Tech Rep A-8.
McMillen, Rebecca, and Frances Alter. 2017. “Social Media, Social Inclusion, and Museum Disability Access.” Museums & Social Issues 12 (2): 115–25. 

“Mind’s Eye – Audio Description Services for Museums & Galleries by Anne Hornsby.” n.d. Accessed May 26, 2021. [URL]
Morgan, David L. 1998. The Focus Group Guidebook. London: Sage Publications. 

Neves, Josélia. 2012. “Multi-Sensory Approaches to (Audio) Describing the Visual Arts.” MonTI. Monografías de Traducción e Interpretación, no. 4: 277–93. 

Neves, Josélia. 2016. “Enriched Descriptive Guides: A Case for Collaborative Meaning-Making in Museums.” Cultus 9 (2): 137–54.
Neves, Josélia. 2018. “Cultures of Accessibility: Translation Making Cultural Heritage in Museums Accessible to People of All Abilities.” In The Routledge Handbook of Translation and Culture, edited by Sue-Ann Harding and Ovidi Carbonell Cortés, 415–30. London: Routledge. 

Orero, Pilar., Stephen Doherty, Jan-Louis Kruger, Jan Pedersen, Elisa Perego, Pablo Romero-Fresco, Sara Rovira-Esteva, Olga Soler-Vilageliu, and Agnieszka Szarkowska. 2018. “Conducting Experimental Research in Audiovisual Translation (AVT): A Position Paper.” The Journal of Specialised Translation, no. 30: 105–26.
Orero, Pilar. 2008. “Three Different Receptions of the Same Film: ‘The Pear Stories Project’ Applied to Audio Description.” European Journal of English Studies 12 (2): 179–93. 

Pérez-González, Luis. 2014. Audiovisual Translation: Theories, Methods and Issues. London: Routledge. 

Ramos, Marina. 2015. “The Emotional Experience of Films: Does Audio Description Make a Difference?” The Translator 21 (1): 68–94. 

Randaccio, Monica. 2018. “Museum Audio Description: Multimodal and ‘Multisensory’ Translation: A Case Study from the British Museum.” Linguistics and Literature Studies 6 (6): 285–97. 

Remael, Aline, Nina Reviers, and Gert Vercauteren. 2015. “Pictures Painted in Words: ADLAB Audio Description Guidelines.” 2015. [URL]
“Resources – VocalEyes.” n.d. Accessed May 26, 2021. [URL]
Sakpere, Wilson, Michael Adeyeye-Oshin, and Nhlanhla B. W. Mlitwa. 2017. “A State-of-the-Art Survey of Indoor Positioning and Navigation Systems and Technologies.” South African Computer Journal 29 (3): 145–97. 

Tymoczko, Maria. 2014. Enlarging Translation, Empowering Translators. London: Routledge. 

United Nations. 2014. “General Comment No. 2. Article 9: Convention on the Rights of Persons with Disabilities (CRPD).” CRPD/C/ GC/2. [URL]. 
Wang, Xi, Danny Crookes, Sue-Ann Harding, and David Johnston. 2020. “Evaluating Audio Description and BPS Visitor Experience in Titanic Belfast.” Journal of Audiovisual Translation 3 (1): 246–63. 

Wang, Xi, Danny Crookes, Sue-Ann Harding, and David Johnston. 2021. “Stories, Journeys and Smart Maps: An Approach to Universal Access.” Universal Access in the Information Society. 

Wilkinson, Sue. 1998. “Focus Group Methodology: A Review.” International Journal of Social Research Methodology ISSN: 1 (3): 181–203. 

Cited by (1)
Cited by one other publication
Wang, Xi
2024.
Translating gardens into accessible multisensory tours for blind and partially sighted visitors: an exploratory case study.
Universal Access in the Information Society 
This list is based on CrossRef data as of 5 july 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.