Usability tests for personalised subtitles
Over the past decade, subtitles have developed along with broadcast and broadband technology. Viewers nowadays enjoy new
opportunities to customize subtitles to best meet their personal preferences or needs. This study aims to identify end-user
subtitle setting preferences, to investigate whether these settings have an effect on content comprehension, and to explore
subtitle usability for two groups of participants, those under the age of 65 and those over 65. In an experiment, three subtitle
features were open to customization: the position, the box and the size of the subtitle, before and after participants watched an
on-demand TV documentary produced by the Catalan public broadcaster TVC. Results confirm a preference for bottom and medium
subtitles. Furthermore, while the under 65 segment made satisfactory use of the system, the over 65 segment experienced different
levels of usability and reported different capabilities and problems.
Article outline
- Introduction
- Media accessibility and usability
- Subtitle position and text size
- Objectives and methodology
- Participants, materials and procedure
- Results
- Discussion
- Conclusions
- Notes
-
References
References (61)
References
AENOR (Asociación Española de Normalización y Certificación). 2012. Subtitulado para personas sordas y personas con discapacidad auditiva [Subtitling for the Deaf and Hard-of-Hearing People]. UNE 153010:2012. Madrid: AENOR.
Armstrong, Mike, Andy Brown, Michael Crabb, Chris J. Hughes, Rhianne Jones, and James Sandford. 2015. Understanding the Diverse Needs of Subtitle Users in a Rapidly Evolving Media Landscape. Research & Development White Paper WHP 307. British Broadcasting Corporation. Accessed September 18, 2017. [URL]. 
Arnáiz-Uzquiza, Verónica. 2008. “La Objetividad en el Subtitulado. Justificación de los Parámetros Formales Mediante Eye Tracking.” In ULISES y la comunidad sorda: Hacia el desarrollo de tecnologías comunicativas para la igualdad de oportunidades, edited by Álvaro Pérez-Ugena, and Ricardo Vizcaíno Laorga, 73–85. Madrid: Observatorio de las Realidades Sociales y de la Comunicación.
Baker, Robert G. 1981. Guidelines for the Subtitling of Television Programmes. A report from Southampton University for Independent Television (UK). Southampton (UK): Southampton University.
Bartoll, Eduard, and Anjana Martínez-Tejerina. 2010. “The Positioning of Subtitles for the Deaf and Hard of Hearing.” In Listening to Subtitles: Subtitles for the Deaf and Hard of Hearing, edited by Anna Matamala, and Pilar Orero, 69–86. Bern: Peter Lang.
Bernard, Michael, Chia Hui Liao, and Melissa Mills. 2001. “The Effect of Font Type and Size on the Legibility and Reading Time of Online Text by Older Adults.” In CHI EA ’01 Extended Abstracts on Human Factors in Computer Systems, 175–176. New York: ACM Press. 

Brooke, John. 1996. “SUS-A quick and dirty usability scale.” In Usability Evaluation in Industry, edited by Patrick W. Jordan, Bruce Thomas, Ian Lyall McClelland, and Bernard A. Weerdmeester, 4–7. London: CRC Press, [URL]
Brown, Andy, Rhianne Jones, and Michael Crabb. 2015. “Dynamic Subtitles: The User Experience.” In TVX 15’ Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video, 103–112. New York: ACM Press. 

Carmichael, Alex. 1999. Style Guide for the Design of Interactive Television Services for Elderly Viewers, Winchester: Independent Television Commission. [URL]
Carroll, Mary, and Jan Ivarsson. 1998. Subtitling. Simrishamn: TransEdit.
Costa-Montenegro, Enrique, Fátima M. García-Doval, Jonathan Juncal-Martínez, and Belén Barragáns-Martínez. 2016. “SubTitleMe, Subtitles in Cinemas in Mobile Devices.” Universal Access in the Information Society 15 (3): 461–472. 

Crabb, Michael, Rhianne Jones, Michael Armstrong, and Chris J. Hughes. 2015. “Online News Videos: The UX of Subtitle Position.” In ASSETS ’15 Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. New York: ACM Press. 

Czaja, Sara J., Neil Charness, Arthur D. Fisk, Christopher Hertzog, Sankaran N. Nair, Wendy A. Rogers, and Joseph Sharit. 2006. “Factors Predicting the Use of Technology: Findings from the Center for Research and Education on Aging and Technology Enhancement (CREATE).” Psychology and Aging 21 (2): 333–352. 

d’Ydewalle, Géry, and Ingrid Gielen. 1992. “Attention Allocation with Overlapping Sound, Image, and Text.” In Eye Movements and Visual Cognition, edited by Keith Rayner, Springer Series in Neuropsychology, 415–527. New York: Springer. 

d’Ydewalle, Géry, Caroline Praet, Karl Verfaillie, and Johan Van Rensbergen. 1991. “Watching Subtitled Television. Automatic Reading Behaviour.” Communication Research 18 (5): 650–666. 

d’Ydewalle, Géry, Johan Van Rensbergen, and Joris Pollet. 1987. “Reading a Message when the Same Message is Available Auditorily in Another Language: The Case of Subtitling.” In Eye Movements From Physiology to Cognition: Selected/Edited Proceedings of the Third European Conference on Eye Movements, Dourdan, France, September 1985, edited by J. K. O’Regan, and A. Levy-Schoen, 313–321. Amsterdam: Elsevier Science Publishers. 

De Bruycker, Wim, and Géry d’Ydewalle. 2003. “Chapter 31. Reading Native and Foreign Language Television Subtitles in Children and Adults.” In The Mind’s Eye: Cognitive and Applied Aspects of Eye Movement Research, edited by Jukka Hyöna, Ralph Radach, and H. Deubel, 671–684. Amsterdam: Elsevier Science BV. 

de Linde, Zoé, and Neil Kay. 1999. The Semiotics of Subtitling. Manchester: St. Jerome Publishing.
DTV4All (Digital Television for All). 2010. European Research Project. [URL]
Dykstra, Dean Julian. 1993. A Comparison of Heuristic Evaluation and Usability Testing: The Efficacy of a Domain-specific Heuristic Checklist. Texas: A&M University.
Gottlieb, Henrik. 1998. “Subtitles, Translation and Idioms.” PhD Thesis, University of Copenhagen.
Gottlieb, Henrik. 2005. “Multidimensional Translation: Semantics turned Semiotics.” In MuTra 2005: Challenges of Multidimensional Translation: Conference Proceedings, edited by Sandra Nauert, and Heidrun Gerzymisch-Arbogast, EU-High-Level Scientific Conference Series, 33–61, [URL]
Greco, Gian Maria. 2016. “On Accessibility as a Human Right, with an application to Media Accessibility.” In Researching Audio Description, edited by Anna Matamala, and Pilar Orero, Palgrave Studies in Translating and Interpreting Series, 11–13. London: Palgrave Macmillan. 

Gulliver, Stephen, and Ghinea, George. 2003. “How Level and Type of Deafness Affect User Perception of Multimedia Video Clips.” Universal Access in the Information Society 2 (4): 374–386. 

HBB4ALL (Hybrid Broadcast Broadband For ALL). 2017. European Research Project. [URL]
Holken, Hamut, and Pilar Orero. 2014. “TV Content Delivery to PC, Tablet, Smartphone: From the Accessibility Vision into Market Reality.” ThinkMind Mobility 2014: The Fourth International Conference on Mobile Services, Resources, and Users, 99–104, [URL]
Hughes, Chris J., Mike Armstrong, Rhianne Jones, and Michael Crabb. 2015. “Responsive Design for Personalised Subtitles.” In W4A ’15 Proceedings of the 12th Web for All Conference, 81. New York: ACM Press. 

ISO (International Organization for Standardization) 2017. Information Technology – User Interface Component Accessibility – Part 23: Guidance on the Visual Presentation of Audio Information (including Captions and Subtitles). ISO/IEC 20071-23. Paris: ISO.
Karamitroglou, Fotios. 1997. “A Proposed Set of Subtitling Standards in Europe.” Translation Journal 2 (2), [URL]
Kirkland, C. Eric. 1999. “Evaluation of Captioning Features to Inform Development of Digital Television Captioning Capabilities.” American Annals of the Deaf 144 (3): 250–260. 

Koolstra, Cees M., and Jonannes W. J. Beentjes. 1999. “Children’s vocabulary acquisition in a foreign language through watching subtitled television programs at home.” Education Technology Research and Development 47 (1): 51–60. 

Koolstra, Cees M., Tom H. A. van der Voort, and Leo J. Th. van der Kamp. 1997. “Television’s Impact on Children’s Reading Comprehension and Decoding Skills: A 3-Year Panel Study.” Reading Research Quarterly 32 (2): 128–152. 

Kruger, Jan-Louis, Agnieszka Szarkowska, and Izabela Krejtz. 2015. “Subtitles on the Moving Image: An Overview of Eye Tracking Studies.” Refractory: A Journal of Entertainment Media 251: 1–14.
Montagud, Mario, Fernando Boronat, Juan González, and Javier Pastor. 2017. “Web-Based Platform for Subtitles Customization and Synchronization in Multi-Screen Scenarios.” In TVX ’17 Adjunct Publication of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video, 81–82. New York: ACM Press. 

Nathan, John G., Daniel R. Anderson, and Diane E. Field. 1984. “Television Viewing at Home: Distances and Visual Angles Adopted by Children and Adults.” In Proceedings of the Human Factors and Ergonomics Society Annual Meeting 28 (11): 978–982. 

Nettelbeck, Ted, and Nicholas R. Burns. 2010. “Processing Speed, Working Memory and Reasoning Ability from Childhood to Old Age.” Personality and Individual Differences 48 (4): 379–384. 

Neves, Josélia. 2007. “‘There is Research and Research’: Subtitling for the Deaf and Hard of Hearing (SDH).” In Traducción y Accesibilidad. Subtitulación para Sordos y Audiodescripción para Ciegos. Nuevas Modalidades de Traducción Audiovisual, edited by Catalina Jiménez Hurtado, Studien zur romanischen Sprachwissenschaft und interkulturellen Kommunikation Series, 27–40. Frankfurt am Main: Peter Lang.
Nielsen, Jakob, and Rolf Molich. 1990. “Heuristic Evaluation of User Interfaces.” In CHI ’90 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 249–256. New York: ACM Press. 

Noland, Katy C., and Louise H. Truong. 2015. A Survey of UK Television Viewing Conditions. BBC R&D White Paper WHP 287. British Broadcasting Corporation. [URL]
Orero, Pilar, John Birch, and Andrew Lambourne. 2014. “Media accessibility in HBBTV: Interaction for All.” IET Conference Proceedings, 11–15 Sept. 2014. 

Orero, Pilar, Stephen Doherty, Jan-Louis Kruger, Anna Matamala, Jan Pedersen, Elisa Perego, Pablo Romero-Fresco, Sara Rovira-Esteva, Olga Soler-Vilageliu, and Agnieszka Szarkowska. 2018. “Conducting Experimental Research in Audiovisual Translation (AVT): A Position Paper.” JosTrans: The Journal of Specialised Translation 301: 105–126, [URL]
Orero, Pilar, Javier Serrano, Olga Soler, Anna Matamala, Judit Castella, Maria Teresa Soto Sanfiel, Anna Vilaró, and Carme Mangiron. 2014. “Accessibility to Digital Society: Interaction for All.” ICDS 2014. The Eighth International Conference on Digital Society, 188–191. [URL]
Orero, Pilar, and Irene Tor-Carroggio. 2018. “User Requirements when Designing Learning e-Content: Interaction for All.” In Designing for the User Experience in Learning Systems, edited by Evangelos Kapros, and Maria Koutsombogera. Berlin: Springer. 

Perego, Elisa, Fabio Del Missier, Marco Porta, and Mauro Mosconi. 2010. “The Cognitive Effectiveness of Subtitle Processing.” Media Psychology 13 (3): 243–272. 

Rayner, Keith. 1998. “Eye Movements in Reading and Information Processing: Twenty Years of Research.” Psychological Bulletin 1241: 372–422. 

Reder, Stephen, and John Bynner (eds). 2009. Tracking Adult Literacy and Numeracy Skills: Findings from Longitudinal Research. New York and London: Routledge.
Reuter-Lorenz, Patricia A., and Denise C. Park. 2014. “How Does it STAC Up? Revisiting the Scaffolding Theory of Aging and Cognition.” Neuropsychology Review 24 (3): 355–370. 

Robson, Gary D. 2004. The Closed Captioning Handbook. Amsterdam and London: Focal Press. 

Romero-Fresco, Pablo. 2009. “More Haste Less Speed: Edited versus Verbatim Respoken Subtitles.” VIAL: Vigo International Journal of Applied Linguistics 61: 109–133, [URL]
Romero-Fresco, Pablo. 2011. Subtitling through Speech Recognition: Respeaking. Manchester: Routledge.
Rudd, Rima E. 2007. “Health Literacy Skills of U.S. Adults.” American Journal of Health Behavior 311 (Suppl 1): S8–S18. 

Sauro, Jeff. 2011. “Measuring Usability with the System Usability Scale (SUS).” In Measuring U. [URL]
Sauro, Jeff, and James R. Lewis. 2016. “Chapter 8. Standardized Usability Questionnaires.” In Quantifying the User Experience, edited by Jeff Sauro and James R. Lewis, 185–240. Amsterdam: Elsevier. 

Sears, Andrew, and Vicki Hanson. 2011. “Representing Users in Accessibility Research.” In CHI ’11 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2235–2238. New York: ACM Press. 

Sinclair II Robert, E., Gilma Annuska Perkins, Michael Edward Dulac Winser, Ramkumar Subramanian, and Paul Reid. 2009. Personalization of User Accessibility Options. U.S. Patent No. US7554522B2, [URL]
Springett, Mark, Mark Rice, and Richard Griffiths. 2011. “Towards Inclusive Digital Television.” Universal Access in the Information Society 121: 1–3. 

Szarkowska, Agnieszka, Izabela Krejtz, Zuzanna Kłyszejko, and Anna Wieczorek. 2011. “Verbatim, Standard, or Edited? Reading Patterns of Different Captioning Styles among Deaf, Hard of Hearing, and Hearing Viewers.” American Annals of the Deaf 156 (4): 363–378. 

Szarkowska, Agnieszka, Izabela Krejtz, Olga Pilipczuk, Łukasz Dutka, and Jan-Louis Kruger. 2016. “The Effects of Text Editing and Subtitle Presentation Rate on the Comprehension and Reading Patterns of Interlingual and Intralingual Subtitles among Deaf, Hard of Hearing and Hearing Viewers.” Across Languages and Cultures 17 (2): 183–204. 

Utray, Francisco, Ana Maria Pereira, and Pilar Orero. 2009. “The Present and Future of Audio Description and Subtitling for the Deaf and Hard of Hearing in Spain.” Meta 54 (2): 248–263. 

Utray, Francisco, Belén Ruiz, and José Antonio Moreiro. 2010. “Maximum Font Size for Subtitles in Standard Definition Digital Television: Tests for a Font Magnifying Application.” In Listening to Subtitles: Subtitles for the Deaf and Hard of Hearing, edited by Anna Matamala, and Pilar Orero, 59–68. Bern: Peter Lang.
Cited by (3)
Cited by three other publications
Qiu, Lijian, Wenzheng Zhao & Xuezhi Liu
2022.
Does subtitle size in teaching video influence learning outcomes?.
Multimedia Tools and Applications 81:30
► pp. 43253 ff.

Gorman, Benjamin M., Michael Crabb & Michael Armstrong
2021.
Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems,
► pp. 1 ff.

Abdel Latif, Muhammad M. M.
2020.
Translation and Interpreting Assessment Research. In
Translator and Interpreter Education Research [
New Frontiers in Translation Studies, ],
► pp. 61 ff.

This list is based on CrossRef data as of 8 november 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.