Cover not available
Article published In:
Target
Vol. 33:1 (2021) ► pp.73–102

Automatic speech recognition in the booth

Assessment of system performance, interpreters’ performances and interactions in the context of numbers

ORCID logo | Ghent University
ORCID logo | Johannes Gutenberg University Mainz
Automatic Speech Recognition (ASR) has been proposed as a means to enhance state-of-the-art computer-assisted interpreting (CAI) tools and to allow machine-learning techniques to enter the workflow of professional interpreters. In this article, we test the usefulness of real-time transcription with number highlighting of a source speech for simultaneous interpreting using InterpretBank ASR. The system’s precision is high (96%) and its latency low enough to fit interpreters’ ear–voice span (EVS). We evaluate the potential benefits among first-time users of this technology by applying an error matrix and by investigating the users’ subjective perceptions through a questionnaire. The results show that the ASR provision improves overall performance for almost all number types. Interaction with the ASR support is varied and participants consult it for just over half of the stimuli. The study also provides some evidence of the psychological benefits of ASR availability and of overreliance on ASR support.
Keywords: automatic speech recognition, simultaneous interpreting, rendition of numbers, computer-assisted interpreting
Article outline
  • 1.Introduction
  • 2.Interpreting numbers
  • 3.Methodology
    • 3.1InterpretBank
    • 3.2Preliminary test
    • 3.3Equipment
    • 3.4Participants
    • 3.5Speeches
    • 3.6Procedure
    • 3.7Data processing and analysis
  • 4.Results
    • 4.1Findings regarding ASR
      • 4.1.1Ergonomics
      • 4.1.2Latency
      • 4.1.3ASR precision for numbers
    • 4.2Findings regarding presumed use of the ASR
    • 4.3Findings regarding performance
      • 4.3.1Renditions, ASR availability and presumed use
      • 4.3.2Results per interpreter
      • 4.3.3Renditions and number type
  • 5.Discussion
  • 6.Conclusions
  • Acknowledgements
  • Notes
  • References
Published online: 26 November 2020
DOI logo
https://doi.org/10.1075/target.19166.def
References (24)
References
Alessandrini, Maria Serena. 1990. “Translating Numbers in Consecutive Interpretation: An Experimental Study.” The Interpreters’ Newsletter 31: 77–80.Google Scholar
Braun, Susanne, and Andrea Clarici. 1996. “Inaccuracy for Numerals in Simultaneous Interpretation: Neurolinguistic and Neuropsychological Perspectives.” The Interpreters’ Newsletter 71: 85–102.Google Scholar
Brüsewitz, Nora. 2019. “Simultandolmetschen 4.0: Ist automatische Spracherkennung der nächste Schritt? [Simultaneous interpreting 4.0: Is automatic speech recognition the next step?]” In Proceedings of Übersetzen und Dolmetschen 4.0. – Neue Wege im digitalen Zeitalter [Translation and Interpreting 4.0 – New Paths in the Digital Era], edited by Wolfram Bauer and Felix Mayer, 323–333. Berlin: BDÜ Fachverlag.Google Scholar
Christoffels, Ingrid K. 2004. Cognitive Studies in Simultaneous Interpreting. PhD diss. University of Amsterdam.Google Scholar
Collard, Camille. 2019. A Corpus-based Study of Simultaneous Interpreting with Special Reference to Sex. PhD diss. Ghent University.Google Scholar
Corpas Pastor, Gloria, and Lily May Fern. 2016. A Survey of Interpreters’ Needs and Practices Related to Language Technology. Technical report [FFI2012-38881-MINECO/TI-DT-2016-1]. Málaga: University of Málaga.Google Scholar
Defrancq, Bart. 2015. “Corpus-based Research into the Presumed Effects of Short EVS.” Interpreting 17 (1): 26–45. DOI logoGoogle Scholar
Desmet, Bart, Mieke Vandierendonck, and Bart Defrancq. 2018. “Simultaneous Interpretation of Numbers and the Impact of Technological Support.” In Interpreting and Technology, edited by Claudio Fantinuoli, 11–24. Berlin: Language Science Press.Google Scholar
Fantinuoli, Claudio. 2017. “Speech Recognition in the Interpreter Workstation.” In Translating and the Computer 39: Proceedings, edited by João Esteves-Ferreira, Juliet Macan, Ruslan Mitkov, and Olaf-Michael Stefanov, 25–34. Geneva: Editions Tradulex.Google Scholar
. 2018. “Interpreting and Technology: The Upcoming Technological Turn.” In Interpreting and Technology, edited by Claudio Fantinuoli, 1–12. Berlin: Language Science Press.Google Scholar
Frittella, Francesca Maria. 2019. “‘70.6 Billion World Citizens’: Investigating the Difficulty of Interpreting Numbers.” Translation and Interpreting 11 (1): 79–99. DOI logoGoogle Scholar
Gile, Daniel. 1995. Regards sur la recherche en interprétation de conférence [Views on Conference Interpreting Research]. Lille: Presses Universitaires de Lille.Google Scholar
Jones, Roderick. 2002. Conference Interpreting Explained. 2nd ed. Manchester: St Jerome Publishing.Google Scholar
Korpal, Paweł. 2016. Linguistic and Psychological Indicators of Stress in Simultaneous Interpreting. PhD diss. Adam Mickiewicz University.Google Scholar
Korpal, Paweł, and Katarzyna Stachowiak-Szymczak. 2020. “Combined Problem Triggers in Simultaneous Interpreting: Exploring the Effect of Delivery Rate on Processing and Rendering Numbers.” Perspectives: Studies in Translation Theory and Practice 28 (1): 126–143. DOI logoGoogle Scholar
Lamberger-Felber, Heike. 2001. “Text-oriented Research into Interpreting – Examples from a Case-study.” Hermes 261: 39–64.Google Scholar
Mazza, Cristina. 2001. “Numbers in Simultaneous Interpretation.” The Interpreters’ Newsletter 111: 87–104.Google Scholar
Mead, Peter. 2015. “Numbers.” In Routledge Encyclopedia of Interpreting Studies, edited by Franz Pöchhacker, 286–288. Abingdon: Routledge.Google Scholar
Oléron, Pierre, and Hubert Nanpon. 1965/2002. “Research into Simultaneous Translation.” In The Interpreting Studies Reader, edited by Franz Pöchhacker and Miriam Shlesinger, 42–51. London: Routledge.Google Scholar
Pinochi, Diletta. 2009. “Simultaneous Interpretation of Numbers: Comparing German and English to Italian. An Experimental Study.” The Interpreters’ Newsletter 141: 33–57.Google Scholar
Prandi, Bianca. 2018. “An Exploratory Study on CAI Tools in Simultaneous Interpreting: Theoretical Framework and Stimulus Validation.” In Interpreting and Technology, edited by Claudio Fantinuoli, 25–54. Berlin: Language Science Press.Google Scholar
Setton, Robin, and Andrew Dawrant. 2016. Conference Interpreting: A Complete Course. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Timarová, Sarka. 2012. Working Memory in Simultaneous Interpreting . PhD diss. KU Leuven.Google Scholar
Vogler, Nicolai, Craig Stewart, and Graham Neubig. 2019. “Lost in Interpretation: Predicting Untranslated Terminology in Simultaneous Interpretation.” ArXiv:1904.00930 [Cs]. [URL]
Cited by (20)

Cited by 20 other publications

Liu, Jichao, Chengpan Liu, Buzheng Shan & Ömer S. Ganiyusufoglu
2024. A Computer-Assisted Interpreting System for Multilingual Conferences Based on Automatic Speech Recognition. IEEE Access 12 ► pp. 67498 ff. DOI logo
Liu, Yiguang & Junying Liang
2024. Multidimensional comparison of Chinese-English interpreting outputs from human and machine: Implications for interpreting education in the machine-translation age. Linguistics and Education 80 ► pp. 101273 ff. DOI logo
Pöchhacker, Franz
2024. Is machine interpreting interpreting?. Translation Spaces DOI logo
Chen, Sijia & Jan-Louis Kruger
2023. The effectiveness of computer-assisted interpreting. Translation and Interpreting Studies 18:3 ► pp. 399 ff. DOI logo
Chen, Sijia & Jan-Louis Kruger
2024. A computer-assisted consecutive interpreting workflow: training and evaluation. The Interpreter and Translator Trainer ► pp. 1 ff. DOI logo
Fantinuoli, Claudio
2023. Chapter 3. Towards AI-enhanced computer-assisted interpreting. In Interpreting Technologies – Current and Future Trends [IVITRA Research in Linguistics and Literature, 37], ► pp. 46 ff. DOI logo
G, Thimmaraja Yadava, Nagaraja B G, Jayanna H S & Shivakumar B R
2023. A spoken query system to access the real time agricultural commodity prices and weather information in Kannada language/dialects. Multimedia Tools and Applications 83:10 ► pp. 28675 ff. DOI logo
Goldsmith, Joshua
2023. Chapter 2. Tablet interpreting. In Interpreting Technologies – Current and Future Trends [IVITRA Research in Linguistics and Literature, 37], ► pp. 27 ff. DOI logo
Mellinger, Christopher D.
2023. Chapter 8. Embedding, extending, and distributing interpreter cognition with technology. In Interpreting Technologies – Current and Future Trends [IVITRA Research in Linguistics and Literature, 37], ► pp. 195 ff. DOI logo
Tian, Sha & Wenjiao Yang
2023. Modeling the use behavior of interpreting technology for student interpreters: An extension of UTAUT model. Education and Information Technologies DOI logo
Yuan, Lu & Binhua Wang
2023. Cognitive processing of the extra visual layer of live captioning in simultaneous interpreting. Triangulation of eye-tracked process and performance data. Ampersand 11 ► pp. 100131 ff. DOI logo
Yuan, Lu & Binhua Wang
2024. Eye-tracking the processing of visual input of live transcripts in remote simultaneous interpreting. FORUM. Revue internationale d’interprétation et de traduction / International Journal of Interpretation and Translation 22:1 ► pp. 118 ff. DOI logo
Zhang Xiaojun, Gloria Corpas Pastor & Jing Zhang
2023. Chapter 7. Videoconference interpreting goes multimodal. In Interpreting Technologies – Current and Future Trends [IVITRA Research in Linguistics and Literature, 37], ► pp. 169 ff. DOI logo
Cheung, Andrew K. F.
2022. Remote Simultaneous Interpreting from Home or Hub: Accuracy of Numbers from English into Mandarin Chinese. In Translation and Interpreting in the Age of COVID-19 [Corpora and Intercultural Studies, 9], ► pp. 113 ff. DOI logo
Chmiel, Agnieszka & Nicoletta Spinolo
2022. Testing the impact of remote interpreting settings on interpreter experience and performance. Translation, Cognition & Behavior 5:2 ► pp. 250 ff. DOI logo
Maggi, Ludovica & Sarah Bordes
2022. Intelligences en jeu. FORUM. Revue internationale d’interprétation et de traduction / International Journal of Interpretation and Translation 20:2 ► pp. 177 ff. DOI logo
Spinolo, Nicoletta & Ricardo Muñoz Martín
2022. Experiential learning for the remote interpreting classroom. In Re-Thinking Translator Education [Sprachen lehren – Sprachen lernen, ], ► pp. 193 ff. DOI logo
Wang, Huashu & Zhi Li
2022. Constructing a competence framework for interpreting technologies, and related educational insights: an empirical study. The Interpreter and Translator Trainer 16:3 ► pp. 367 ff. DOI logo
Zhao, Nan
2022. Use of Computer-Assisted Interpreting Tools in Conference Interpreting Training and Practice During COVID-19. In Translation and Interpreting in the Age of COVID-19 [Corpora and Intercultural Studies, 9], ► pp. 331 ff. DOI logo
Čeňková, Ivana
2022. Umělá inteligence a tlumočníci – víme, co nás čeká?. AUC PHILOLOGICA 2021:2 ► pp. 105 ff. DOI logo

This list is based on CrossRef data as of 5 july 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.