Cover not available
Article published In:
Target
Vol. 35:4 (2023) ► pp.483–513

Use of statistical methods in translation and interpreting research

A longitudinal quantitative analysis of eleven peer-reviewed journals (2000–2020)

ORCID logo | Xiamen University
ORCID logo | Xiamen University
ORCID logo | Xiamen University
The study reported on in the article examines the patterns and trends of statistical analysis in translation and interpreting (T&I) research, based on a longitudinal quantitative analysis of more than 3300 research articles sampled from eleven leading T&I journals (2000–2020). This evidence-based review is the first study to provide a systematic mapping of statistical methods used by T&I researchers. Our analyses suggest that (a) about 40% of the articles use statistics, and the use of statistics has been increasing over time; (b) the most frequently used inferential statistical techniques are the t-test, Pearson’s correlation, and chi-squared test; and (c) although the use of statistical methods has become increasingly diversified, about 90% of the methods used are basic-level statistics. We discuss these findings in relation to statistical teaching and learning for relevant stakeholders, especially T&I researchers.
Keywords: statistical analysis, systematic review, statistical literacy, statistical teaching and learning, translation and interpreting research
Article outline
  • 1.Introduction
  • 2.Categorization schemes for statistical methods
  • 3.Statistics in T&I Studies
  • 4.Research questions
  • 5.Method
    • 5.1T&I journals
    • 5.2Article selection
    • 5.3Coding scheme
    • 5.4Coding procedure
    • 5.5Data analysis
  • 6.Results
    • 6.1The extent of use of statistical methods
    • 6.2Frequency of statistical use
    • 6.3Diversity of statistical use
    • 6.4The patterns of statistical use
    • 6.5Statistical methods labeled ‘Others’
  • 7.Discussion
  • 8.Conclusion
  • Notes
  • References
Published online: 23 May 2023
DOI logo
https://doi.org/10.1075/target.21132.han
References (41)
References
Balling, Laura Winther. 2008. “A Brief Introduction to Regression Designs and Mixed-Effects Modelling by a Recent Convert.” Copenhagen Studies in Language 361: 175–192.Google Scholar
Balling, Laura Winther, and Kristian Tangsgaard Hvelplund. 2015. “Design and Statistics in Quantitative Translation (Process) Research.” In Translation as a Cognitive Activity, edited by Fabio Alves, Amparo Hurtado Albir, and Isabel Lacruz, special issue of Translation Spaces 4 (1): 169–186. DOI logoGoogle Scholar
Blanca, María J., Rafael Alarcón, and Roser Bono. 2018. “Current Practices in Data Analysis Procedures in Psychology: What Has Changed?” Frontiers in Psychology 91: 2558. DOI logoGoogle Scholar
Carl, Michael, Srinivas Bangalore, and Moritz Schaeffer, eds. 2016. New Directions in Empirical Translation Process Research: Exploring the CRITT TPR-DB. Cham: Springer. DOI logoGoogle Scholar
De Sutter, Gert, and Marie-Aude Lefer. 2020. “On the Need for a New Research Agenda for Corpus-Based Translation Studies: A Multi-Methodological, Multifactorial and Interdisciplinary Approach.” Perspectives 28 (1): 1–23. DOI logoGoogle Scholar
Eyckmans, June, Philippe Anckaert, and Winibert Segers. 2009. “The Perks of Norm-Referenced Translation Evaluation.” In Testing and Assessment in Translation and Interpreting Studies: A Call for Dialogue between Research and Practice, edited by Claudia V. Angelelli and Holly E. Jacobson, 73–93. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Field, Andy. 2009. Discovering Statistics Using SPSS. 3rd ed. Thousand Oaks: Sage.Google Scholar
Franco Aixelá, Javier. 2001–2022. BITRA – Bibliography of Interpreting and Translation. Open-access database. [URL]
. 2009. “Interpreting Studies: A Critical View from within.” In A (Self-)Critical Perspective of Translation Theories, edited by Àfrica Vidal and Javier France, special issue of MonTI 11: 135–155. DOI logoGoogle Scholar
Gile, Daniel, Helle V. Dam, Friedel Dubslaff, Bodil Martinsen, and Anne Schjoldager, eds. 2001. Getting Started in Interpreting Research: Methodological Reflections, Personal Accounts and Advice for Beginners. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Goodwin, Laura D., and William L. Goodwin. 1985. “Statistical Techniques in AERJ Articles, 1973–1983: The Preparation of Graduate Students to Read the Educational Research Literature.” Educational Researcher 14 (2): 5–11.Google Scholar
Han, Chao. 2016. “Reporting Practices of Rater Reliability in Interpreting Research: A Mixed-Methods Review of 14 Journals (2004–2014).” In Mixed Methods, edited by Anna Kuznik and Joan Miquel Verd, special issue of Journal of Research Design and Statistics in Linguistics and Communication Science 3 (1): 49–75. DOI logoGoogle Scholar
. 2017. “Using Analytic Rating Scales to Assess English/Chinese Bi-Directional Interpreting: A Longitudinal Rasch Analysis of Scale Utility and Rater Behavior.” In Translator Quality – Translation Quality: Empirical Approaches to Assessment and Evaluation, edited by Geoffrey S. Koby and Isabel Lacruz, special issue of Linguistica Antverpiensia, New Series – Themes in Translation Studies 161: 196–215.Google Scholar
. 2018. “Mixed-Methods Research in Interpreting Studies: A Methodological Review (2004–2014).” Interpreting 20 (2): 155–187. DOI logoGoogle Scholar
. 2019. “A Generalizability Theory Study of Optimal Measurement Design for A Summative Assessment of English/Chinese Consecutive Interpreting.” Language Testing 36 (3): 419–438. DOI logoGoogle Scholar
. 2022. “Interpreting Testing and Assessment: A State-of-the-art Review.” Language Testing 39 (1): 30–55. DOI logoGoogle Scholar
Han, Chao, and Xiaoqi Shang. 2023. “An Item-based, Rasch-Calibrated Approach to Assessing Translation Quality.” Target 35 (1): 63–96. DOI logoGoogle Scholar
Jenkins, Stephen J., Dale R. Fuqua, and Thomas C. Froehle. 1984. “A Critical Examination of Use of Non-Parametric Statistics in the Journal of Counseling Psychology .” Perceptual and Motor Skills 59 (1): 31–35. DOI logoGoogle Scholar
Khany, Reza, and Khalil Tazik. 2019. “Levels of Statistical Use in Applied Linguistics Research Articles: From 1986 to 2015.” Journal of Quantitative Linguistics 26 (1): 48–65. DOI logoGoogle Scholar
Larson-Hall, Jenifer. 2015. A Guide to Doing Statistics in Second Language Research Using SPSS and R. 2nd ed. New York: Routledge. DOI logoGoogle Scholar
Liu, Minhua. 2011. “Methodology in Interpreting Studies: A Methodological Review of Evidence-Based Research.” In Advances in Interpreting Research: Inquiry in Action, edited by Brenda Nicodemus and Laurie Swabey, 85–119. Amsterdam: Johan Benjamins. DOI logoGoogle Scholar
. 2016. “Putting the Horse before the Cart: Righting the Experimental Approach in Interpreting Studies.” In Addressing Methodological Challenges in Interpreting Studies Research, edited by Claudio Bendazzoli and Claudia Monacelli, 87–105. Newcastle upon Tyne: Cambridge Scholars.Google Scholar
Marco, Josep. 2009. “Training Translation Researchers: An Approach Based on Models and Best Practice.” The Interpreter and Translator Trainer 3 (1): 13–35. DOI logoGoogle Scholar
Mason, Ian. 2009. “Research Training in Translation Studies.” The Interpreter and Translator Trainer 3 (1): 1–12. DOI logoGoogle Scholar
Mead, Peter. 2001. “Doctoral Work on Interpretation: A Supervisee’s Perspective.” In Getting Started in Interpreting Research: Methodological Reflections, Personal Accounts and Advice for Beginners, edited by Daniel Gile, Helle V. Dam, Friedel Dubslaff, Bodil Martinsen, and Anne Schjoldager, 121–144. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Meister, Lova. 2018. “On Methodology: How Mixed Methods Research Can Contribute to Translation Studies.” Translation Studies 11 (1): 66–83. DOI logoGoogle Scholar
Mellinger, Christopher D., and Thomas A. Hanson. 2017. Quantitative Research Methods in Translation and Interpreting Studies. Abingdon: Routledge.Google Scholar
. 2019. “Meta-Analyses of Simultaneous Interpreting and Working Memory.” Interpreting 21 (2): 165–195. DOI logoGoogle Scholar
. 2020. “Methodological Considerations for Survey Research: Validity, Reliability, and Quantitative Analysis.” In Cognitive Translation Studies – Theoretical Models and Methodological Criticism, edited by Ricardo Muñoz Martín and Kairong Xiao, special issue of Linguistica Antverpiensia, New Series – Themes in Translation Studies 191: 172–190.Google Scholar
Muñoz Martín, Ricardo, Sanjun Sun, and Defeng Li. 2021. Advances in Cognitive Translation Studies. Singapore: Springer Nature. DOI logoGoogle Scholar
Oakes, Michael. 2019. “Statistics for Corpus-Based and Corpus-Driven Approaches to Empirical Translation Studies.” In Advances in Empirical Translation Studies: Developing Translation Resources and Technologies, edited by Meng Ji and Michael Oakes, 28–52. Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Olohan, Maeve, and Mona Baker. 2009. “Coherence and Clarity of Objectives in Doctoral Projects: A Research Design Workshop.” The Interpreter and Translator Trainer 3 (1): 143–164. DOI logoGoogle Scholar
Page, Matthew J., Joanne E. McKenzie, Patrick M. Bossuyt, Isabelle Boutron, Tammy C. Hoffmann, Cynthia D. Mulrow, Larissa Shamseer et al. 2021. “The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews.” British Medical Journal 372 (71): 1–9.Google Scholar
Pöchhacker, Franz. 2011. “Researching Interpreting: Approaches to Inquiry.” In Advances in Interpreting Research: Inquiry in Action, edited by Brenda Nicodemus and Laurie Swabey, 5–25. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Pöchhacker, Franz, and Minhua Liu. 2021. “Interpreting Research in Print: A Quarter-Century Update.” Interpreting 23 (1): 1–17. DOI logoGoogle Scholar
Saldanha, Gabriela, and Sharon O’Brien. 2013. Research Methodologies in Translation Studies. Manchester: St Jerome.Google Scholar
Schäffner, Christina, ed. 2004. Translation Research and Interpreting Research: Traditions, Gaps and Synergies. Clevedon: Multilingual Matters. DOI logoGoogle Scholar
Shang, Xiaoqi, and Guixia Xie. 2020. “Aptitude for Interpreting Revisited: Predictive Validity of Recall Across Languages.” In Remote Interpreting, edited by Mariachiara Russo, Emilia Iglesias Fernàndez, and Sabine Braun, special issue of The Interpreter and Translator Trainer 14 (3): 344–361. DOI logoGoogle Scholar
Zanettin, Federico, Gabriela Saldanha, and Sue-Ann Harding. 2015. “Sketching Landscapes in Translation Studies: A Bibliographic Study.” In Bibliometric and Bibliographical Research in Translation Studies, edited by Sara Rovira-Esteva, Pilar Orero, and Javier Franco Aixelá, special issue of Perspectives 23 (2): 161–182. DOI logoGoogle Scholar