Exploring the predictive validity of an interpreting aptitude test battery
An approximate replication
This study explores the validity of a battery of interpreting aptitude tests comprising the SynCloze test, the
Negative Affectivity Scale and the Inventory of Learning Styles in predicting the interpreting performance of Chinese interpreting
trainees. The aptitude test battery was conducted at the beginning of the first semester for 68 post-graduate interpreting
students in four Chinese interpreter training programs. English-Chinese (E-C) and Chinese-English (C-E) consecutive interpreting
(CI) tests that measure the interpreting proficiency of the participants were conducted at the end of the semester. The results of
the correlation and regression analysis indicated that the SynCloze test enjoyed statistically significant predictive power for
both directions of CI and that its predictive power was stronger for C-E CI (β = 0.70) than for E-C CI
(β = 0.48); negative affectivity was found to be a statistically significant predictor for E-C CI
(β = −0.21) but not for C-E CI. Neither the meaning-directed nor the reproduction-directed learning style
could predict interpreting performance. The implications of the findings are discussed in relation to interpreter selection and
training.
Article outline
- 1.Introduction
- 2.Literature review
- 3.Methods
- 3.1Participants
- 3.2Materials
- 3.2.1Aptitude test battery
- 3.2.2CI tests
- 3.3Procedure
- 3.4Scoring aptitude tests
- 3.5Assessment of interpreting performance
- 3.5.1Rater selection
- 3.5.2Rating criteria
- 3.5.3Rater training
- 3.5.4Inter-rater reliability
- 3.5.4.1Inter-rater reliability of pilot scoring
- 3.5.4.2Inter-rater reliability of actual scoring
- 3.6Data analysis
- 4.Results
- 4.1Correlation analysis
- 4.2Regression analysis
- 4.2.1Regression for E-C CI
- 4.2.2Regression for C-E CI
- 5.Discussion
- 5.1Predictive power of the aptitude tests
- 5.1.1The SynCloze test
- 5.1.2Negative affectivity
- 5.1.3Learning styles
- 5.2Implications for candidate screening
- 5.3Implications for interpreter training
- 6.Conclusion
- Acknowledgements
- Notes
-
References
References (33)
References
European Union (2020). Marking
criteria for consecutive (indicative only). [URL] (accessed 10 May 2021).
Field, A. (2018). Discovering
statistics using IBM SPSS statistics (5th
ed.). London: SAGE Publications Ltd.
Gerver, D., Longley, P., Long, J. & Lambert, S. (1984). Selecting
trainee conference interpreters: A preliminary study. Journal of Occupational
Psychology 57 (1), 17–31.
Higginbottom, H. (2015). Consultation
on People-to-People Exchange – U.S.–China Consultation on CPE Women’s Leadership Exchange and Dialogue
event. [URL] (accessed 13 October 2021).
Huang, L., Yang, T. & Ji, Z. (2003). Applicability
of the positive and negative affect scale in Chinese (in Chinese). Chinese Mental Health
Journal
17
(1), 54–56.
ILR (n.d.). ILR skill level
descriptions for interpretation performance. [URL] (accessed 10 May 2021).
Longley, P. (1989). The
use of aptitude testing in the selection of students for conference interpretation
training. In L. Gran & J. Dodds (Eds.), The
theoretical and practical aspects of teaching conference
interpretation. Udine: Campanotto, 105–108.
Martin, W. & Bridgmon, K. (2012). Quantitative
and statistical research methods: From hypothesis to results. San Francisco: Jossey-Bass.
McGraw, K. O. & Wong, P. (1996). Forming
inferences about some intraclass correlation coefficients. Psychological
Methods
1
(1), 30.
NAATI (2020). Certified conference
interpreter test assessment rubrics. [URL] (accessed 10 May 2021).
Nichols, D. P. (1998). Choosing
an intraclass correlation coefficient. SPSS
Keywords
67
1, 1–2.
Porte, G. & Richards, K. (2012). Focus
article: Replication in second language writing research. Journal of Second Language
Writing
21
1, 284–293.
Portney, L. G. & Watkins, M. P. (2000). Foundations
of clinical research: Applications to practice. Upper Saddle River, NJ: Prentice Hall.
Shang, X. & Xie, G. (2020). Aptitude
for interpreting revisited: Predictive validity of recall across languages. The Interpreter and
Translator
Trainer
14
(3), 344–361.
Timarová, Š. & Ungoed-Thomas, H. (2008). Admission
testing for interpreting courses. The Interpreter and Translator
Trainer
2
(1), 29–46.
Vermunt, J. D. (1994). Inventory
of learning styles in higher education. Tilburg: Tilburg University.
Vermunt, J. D. & Donche, V. (2017). A
learning patterns perspective on student learning in higher education: State of the art and moving
forward. Educational
Psychology Review
29
(2), 269–299.
Watson, D., Clark, A. & Tellegen, A. (1988). Development
and validation of brief measures of positive and negative affect: The PANAS scales. Journal of
Personality and Social
Psychology
54
(6), 1063–1070.
Xing, X. (2015). Research
on interpreting aptitude and its testing: A case study of admission tests for MTI in China (in
Chinese). Foreign Language Testing and
Teaching
3
1, 9–29.
Xing, X. (2017). The
effects of personality hardiness on interpreting performance: Implications for aptitude testing for
interpreting. PhD dissertation, Xiamen University.
Xu, H. (2013). Learning
statistics from examples of second language research (in
Chinese). Beijing: Foreign Language Teaching and Research Press.
Xu, X. (2012). Transcript
of Xiaonian Xu’s Speech at the 12th Annual Conference of BOAO 21st Century Real Estate Forum (in
Chinese). [URL] (accessed 13 October 2021).
Yu, H., Luo, Y., Sa, J. & Ai, Y. (2011). Intraclass
correlation coefficient and software procedures (in Chinese). Chinese Journal of Health
Statistics
28
(5), 497–500.
Cited by (3)
Cited by three other publications
Han, Chao
2023.
Interrogating the predictive validity of aptitude testing for interpreting: a systematic methodological review.
The Interpreter and Translator Trainer 17:1
► pp. 7 ff.
Lu, Rong, Muhammad Alif Redzuan Abdullah & Lay Hoon Ang
2023.
Into-A or Into-B, That is a Question: A Systematic Literature Review of Directionality and Performance in Consecutive Interpreting.
Sage Open 13:4
Shang, Xiaoqi, Mariachiara Russo & Catherine Chabasse
2023.
Introduction to the special issue
Revisiting aptitude testing for interpreting
.
The Interpreter and Translator Trainer 17:1
► pp. 1 ff.
This list is based on CrossRef data as of 18 october 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.