Cover not available
Article published In:
Journal of Second Language Pronunciation
Vol. 9:2 (2023) ► pp.234–262

Listener perceptions of customer service agents’ performance

Do comprehensibility, accentedness, and fluency matter?

ORCID logo | Concordia University
 | Western Kentucky University
 | Concordia University
 | The Hong Kong Polytechnic University
This study investigated listener-based assessment of the job performance of second language (L2) speakers employed as customer service agents in outsourced foreign-based call centers, focusing on agents’ job performance as a function of the comprehensibility, fluency, and accentedness of their speech. Using Amazon’s Mechanical Turk crowdsourcing platform, 116 native English-speaking listeners evaluated two-minute recordings of actual customer service conversations featuring 18 Filipino agents, assessing them for three global speech dimensions (comprehensibility, accentedness, and fluency) and three performance indicators, including agents’ confidence, competence, and listeners’ interest in future communication with agents (a measure capturing customer patronage). Comprehensibility and fluency consistently predicted how the listeners assessed the agents on all job performance scales, and accentedness was additionally associated with how strongly the listeners wished to communicate with the agents. Findings generally highlight the importance of fluent and comprehensible L2 speech in workplace settings.
Keywords: comprehensibility, accentedness, fluency, perception, customer service, foreign-based call center
Article outline
  • 1.Introduction
  • 2.Background literature
  • 3.The present study
  • 4.Method
    • 4.1Audio recordings
    • 4.2Listeners
    • 4.3Materials and procedure
  • 5.Data analysis
    • 5.1Rating reliability
    • 5.2Statistical modeling
  • 6.Results
  • 7.Discussion
  • 8.Implications, limitations, and future work
  • 9.Conclusion
  • Acknowledgments
  • Notes
  • References
Published online: 25 April 2022
DOI logo
https://doi.org/10.1075/jslp.21027.tsu
References (81)
References
Almeida, S., Fernando, M., Hannif, Z., & Dharmage, S. C. (2015). Fitting the mould: The role of employer perceptions in immigrant recruitment decision-making. The International Journal of Human Resource Management, 26 1, 2811–2832. DOI logoGoogle Scholar
Archer, D., & Jagodziński, P. (2015). Call centre interaction: A case of sanctioned face attack? Journal of Pragmatics, 76 1, 46–66. DOI logoGoogle Scholar
Bartoń, K. (2020). MuMIn: Multi-Model Inference. R package version 1.43.17. [URL]
Bates, D., Mäechler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67 1, 1–48. DOI logoGoogle Scholar
Bestelmeyer, P. E. G., Belin, P., & Ladd, D. R. (2015). A neural marker for social bias toward in- group accents. Cerebral Cortex, 25 1, 3953–3961. DOI logoGoogle Scholar
Blankenship, K. L., & Holtgraves, T. (2005). The role of different markers of linguistic powerlessness in persuasion. Journal of Language and Social Psychology, 24 1, 3–24. DOI logoGoogle Scholar
Bosker, H. R., Pinget, A. F., Quené, H., Sanders, T., & de Jong, N. H. (2013). What makes speech sound fluent? The contribution of pauses, speed and repairs. Language Testing, 30 1, 159–175. DOI logoGoogle Scholar
Brennan, E., & Brennan, J. (1981). Accent scaling and language attitudes: Reactions to Mexican American English speech. Language and Speech, 24 1, 207–221. DOI logoGoogle Scholar
Brennan, S. E., & Williams, M. (1995). The feeling of another’s knowing: Prosody and filled pauses as cues to listeners about the metacognitive states of speakers. Journal of Memory and Language, 34 1, 383–398. DOI logoGoogle Scholar
Camilleri, M. A. (2021). E-commerce websites, consumer order fulfillment and after-sales service satisfaction: The customer is always right, even after the shopping cart check-out. Journal of Strategy and Management. Advance online publication. DOI logoGoogle Scholar
Campbell-Kibler, K. (2007). Accent, (ING), and the social logic of listener perceptions. American Speech, 82 1, 32–64. DOI logoGoogle Scholar
CFI Group (2020). Contact center satisfaction index: Managing the entire customer experience. [URL]
Chicu, D., Pàmies, M., Ryan, G., & Cross, C. (2019). Exploring the influence of the human factor on customer satisfaction in call centres. Business Research Quarterly, 22 1, 83–95. DOI logoGoogle Scholar
Cocchiara, F. K., Bell, M. P., & Casper, W. J. (2016). Sounding “different”: The role of sociolinguistic cues in evaluating job candidates. Human Resource Management, 55 1, 463–477. DOI logoGoogle Scholar
Cowie, C., & Murty, L. (2010). Researching and understanding accent shifts in Indian call centre agents. In G. Forey & J. Lockwood (Eds.), Globalization, communication and the workplace: Talking across the world (pp. 125–144). Continuum.Google Scholar
D’Ausilio, R. (1998). Wake up your call center: How to be a better call center agent. Purdue University Press.Google Scholar
Darian, J. C., Tucci, L. A., & Wiman, A. R. (2001). Perceived salesperson service attributes and retail patronage intentions. International Journal of Retail Distribution Management, 29 1, 205–213. DOI logoGoogle Scholar
Davila, A., Bohara, A., & Saenz, R. (1993). Accent penalties and the earnings of Mexican Americans. Social Science Quarterly, 74 1, 902–916. [URL]Google Scholar
Derwing, T. M., & Munro, M. J. (1997). Accent, intelligibility, and comprehensibility: Evidence from four L1s. Studies in Second Language Acquisition, 19 1, 1–16. DOI logoGoogle Scholar
(2009). Comprehensibility as a factor in listener interaction preferences: Implications for the workplace. Canadian Modern Language Review, 66 1, 181–202. DOI logoGoogle Scholar
Derwing, T., Fraser, H., Kang, O., & Thomson, R. (2014). L2 accent and ethics: Issues that merit attention. In A. Mahboob & L. Barratt (Eds.), Englishes in multilingual contexts (pp. 63–80). Springer. DOI logoGoogle Scholar
Difallah, D., Filatova, E., & Ipeirotis, P. (2018). Demographics and dynamics of Mechanical Turk workers. Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, 135–143. DOI logoGoogle Scholar
Downing, J. R. (2011). Linking communication competence with call center agents’ sales effectiveness. Journal of Business Communication, 48 1, 409–425. DOI logoGoogle Scholar
Dragojevic, M., Giles, H., Beck, A.-C., & Tatum, N. T. (2017). The fluency principle: Why foreign accent strength negatively biases language attitudes. Communication Monographs, 84 1, 385–405. DOI logoGoogle Scholar
Erickson, B., Lind, A. E., Johnson, B. C., & O’Barr, W. M. (1978). Speech style and impression formation in a court setting: The effects of “powerful” and “powerless” speech. Journal of Experimental Social Psychology, 14 1, 266–279. DOI logoGoogle Scholar
Forey, G., & Lockwood, J. (2007). “I’d love to put someone in jail for this”: An initial investigation of English in the business processing outsourcing (BPO) industry. English for Specific Purposes, 26 1, 308–326. DOI logoGoogle Scholar
(Eds.) (2010). Globalization, communication, and the workplace: Talking across the world. Continuum.Google Scholar
Friginal, E. (2007). Outsourced call centers and English in the Philippines. World Englishes, 26 1, 331–345. DOI logoGoogle Scholar
Friginal, E., & Cullom, M. (2014). Saying ‘No’ in Philippine-based outsourced call center interactions. Asian Englishes, 16 1, 2–18. DOI logoGoogle Scholar
Gaffney, C., & Côté, S. (2020). Does personality influence ratings of foreign accents? Journal of Second Language Pronunciation, 6 1, 68–95. DOI logoGoogle Scholar
Gatbonton, E., Trofimovich, P., & Magid, M. (2005). Learners’ ethnic group affiliation and L2 pronunciation accuracy: A sociolinguistic investigation. TESOL Quarterly, 39 1, 489–511. DOI logoGoogle Scholar
Gluszek, A., Newheiser, A.-K., & Dovidio, J. F. (2011). Social psychological manipulations and accent strength. Journal of Language and Social Psychology, 30 1, 28–45. DOI logoGoogle Scholar
Goldberg, L. R. (1993). The structure of phenotypic personality traits. American Psychologist, 48 1, 26–34. DOI logoGoogle Scholar
Grandey, A. A., Dickter, D. N., & Sin, H.-P. (2004). The customer is not always right: Customer aggression and emotion regulation of service employees. Journal of Organizational Behavior, 25 1, 397–418. DOI logoGoogle Scholar
Graziano, W. G., & Tobin, R. M. (2017). Agreeableness and the Five Factor Model. In T. A. Widiger (Ed.), The Oxford handbook of the Five Factor Model (pp. 105–132). Oxford University Press.Google Scholar
Hallgren, K. A. (2012). Computing inter-rater reliability for observational data: An overview and tutorial. Tutorials in Quantitative Methods for Psychology, 8 1, 23–34. DOI logoGoogle Scholar
Hamp-Lyons, L., & Lockwood, J. (2009). The workplace, the society and the wider world: The offshoring and outsourcing industry. Annual Review of Applied Linguistics, 29 1, 145–167. DOI logoGoogle Scholar
Hayes-Harb, R., & Hacking, J. F. (2015). Beyond rating data: What do listeners believe underlies their accentedness judgments? Journal of Second Language Pronunciation, 1 1, 43–64. DOI logoGoogle Scholar
Hood, S., & Forey, G. (2008). The interpersonal dynamics of call-centre interactions: Co-constructing the rise and fall of emotion. Discourse & Communication, 2 1, 389–409. DOI logoGoogle Scholar
Hosman, L. (2015). Powerful and powerless speech styles and their relationship to perceived dominance and control. In R. Schulze, & H. Pishwa (Eds.), The exercise of power in communication (pp. 221–232). Palgrave Macmillan. DOI logoGoogle Scholar
Hosman, L. A., & Siltanen, S. A. (2011). Hedges, tag questions, message processing, and persuasion. Journal of Language and Social Psychology, 30 1, 341–349. DOI logoGoogle Scholar
Hosoda, M., Stone-Romero, E. F., & Walter, J. N. (2007). Listeners’ cognitive and affective reactions to English speakers with standard American English and Asian accents. Perceptual and Motor Skills, 104 1, 307–326. DOI logoGoogle Scholar
Hox, J. J., Moerbeek, M., & Van de Schoot, R. (2017). Multilevel analysis: Techniques and applications. Routledge. DOI logoGoogle Scholar
Hultgren, A. K. (2011). “Building rapport” with customers across the world: The global diffusion of a call centre speech style. Journal of Sociolinguistics, 15 1, 36–64. DOI logoGoogle Scholar
Isaacs, T., & Trofimovich, P. (2012). Deconstructing comprehensibility: Identifying the linguistic influences on listeners’ L2 comprehensibility ratings. Studies in Second Language Acquisition, 34 1, 475–505. DOI logoGoogle Scholar
Iwashita, N., Brown, A., McNamara, T., & O’Hagan, S. (2008). Assessed levels of second language speaking proficiency: How distinct? Applied Linguistics, 29 1, 24–49. DOI logoGoogle Scholar
Kahng, J. (2018). The effect of pause location on perceived fluency. Applied Psycholinguistics, 39 1, 569–591. DOI logoGoogle Scholar
Krahn, H., Derwing, T., Mulder, M., & Wilkinson, L. (2000). Educated and underemployed: Refugee integration into the Canadian labour market. Journal of International Migration and Integration, 1 1, 59–84. DOI logoGoogle Scholar
Krishnamurthy, M. (2018). 1-800-Worlds: The making of Indian call centre economy. Oxford University Press.Google Scholar
Levis, J. M. (2018). Intelligibility, oral communication, and the teaching of pronunciation. Cambridge University Press. DOI logoGoogle Scholar
Linck, J. A., & Cunnings, I. (2015). The utility and application of mixed-effects models in second language research. Language Learning, 65 1, 185–207. DOI logoGoogle Scholar
Lippi-Green, R. (2012). English with an accent: Language, ideology, and discrimination in the United States. Routledge. DOI logoGoogle Scholar
Lockwood, J. (2012). Are we getting the right people for the job? A study of English language recruitment assessment practices in the business processing outsourcing sector: India and the Philippines. The Journal of Business Communication, 49 1, 107–127. DOI logoGoogle Scholar
Lockwood, J. E. (2015). Language for Specific Purpose (LSP) performance assessment in Asian call centres: Strong and weak definitions. Language Testing in Asia, 5 1, 1–11. DOI logoGoogle Scholar
(2018). Theorising communications coaching in Asian contact centres: What is the approach? Industrial and Commercial Training, 50 1, 312–325. DOI logoGoogle Scholar
Marbach, J., Lages, C. R., & Nunan, D. (2016). Who are you and what do you value? Investigating the role of personality traits and customer-perceived value in online customer engagement. Journal of Marketing Management, 32 1, 502–525. DOI logoGoogle Scholar
Munro, M. J., & Derwing, T. M. (1995). Foreign accent, comprehensibility, and intelligibility in the speech of second language learners. Language Learning, 45 1, 73–97. DOI logoGoogle Scholar
Nagle, C. (2019). Developing and validating a methodology for crowdsourcing L2 speech ratings in Amazon Mechanical Turk. Journal of Second Language Pronunciation, 5 1, 294–323. DOI logoGoogle Scholar
Nagle, C., & Rehman, I. (2021). Doing L2 speech research online: Why and how to collect online ratings data. Studies in Second Language Acquisition, 43 1, 916–939. DOI logoGoogle Scholar
Nelson, C. L. (2012). Intelligibility in World Englishes: Theory and application. Routledge. DOI logoGoogle Scholar
O’Brien, M. G. (2016). Methodological choices in rating speech samples. Studies in Second Language Acquisition, 38 1, 587–605. DOI logoGoogle Scholar
Orth, U. R., & Wirtz, J. (2014). Consumer processing of interior service environments: The interplay among visual complexity, processing fluency, and attractiveness. Journal of Service Research, 17 1, 296–309. DOI logoGoogle Scholar
Parton, S. R., Siltanen, S. A., Hosman, L. A., & Langenderfer, J. (2002). Employment interview outcomes and speech style effects. Journal of Language and Social Psychology, 21 1, 144–161. DOI logoGoogle Scholar
Plonsky, L., & Oswald, F. L. (2014). How big is “big”? Interpreting effect sizes in L2 research. Language Learning, 64 1, 878–912. DOI logoGoogle Scholar
Presbitero, A. (2017). It’s not all about language ability: Motivational cultural intelligence matters in call center performance. The International Journal of Human Resource Management, 28 1, 1547–1562. DOI logoGoogle Scholar
R Core Team (2020). R: A language and environment for statistical computing [Computer software]. R Foundation for Statistical Computing. [URL]
Ramjattan, V. A. (2019). Racializing the problem of and solution to foreign accent in business. Applied Linguistics Review. Advanced online publication. DOI logoGoogle Scholar
Reber, R., & Greifeneder, R. (2017). Processing fluency in education: How metacognitive feelings shape learning, belief formation, and affect. Educational Psychologist, 52 1, 84–103. DOI logoGoogle Scholar
Revelle, W. (2021). psych: Procedures for psychological, psychometric, and personality research. Northwestern University, Evanston, Illinois. R package version 2.1.3. [URL]
Rossiter, M. J. (2009). Perceptions of L2 fluency by native and non-native speakers of English. The Canadian Modern Language Review, 65 1, 395–412. DOI logoGoogle Scholar
Saito, K., Trofimovich, P., & Isaacs, T. (2017). Using listener judgments to investigate linguistic influences on L2 comprehensibility and accentedness: A validation and generalization study. Applied Linguistics, 38 1, 439–462. DOI logoGoogle Scholar
Sanchez, C. A., & Khan, S. (2016). Instructor accents in online education and their effect on learning and attitudes. Journal of Computer Assisted Learning, 32 1, 494–502. DOI logoGoogle Scholar
Schwarz, N. (2004). Metacognitive experiences in consumer judgment and decision making. Journal of Consumer Psychology, 14 1, 332–348. DOI logoGoogle Scholar
Segalowitz, N. (2010). Cognitive bases of second language fluency. Routledge. DOI logoGoogle Scholar
Soto, C. J., & John, O. P. (2017). Short and extra-short forms of the Big Five Inventory-2: The BFI-2-S and BFI-2-XS. Journal of Research in Personality, 68 1, 69–81. DOI logoGoogle Scholar
Tavakoli, P., & Hunter, A.-M. (2017). Is fluency being “neglected” in the classroom? Teacher understanding of fluency and related classroom practices. Language Teaching Research, 22 1, 330–349. DOI logoGoogle Scholar
Tavakoli, P., Nakatsuhara, F., & Hunter, A.-M. (2020). Aspects of fluency across assessed levels of speaking proficiency. The Modern Language Journal, 104 1, 169–191. DOI logoGoogle Scholar
Timming, A. R. (2017). The effect of foreign accent on employability: A study of the aural dimensions of aesthetic labour in customer-facing and non-customer-facing jobs. Work, Employment and Society, 31 1, 409–428. DOI logoGoogle Scholar
Whitaker, J., Krishnan, M. S., Fornell, C., & Morgeson, F. (2020). How does customer service offshoring impact customer satisfaction? Journal of Computer Information Systems, 60 1, 569–582: DOI logoGoogle Scholar
Wilt, J., & Revelle, W. (2017). Extraversion. In T. A. Widiger (Ed.), The Oxford handbook of the Five Factor Model (pp. 57–81). Oxford University Press.Google Scholar
Cited by (1)

Cited by one other publication

Teló, Cesar, Rosane Silveira, Ana Flávia Boeing Marcelino & Mary G O’Brien
2024. Accent Bias in Professional Evaluations: A Conceptual Replication Study in Brazil. Applied Linguistics 45:6 ► pp. 1010 ff. DOI logo

This list is based on CrossRef data as of 10 january 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.