Experimental contributions of eye-tracking to the understanding of comprehension processes while hearing and reading code-switches
Jorge R. Valdés Kroff | Department of Spanish and Portuguese Studies, University of Florida
Rosa E. Guzzardo Tamargo | Department of Hispanic Studies, Graduate Program of Linguistics, University of Puerto Rico-Río Piedras
Paola E. Dussias | Department of Spanish, Italian and Portuguese, Penn State University | Center for Language Science, Penn State University
Researchers who study code-switching using lab-based approaches face a series of methodological challenges; these include, but are not limited to, using adequate techniques and tasks that allow for processing that reflects real-language usage and selecting stimuli that reflect the participants’ code-switching community norms. We present two illustrative eye-tracking studies that consider these challenges. Study 1 tests whether experience with code-switching leads to differential processing of Spanish determiner-English noun code-switches (e.g., una cookie ‘a cookie’). Study 2 examines auxiliary-verb code-switches involving the progressive structure (e.g., están cooking ‘are cooking’) and perfect structure (e.g., han cooked ‘have cooked’) while participants read either for comprehension or provide grammaticality judgments. The results of both studies highlight the advantages that eye-tracking provides when its use is accompanied by an appropriate bilingual sample, by stimuli that reflect actual bilingual language use, and by secondary tasks that do not invoke metalinguistic processes.
Altarriba, J., Kroll, J. F., Sholl, A., & Rayner, K.
(1996) The influence of lexical and conceptual constraints on reading mixed-language sentences: Evidence from eye fixations and naming times. Memory and Cognition, 241, 477–492.
Altmann, G T M.
(2011) The mediation of eye movements by spoken language. In S. P. Liversedge, I. D. Gilchrist, & S. Everling (Eds.), The Oxford handbook of eye movements (pp. 979–1004). Oxford, UK: Oxford University Press.
Altmann, G T M., & Kamide, Y.
(1999) Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition, 731, 247–264.
Badiola, L., Delgado, R., Sande, A., & Stefanich, S.
(2015) Spanish-English bilingual voice onset time in spontaneous code-switching. International Journal of Bilingualism, 191, 423–443.
Blackburn, A.
(2013) A study of the relationship between code switching and the bilingual advantage: Evidence that language use modulates neural indices of language processing and cognitive control. (Unpublished doctoral dissertation). University of Texas at San Antonio, San Antonio, TX.
Brown-Schmidt, S., & Konopka, A. E.
(2008) Little houses and casa pequeñas: Message formulation and syntactic form in unscripted speech with speakers of English and Spanish. Cognition, 1091, 274–280.
Brown-Schmidt, S., & Konopka, A. E.
(2015) Processes of incremental message planning during conversation. Psychonomics Bulletin Review, 221, 833–843.
Brown-Schmidt, S., & Tanenhaus, M. K.
(2008) Real-time investigation of referential domains in unscripted conversation: A targeted language game approach. Cognitive Science, 321, 643–684.
Bullock, B., & Toribio, A. J.
(2009) Themes in the study of code-switching. In B. E. Bullock & A. J. Toribio (Eds.), The Cambridge handbook of linguistic code-switching (pp. 1–17). Cambridge, UK: Cambridge University Press.
Bultena, S., Dijkstra, T., & Van Hell, J. G.
(2015a) Language switch costs in comprehension depend on language dominance: Evidence from self-paced reading. Bilingualism: Language and Cognition, 181, 453–469.
Bultena, S., Dijkstra, T., & Van Hell, J. G.
(2015b) Switch cost modulations in bilingual sentence processing: Evidence from shadowing. Language, Cognition, and NeuroScience, 301, 586–605.
Callahan, L.
(2003) Spanish/English code-switching in a written corpus. Philadelphia, PA: John Benjamins.
Chan, M. C., Chau, H., & Hoosain, R.
(1983) Input/output switch in bilingual code switching. Journal of Psycholinguistic Research, 121, 407–416.
Clifton, C., Jr., & Staub, A.
(2011) Syntactic influences on eye movements in reading. In S. P. Liversedge, I. D. Gilchrist, & S. Everlling (Eds.), The Oxford handbook of eye movements (pp. 895–909). Oxford, UK: Oxford University Press.
Dell, G. S., & Chang, F.
(2013) The P-chain: Relating sentence production and its disorders to comprehension and acquisition. Philosophical Transactions of the Royal Society B, 3691.
Deuchar, M., Davies, P., Herring, J. R., Parafita Couto, M. C., & Carter, D.
(2014) Building bilingual corpora: Welsh-English, Spanish-English and Spanish-Welsh. In E. M. Thomas & I. Mennen (Eds.), Advances in the study of bilingualism (pp. 93–110). Bristol, UK: Multilingualism Matters.
Dorleijn, M., & Nortier, J.
(2009) Code-switching and the internet. In B. Bullock & A. J. Toribio (Eds.), The Cambridge handbook of linguistic code-switching. Cambridge, UK: Cambridge University Press.
Dussias, P. E.
(2003) Spanish-English code-mixing at the auxiliary phrase: Evidence from eye-movement data. Revista Internacional de Lingüística Iberoamericana, 21, 7–34.
Dussias, P. E., Guzzardo Tamargo, R. E., Valdés Kroff, J. R., & Gerfen, C.
(2014) Looking into comprehension of Spanish-English code-switched sentences: Evidence from eye movements. In F. -H. Liu & J. Huang (Eds.), Peaches and plums (pp. 335–351). Taipei, Taiwan: Academia Sinica.
Dussias, P. E., Valdés Kroff, J. R., & Gerfen, C.
(2014) Using the visual world to explore spoken language processing in second language speakers. In J. Jegerski & B. Van Patten (Eds.), Research methods in second language psycholinguistics (pp. 93–126). London, UK: Taylor & Francis.
(2015) Determiner-noun code-switching in Spanish-English heritage speakers. Bilingualism: Language and Cognition.
Federmeier, K. D., McLennan, D. B., De Ochoa, E., & Kutas, M.
(2002) The impact of semantic memory organization and sentence context information on spoken language processing by younger and older adults: An ERP study. Psychophysiology, 391, 133–146.
Fodor, J. A., & Bever, T. G.
(1965) The psychological reality of linguistic segments. Journal of Verbal Learning and Verbal Behavior, 41, 414–420
Fricke, M., Kroll, J. F., & Dussias, P. E.
(2016) Phonetic variation in bilingual speech: A lens for studying the production-comprehension link. Journal of Memory and Language, 891, 110–137.
Gardner-Chloros, P.
(2009) Code-swtiching. Cambridge, UK: Cambridge University Press.
Garnsey, S. M., Pearlmutter, N. J., Myers, E., & Lotocky, M. A.
(1997) The contributions of verb bias and plausibility to the comprehension of temporarily ambiguous sentences. Journal of Memory and Language, 931, 58–93.
Gennari, S. P., & MacDonald, M. C.
(2009) Linking production and comprehension processes: The case of relative clauses. Cognition, 1111, 1–23.
(1987) Language blocking and lexical access in bilinguals. The Quarterly Journal of Experimental Psychology, A391, 295–319.
Green, D.
(2011) Language control in different contexts: The behavioural ecology of bilingual speakers. Frontiers in Psychology, 21, 1–4.
Griffin, Z., & Bock, J. K.
(2000) What the eyes say about speaking. Psychological Science, 111, 274–279.
Grosjean, F.
(2001) The bilingual’s language modes. In L. N. Janet (Ed.), One mind, two languages: Bilingual language processing (pp. 1–22). Oxford, UK: Blackwell.
Gullberg, M., Indefrey, P., & Muysken, P.
(2009) Research techniques for the study of code-switching. In B. Bullock & A. J. Toribio (Eds.), The Cambridge handbook of linguistic code-switching (pp. 21–39). Cambridge, UK: Cambridge University Press.
Gullifer, J. W., Kroll, J. F., & Dussias, P. E.
(2013) When language switching has no apparent cost: Lexical access in sentence context. Frontiers in Psychology, 41, 1–13.
Guzzardo Tamargo, R. E., & Dussias, P. E.
(2013) Processing of Spanish-English code-switches by late bilinguals. In S. Baiz, N. Goldman, & R. Hawkes (Eds.), BUCLD 37: Proceedings of the 37th annual Boston University Conference on Language Development (pp. 134–146). Somerville, MA: Cascadilla Press.
Guzzardo Tamargo, R. E., Valdés Kroff, J. R., & Dussias, P. E.
(2016) Using code-switching as a tool to study the link between production and comprehension. Journal of Memory and Language, 891, 138–161.
Hamers, J. F., & Blanc, M H A.
(2000) Bilinguality and bilingualism (2nd ed.). Cambridge, UK: Cambridge University Press.
Hanna, J. E., Tanenhaus, M. K., & Trueswell, J. C.
(2003) The effects of common ground and perspective in domains of referential interpretation. Journal of Memory and Language, 491, 43–61.
Herring, J. R., Deuchar, M., Parafita Couto, M. C., & Moro Quintanilla, M.
(2010) “I saw the madre”: Evaluating predictions about code-switched determiner-noun sequences using Spanish-English and Welsh-English data. International Journal of Bilingual Education and Bilingualism, 131, 553–573.
(2011) Using the visual world paradigm to study language processing: A review and critical evaluation. Acta Psychologica, 1371, 151–171.
Jake, J., Myers-Scotton, C., & Gross, S.
(2002) Making a minimalist approach to code-switching work: Adding the matrix language. Bilingualism: Language and Cognition, 51, 69–91.
Kaplan, E., Goodglass, H., Weintraub, S., & Segal, O.
(1983) Boston Naming Test. Philadelphia, PA: Lea & Febiger.
Keating, G. D.
(2014) Eye-tracking with text. In J. Jegerski & B. Van Patten (Eds.), Research methods in second language psycholinguistics (pp. 69–92). London, UK: Taylor & Francis.
Kolers, P. A.
(1966) Reading and talking bilingually. American Journal of Psychology, 791, 357–376.
Kootstra, G. J., Van Hell, J. G., & Dijkstra, T.
(2012) Priming of code-switching in sentences: The role of lexical repetition, cognates, and proficiency. Bilingualism: Language and Cognition, 151, 797–819.
Lance, D. M.
(1975) Spanish-English code-switching. In E. Hernández-Chávez & A. Beltramo (Eds.), El lenguaje de los chicanos. Arlington, VA: Center for Applied Linguistics.
Lawrence, M. A.
(2011) ez: Easy analysis and visualization of factorial experiments. R package version 3.0–0. [URL]
Lew-Williams, C., & Fernald, A.
(2007) Young children learning Spanish make rapid use of grammatical gender in spoken word recognition. Psychological Science, 181, 193–198.
Lipski, J. M.
(1978) Code switching and the problem of bilingual competence. In M. Paradis (Ed.), Aspects of bilingualism (pp. 250–264). Columbia, SC: Hornbeam Press.
MacDonald, M. C.
(2013) How language production shapes language form and comprehension. Frontiers in Psychology, 41.
MacNamara, J., & Kushnir, S. L.
(1971) Linguistic independence of bilinguals: The input switch. Journal of Verbal Learning and Verbal Behavior, 101, 480–487.
Meuter, R. F., & Allport, A.
(1999) Bilingual language switching in naming: Asymmetrical costs of language selection. Journal of Memory and Language, 401, 25–40.
Montes-Alcalá, C.
(2000) Written code-switching: Powerful bilingual images. In R. Jacobson (Ed.), Code-switching worldwide II (pp. 193–219). Berlin, Germany: Mouton de Gruyter.
Montes-Alcalá, C.
(2007) Blogging in two languages: Code-switching in bilingual blogs. In J. Holmquist, A. Lorenzino, & L. Sayahi (Eds.), Selected proceedings of the Third Workshop on Spanish Sociolinguistics (pp. 162–170). Somerville, MA: Cascadilla Proceedings Project.
Moreno, E. M., Federmeier, K. D., & Kutas, M.
(2002) Switching languages, switching palabras (words): An electrophysiological study of code switching. Brain and Language, 801, 188–207.
Myers-Scotton, C., & Jake, J. L.
(2014) Nonfinite verbs and negotiating bilingualism in codeswitching: Implications for a language production model. Bilingualism: Language and Cognition, 171, 511–525.
Ng, S., Gonzalez, C., & Wicha, N Y Y.
(2014) The fox and the cabra: An ERP analysis of reading code switched nouns and verbs in bilingual short stories. Brain Research, 15571, 127–140.
(1979) Constraints on language mixing: Intrasentential code-switching and borrowing in Spanish/English. Language, 551, 581–618.
Poplack, S.
(1980) Sometimes I’ll start a sentence in Spanish y termino en español: Towards a typology of code-switching. Linguistics, 181, 581–618.
Poplack, S.
(1988) Contrasting patterns of code-switching in two communities. In M. Heller (Ed.), Code-switching: Anthropological and sociolinguistic perspectives (pp. 215–244). The Hague, The Netherlands: Mouton de Gruyter.
Poplack, S.
(2013) Foreword to “Sometimes I’ll start a sentence in Spanish Y TERMINO EN ESPAÑOL: Toward a typology of code-swtiching. Linguistics 1980, Volume 18, issue 7. 581–618. Linguistics, 511, 11–14.
Poplack, S., Sankoff, D., & Miller, C.
(1988) The social correlates and linguistic processes of lexical borrowing and assimilation. Linguistics, 261, 47–104.
Prior, A., & Gollan, T. H.
(2012) Good language-switchers are good task-switchers: Evidence from Spanish-English and Mandarin-English bilinguals. Journal of the International Neuropsychological Society, 171, 682–691.
Proverbio, A. M., Leoni, G., & Zani, A.
(2004) Language switching mechanisms in simultaneous interpreters: An ERP study. Neuropsychologia, 421, 1636–1656.
Rayner, K.
(1998) Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 1241, 372–422.
Rayner, K., & Duffy, S. A.
(1986) Lexical complexity and fixation times in reading: Effects of word frequency, verb complexity, and lexical ambiguity. Memory and Cognition, 141, 191–201.
Rodríguez-Fornells, A., Krämer, U. M., Lorenzo-Seva, U., Festman, J., & Münte, T. F.
(2011) Self-assessment of individual differences in language switching. Frontiers in Psychology, 2, 388.
Sridhar, S. N., & Sridhar, K. K.
(1980) The syntax and psycholinguistics of bilingual code mixing. Canadian Journal of Psychology, 341, 407–416.
Stadthagen-Gonzalez, H., López, L., Parafita Couto, M. C., & Párraga, C. A.
Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivey, J. C.
(1995) Integration of visual and spatial information in spoken language comprehension. Science, 2681, 1632–1634.
Tanenhaus, M. K., & Trueswell, J. C.
(2006) Eye movements and spoken language comprehension. In M. Traxler & M. Gernsbacher (Eds.), Handbook of psycholinguistics (pp. 863–900). (2nd ed.). New York, NY: Elsevier Academic Press.
Taylor, I.
(1971) How are words from two languages organized in bilinguals’ memory?Canadian Journal of Psychology, 251, 28–239.
Torres Cacoullos, R., & Travis, C. E.
(2015) Gauging convergence on the ground: Code-switching in the community – Introduction. International Journal of Bilingualism, 191, 365–386.
Trueswell, J. C., Tanenhaus, M. K., & Garnsey, S. M.
(1994) Semantic influences on parsing: Use of thematic role information in syntactic ambiguity resolution. Journal of Memory and Language, 331, 285–318.
in press). Experimentally inducing Spanish-English code-switching: A new conversation paradigm. In K. Bellamy, M. Child, P. González González, A. Muntendam, & M. C. Parafita Couto Eds. Multidisciplinary approaches to bilingualism in the Hispanic and Lusophone world pp. 209 231 Amsterdam, The Netherlands John Benjamins
Van Hell, J. G., Fernandez, C. B., Kootstra, G. J., Litcofsky, K. A., & Ting, C. Y.
(1963) Languages in contact: Findings and problems. The Hague, The Netherlands: Mouton & Co.
Yim, O., & Bialystok, E.
(2012) Degree of conversational code-switching enhances verbal task switching in Cantonese-English bilinguals. Bilingualism: Language and Cognition, 151, 873–883.
Zentella, A. C.
(1997) Growing up bilingual: Puerto Rican children in New York. Malden, MA: Blackwell.
Cited by
Cited by 21 other publications
Abbas, Nawras, Tamar Degani & Anat Prior
2021. Equal Opportunity Interference: Both L1 and L2 Influence L3 Morpho-Syntactic Processing. Frontiers in Psychology 12
2021. Lexical-semantic processing costs are not inherent to intra-sentential code-switching: The role of switching habits. Neuropsychologia 159 ► pp. 107922 ff.
Salig, Lauren K., Jorge R. Valdés Kroff, L. Robert Slevc & Jared M. Novick
2021. Moving From Bilingual Traits to States: Understanding Cognition and Language Processing Through Moment-to-Moment Variation. Neurobiology of Language 2:4 ► pp. 487 ff.
2022. Expecting the unexpected: Code-switching as a facilitatory cue in online sentence processing. Bilingualism: Language and Cognition 25:1 ► pp. 81 ff.
Valdés Kroff, Jorge R., Patricia Román & Paola E. Dussias
2020. Are All Code-Switches Processed Alike? Examining Semantic v. Language Unexpectancy. Frontiers in Psychology 11
This list is based on CrossRef data as of 23 april 2022. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.