Visual working memory load constrains language non-selective activation under task-demands
Visual world studies with bilinguals have demonstrated spontaneous cross-linguistic activations. In two experiments, we examined whether concurrent visual working memory (VWM) load constrains bilingual parallel activation during spoken word comprehension. Hindi-English bilinguals heard a spoken word in Hindi (L1) or English (L2) and saw a display containing the spoken word-referent, a phonological cohort of the spoken word’s translation and two unrelated objects. Participants completed a concurrent WM task of remembering an array of five coloured squares and judging its similarity with a test array. Participants were asked to click on the spoken word-referent in Experiment 1 but not in Experiment 2. Reduced parallel activation and enhanced target activation was observed under the load for L2 spoken words in Experiment 1 (where the task-demands were high). The findings suggest that a VWM load can constrain the spontaneous activation of an irrelevant lexicon, under certain conditions.
Article outline
- 1.Introduction
- 2.Experiment 1
- 2.1Method
- 2.1.1Participants
- 2.1.2Stimuli
- 2.1.3Control measures
- 2.1.4Apparatus
- 2.1.5Procedure
- 2.2Data analysis
- 2.2.1Eye movements
- 2.2.2Manual responses
- 2.3Results
- 2.3.1Proportion of fixations
- 2.3.2First saccade latency
- 2.3.3Manual responses on visual world task
- 2.3.4WM task
- 2.4Discussion
- 3.Experiment 2
- 3.1Methods
- 3.1.1Participants
- 3.1.2Stimuli & procedure
- 3.2Data analysis
- 3.3Results
- 3.3.1Proportion of fixations
- 3.3.2First saccade latency
- 3.3.3WM task
- 3.4Discussion
- 4.General discussion
- Acknowledgements
- Note
-
References
References (43)
References
Altmann, G. T. M., & Kamide, Y. (2004). Now you see it, now you don’t: Mediating the mapping between language and the visual world. In J. M. Henderson & F. Ferreira (Eds.), Interfacing language, vision, and action (pp. 347–386). New York: Psychology Press.
Ardila, A. (2003). Language representation and working memory with bilinguals. Journal of Communication Disorders, 36(3), 233–240.
Barr, D. J. (2008). Analyzing ‘visual world’ eyetracking data using multilevel logistic regression. Journal of Memory and Language, 59(4), 457–474.
Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013). Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language, 68(3), 255–278.
Bhatia, D., Prasad, S. G., Sake, K., & Mishra, R. K. (2017). Task Irrelevant External Cues Can Influence Language Selection in Voluntary Object Naming: Evidence from Hindi-English Bilinguals. PloS One, 12(1), e0169284.
Blumenfeld, H. K., & Marian, V. (2013). Parallel language activation and cognitive control during spoken word recognition in bilinguals. Journal of Cognitive Psychology, 25(5), 547–567.
Christoffels, I. K., De Groot, A. M., & Kroll, J. F. (2006). Memory and language skills in simultaneous interpreters: The role of expertise and language proficiency. Journal of Memory and Language, 54(3), 324–345.
Christoffels, I. K., Ganushchak, L., & Koester, D. (2013). Language conflict in translation: An ERP study of translation production. Journal of Cognitive Psychology, 25(5), 646–664.
Costa, A., Miozzo, M., & Caramazza, A. (1999). Lexical selection in bilinguals: Do words in the bilingual’s two lexicons compete for selection?. Journal of Memory and Language, 41(3), 365–397.
Costa, A., & Santesteban, M. (2004). Lexical access in bilingual speech production: Evidence from language switching in highly proficient bilinguals and L2 learners. Journal of Memory and Language, 50(4), 491–511.
de Bot, K. (1992). A bilingual production model: Levelt’s “Speaking” Model adapted. Applied Linguistics, 131, 1–24.
Engle, R. W. (2002). Working memory capacity as executive attention. Current directions in Psychological Science, 11(1), 19–23.
Grosjean, F. (2001). The bilingual’s language modes. In J. Nicol (Ed.),
One mind, two languages: Bilingual language processing (pp. 1–22). Oxford: Blackwell.
Hadar, B., Skrzypek, J. E., Wingfield, A., & Ben-David, B. M. (2016). Working memory load affects processing time in spoken word recognition: evidence from eye-movements. Frontiers in Neuroscience, 101, Article 221.
Hasegawa, M., Carpenter, P. A., & Just, M. A. (2002). An fMRI study of bilingual sentence comprehension and workload. Neuroimage, 15(3), 647–660.
Huettig, F., Olivers, C. N., & Hartsuiker, R. J. (2011). Looking, language, and memory: Bridging research from the visual world and visual search paradigms. Acta Psychologica, 137(2), 138–150.
Huettig, F., Mishra, R. K., & Olivers, C. N. (2012). Mechanisms and representations of language-mediated visual attention. Frontiers in Psychology, 21, Article 394.
Huettig, F., & Janse, E. (2016). Individual differences in working memory and processing speed predict anticipatory spoken language processing in the visual world. Language, Cognition and Neuroscience, 31(1), 80–93.
Ito, A., Corley, M., & Pickering, M. J. (2018). A cognitive load delays predictive eye movements similarly during L1 and L2 comprehension. Bilingualism: Language and Cognition, 21(2), 251–264.
Kim, S. Y., Kim, M. S., & Chun, M. M. (2005). Concurrent working memory load can reduce distraction. Proceedings of the National Academy of Sciences of the United States of America, 102(45), 16524–16529.
Knoeferle, P., & Crocker, M. W. (2006). The coordinated interplay of scene, utterance, and world knowledge: Evidence from eye tracking. Cognitive Science, 30(3), 481–529.
Konstantinou, N., Beal, E., King, J. R., & Lavie, N. (2014). Working memory load and distraction: dissociable effects of visual maintenance and cognitive control. Attention, Perception, & Psychophysics, 76(7), 1985–1997.
Kroll, J. F., & Stewart, E. (1994). Category interference in translation and picture naming: Evidence for asymmetric connections between bilingual memory representations. Journal of Memory and Language, 33(2), 149–174.
Kroll, J. F., Michael, E., Tokowicz, N., & Dufour, R. (2002). The development of lexical fluency in a second language. Second Language Research, 18(2), 137–171.
Leys, C., Ley, C., Klein, O., Bernard, P., & Licata, L. (2013). Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median. Journal of Experimental Social Psychology, 49(4), 764–766.
Lin, P. H., & Luck, S. J. (2012). Proactive interference does not meaningfully distort visual working memory capacity estimates in the canonical change detection task. Frontiers in Psychology, 31, Article 42.
Marian, V., & Spivey, M. (2003). Competing activation in bilingual language processing: Within-and between-language competition. Bilingualism: Language and Cognition, 6(2), 97–115.
Mercier, J., Pivneva, I., & Titone, D. (2014). Individual differences in inhibitory control relate to bilingual spoken word processing. Bilingualism: Language and Cognition, 17(1), 89–117.
Mishra, R. K., Olivers, C. N., & Huettig, F. (2013). Spoken language and the decision to move the eyes: To what extent are language-mediated eye movements automatic? In Progress in brain research. 2021, (pp.135–149). Elsevier. Amsterdam: Netherlands.
Mishra, R. K., & Singh, N. (2014). Language non-selective activation of orthography during spoken word processing in Hindi–English sequential bilinguals: an eye tracking visual world study. Reading and Writing, 27(1), 129–151.
Mishra, R. K., & Singh, N. (2016). The influence of second language proficiency on bilingual parallel language activation in Hindi–English bilinguals. Journal of Cognitive Psychology, 28(4), 396–411.
Pivneva, I., Mercier, J., & Titone, D. (2014). Executive control modulates cross-language lexical activation during L2 reading: Evidence from eye movements. Journal of Experimental Psychology: Learning, Memory, and Cognition, 40(3), 787.
Posner, M. I., & Snyder, C. R. R. (1975). Attention and cognitive control. In R. J. Solso (Ed.), Information Processing and Cognition: the Loyola Symposium (pp. 55–85); Hillsdale, NJ: Lawrence Erlbaum Associates.
Roychoudhuri, K. S., Prasad, S. G., & Mishra, R. K. (2016). Iconic Native Culture Cues Inhibit Second Language Production in a Non-immigrant Population: Evidence from Bengali-English Bilinguals. Frontiers in Psychology, 71, 1516.
Segalowitz, N. (1991). Does advanced skill in a second language reduce automaticity in the first language? Language Learning, 41(1), 59–83.
Singh, N., & Mishra, R. K. (2015). Unintentional activation of translation equivalents in bilinguals leads to attention capture in a cross-modal visual task. PloS One, 10(3), e0120131.
Saslow, M. G. (1967). Latency for saccadic eye movement. JOSA, 57(8), 1030–1033.
Spivey, M. J., & Marian, V. (1999). Cross talk between native and second languages: Partial activation of an irrelevant lexicon. Psychological Science, 10(3), 281–284.
Sunderman, G., & Kroll, J. F. (2006). First language activation during second language lexical processing: An investigation of lexical form, meaning, and grammatical class. Studies in Second Language Acquisition, 28(3), 387–422.
Sunderman, G. L., & Priya, K. (2012). Translation recognition in highly proficient Hindi–English bilinguals: The influence of different scripts but connectable phonologies. Language and Cognitive Processes, 27(9), 1265–1285.
Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivy, J. C. (1995). Integration of visual and linguistic information in spoken language comprehension. Science, 268(5217), 1632–1634.
Titone, D., Libben, M., Mercier, J., Whitford, V., & Pivneva, I. (2011). Bilingual lexical access during L1 sentence reading: The effects of L2 knowledge, semantic constraint, and L1–L2 intermixing. Journal of Experimental Psychology: Learning, Memory, and Cognition, 37(6), 1412.
Weber, A., & Cutler, A. (2004). Lexical competition in non-native spoken-word recognition. Journal of Memory and Language, 50(1), 1–25.
Cited by (1)
Cited by one other publication
Prasad, Seema & Ramesh Kumar Mishra
2020.
Concurrent verbal working memory load constrains cross-linguistic translation activation: A visual world eye-tracking study on Hindi–English bilinguals.
Bilingualism: Language and Cognition ► pp. 1 ff.
This list is based on CrossRef data as of 6 december 2020. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.