DOES TIME MATTER? A MULTIMODAL ANALYSIS OF SI FROM L2 TO L1

DOES TIME MATTER? A MULTIMODAL ANALYSIS OF SI FROM L2 TO L1

Author:  A.V. Leonteva, O.V. Agafonova, A.A. Petrov

Affiliation:  Moscow State Linguistic University

Abstract:  Simultaneous interpreting is regarded as one of the most difficult and stressful types of activity. Simultaneous interpreters work in a severe time deficit and have to absorb much information per unit of time, which means that different cognitive processes (e.g., memory, attention, thinking, perception) are engaged concurrently. This leads to a severe cognitive load, which is sometimes compared with that of pilots.
In the current study we investigate how the increase in cognitive load, which happens throughout time, affects interpreters’ performance. This surge, we expect, will be observed on two language levels: verbal and nonverbal (gestural). The analysis is based on 10 videos of simultaneous interpreting of a lec-ture about biodiversity from English (L2) into Russian (L1), approximately 10 minutes each.
The results of the study show an increase in speech disfluencies on the verbal level and distribution of various gesture functions on the nonverbal level. In particular, verbal disfluencies are exteriorized in fillers, draggings and truncations, and their number increases during the interpreting. Along with disflu-encies we observed the rise of the co-speech gestures, e.g., adapters and pragmatic gestures, that help maintain control over the process of simultaneous interpreting, structure the output and reduce the cog-nitive load and stress experienced by participants while performing the task.

Keywords:  time, co-speech gestures, disfluency, simultaneous interpreting, cognitive load.

References:  Barrouillet P., Bernardin S., Camos V. Time constraints and resource sharing in adults’ working memory spans. Journal of Experimental Psychol-ogy: General, 133. 2004. P. 83-100.
Barrouillet P., Bernardin S., Portrat S., Vergauwe E., Camos V. Time and Cognitive Load in Working Memory. Journal of experimental psy-chology. Learning, memory, and cognition. 2007. P. 570-585.
Boos M., Kobi M., Elmer S., Jäncke L. The influence of experience on cognitive load during simultaneous interpretation. Brain and Language. 234. 2022. P. 105-185.
Bressem J. Repetitions in gesture: Structures, functions, and cognitive aspects. Ph.D. disserta-tion, Faculty of Social and Cultural Sciences, Eu-ropean University Viadrina, Frankfurt (Oder). 2012.
Cienki A. From the finger lift to the palm-up open hand when presenting a point: A methodo-logical exploration of forms and functions. Lan-guages and Modalities, 1. 2021. P. 17-30.
Cienki A. Image Schemas and Gesture // From Perception to Meaning: Image Schemas in Cognitive Linguistics / ed. by J. Grady. Berlin, New York: Mouton de Gruyter, 2005. P. 421-442.
Cienki A., Iriskhanova O.K. Patterns of mul-timodal behavior under cognitive load: an analysis of simultaneous interpretation from L2 to L1. Vo-prosy Kognitivnoy Lingvistiki, 1. 2020. P. 5-11.
Cienki A., Mittelberg I. Creativity in the Forms and Functions of Spontaneous Gesture with Speech // The Agile Mind: A multi-disciplinary Study of a Multi-faceted Phenomenon / ed. by T. Veale, K. Feyaerts, C. Forceville. Berlin: De Gruy-ter Mouton, 2013. P. 231-252.
Cowan N. An embedded-process model of working memory. In A. Miyake & P. Shah (Eds.), Models of working memory: Mechanisms of ac-tive maintenance and executive control. Cam-bridge, England: Cambridge University Press. 1999. P. 62-101.
Desmet B., Vandierendonck M., Defrancq B. Simultaneous interpretation of numbers and the impact of technological support, in Fantinuoli, C. (ed.), Interpreting and technology, Language Sci-ence Press, Berlin, Germany. 2018. P. 13-27.
Engle R.W., Kane M. J., Tuholski S.W. Indi-vidual differences in working memory capacity and what they tell us about controlled attention, general fluid intelligence, and functions of the prefrontal cortex. In A. Miyake & P. Shah (eds.), Models of working memory: Mechanisms of ac-tive maintenance and executive control. Cam-bridge, England: Cambridge University Press. 1999. P. 102-134.
Gile D. Testing the Effort Models’ Tightrope Hypothesis in Simultaneous Interpreting – A Con-tribution. Hermes, 23. 2017. P. 153-172.
Hervais-Adelman A., Babcock L. The neu-robiology of simultaneous interpreting: Where ex-treme language control and cognitive control inter-sect. Bilingualism: Language and Cognition, 23(4). 2020. P. 740-751.
Iriskhanova O.K., Cienki A. The Semiotics of Gestures in Cognitive Linguistics: Contribution and Challenges. Voprosy Kognitivnoy Lingvistiki, 4. 2018. P. 25-36.
Jarjat G., Hoareau V., Plancher G., Hot P., Lemaire B., Portrat S. What makes working memory traces stable over time?: Working memory conditions for long-term recall. Annals of the New York Academy of Sciences, 1424(1). 2018. P. 149-160.
Korpal P. Interpreting as a stressful activity: Physiological measures of stress in simultaneous interpreting. Poznan Studies in Contemporary Lin-guistics, 52(2). 2016. P. 297-316.
Kosmala L., Candea M., Morgenstern A. Synchronization of (dis)fluent speech and gesture: A multimodal approach to (dis)fluency // 6th Ges-ture and Speech in Interaction Conference 11-13 September 2019, Paderborn, Germany.
Labaronne M., Jarjat G., Plancher G. At-tentional Refreshing in the Absence of Long-Term Memory Content: Role of Short-Term and Long-Term Consolidation. Journal of Cognition, 6(1): 5. 2023. P. 1-24.
Liu M., Schallert D., Carroll P. Working memory and expertise in simultaneous interpret-ing. Interpreting, 6. 2004. P. 19-42.
Moser-Mercer B., Künzli A., Korac M. Pro-longed turns in interpreting: Effects on quality, physiological and psychological stress (Pilot study). Interpreting, 3(1). 1998. P. 47-64.
Müller C. Metaphors dead and alive, sleep-ing and waking: A dynamic view. Chicago, Lon-don: University of Chicago Press, 2008.
Plancher G., Barrouillet P. Forgetting from working memory: Does novelty encoding matter? Journal of Experimental Psychology: Learning, Memory, and Cognition, 39(1). 2013. P. 110-125.
Raufov M.M., Toshmatov O.S., Mustafoeva N. I. Simultaneous interpreting as a special inter-preter activity. Pros and cons of simultaneous in-terpreting. Oriental Art and Culture, V. 2020. P. 175-178.
Riccardi A. On the Evolution of Interpreting Strategies in Simultaneous Interpreting. Meta, 50(2). 2005. P. 753-767.
Signorelli T., Obler L. Working memory in simultaneous interpreters. In J. Altarriba & L. Isurin (Eds.), Memory, Language, and Bilingual-ism: Theoretical and Applied Approaches. Cam-bridge: Cambridge University Press. 2012. P. 95-125.
Stachowiak-Szymczak K. Eye Movements and Gestures in Simultaneous and Consecutive Interpreting. New York: Springer. 2019. P. 1-42.
Wagner S.M., Nusbaum H., Goldin-Meadow S. Probing the mental representation of gesture: Is handwaving spatial? Journal of memory and lan-guage, 50(4). 2004. P. 395-407.
Чернов Г.В. Теория и практика синхрон-ного перевода. Международные отношения, 1978. [Chernov G.V. Teoriya I praktika sinhron-nogo perevoda. Mezhdunarodnye otnosheniya. 1978.]

For citation:  Leonteva A.V., Agafonova O.V., Petrov A.A. Does Time Matter? Analysis of SI From L2 to L1 // Вопросы когнитивной лингвистики. 2023. № 3. С. 40-46.

Pages:  40-46