11:00 - 12:30
Parallel sessions 8
11:00 - 12:30
Room: HSZ - N5
Chair/s:
Fritz Günther, Markus Kiefer
Embodied and grounded cognition approaches have remained enduring focal points in cognitive psychology. Although some subtle differences are sometimes postulated, both approaches converge on the assumption that cognition is essentially based on a reinstatement of processes of perception, action and introspection. How exactly the symbols that are central our higher cognition and communication, such as linguistic forms and abstracted mental representations, obtain their meaning from sensorimotor experience is one of the open challenges in this line of research. Highly interesting experimental-behavioural studies have been conducted that produced important insights. At the same time, we are experiencing the theoretical and empirical limits of this approach:
On the one hand, research on embodied cognition is often missing the formalisation, quantification, and precision required to make theoretically substantive advances – a gap to be filled with computational modelling. Here, recent work has brought forward large-scale data-driven representation models built from different data sources, such as language and vision. These allow us to exactly operationalize to what extent information from different modalities of experience shape our semantic representations, and investigate their specific influences on cognitive processes.
On the other hand, theories of embodied cognition ultimately always result in claims about processes in specific cognitive systems (shared between higher cognition and sensorimotor or introspective processing), which are hard to evaluate with purely behavioural approaches and instead require neuroscientific methods. This includes electrophysiological methods with high temporal precision, as well neuroimaging methods with high spatial resolution; together, these techniques allow us to precisely map neural processes that underpin higher cognition.
 In this symposium, we bring together recent advances integrating computational and neuroscientific approaches to embodiment research: Computational models yield precise predictions at the system level, which in turn can be tested with neuroscientific methods. The presentations in this symposium highlight the advantage of an interplay of computational and neuroscientific approaches for various fields of embodied cognition such as language, memory and semantics.
Submission 349
Neural Basis of Action Sequence Prediction in Communicative Function Understanding
SymposiumTalk-05
Presented by: Rosario Tomasello
Rosario Tomasello
Brain Language Laboratory, Department of Philosophy and Humanities, WE4, Free University of Berlin, Germany
Cluster of Excellence "Matters of Activity. Image Space Material", Humboldt-University, Berlin, Germany
For decades, research in the neurobiology of language has focused primarily on how linguistic symbols are processed in the human brain, with a particular attention on the functional role of sensorimotor experiences in this cognitive process. In everyday social interactions, however, linguistic symbols (words and sentences) primarily serve as tools for communication, enabling us to convey our intentions to others. In linguistic-pragmatic theory, these intentions are referred to as speech acts or communicative functions, which are typically embedded in complex contextual settings and sequences of actions. Here, I will present studies examining the neural correlates underlying fine-grained distinctions between different types of communicative action (e.g. naming, requesting, questioning and stating) conveyed through identical linguistic utterances in written, prosodic and gestural modalities. I will show that communicative function understanding emerges very rapidly, around 150 ms after stimulus onset, in parallel with semantic processing, and is associated with distinct brain activation patterns that reflect specific pragmatic functions. In particular, communicative actions that typically elicit motor-related partner responses, such as handing over an object after a request or giving a verbal reply to a question, trigger somatotopic activation in the motor cortex (e.g., hand vs. face regions). I argue that the embedding of linguistic symbols into action-related schemas highlights the contribution of the motor cortex, whose rapid activation suggests a crucial role in the pragmatic understanding of communicative functions.