16:30 - 18:00
Parallel sessions 3
16:30 - 18:00
Symbolic Representations in the Visual Pathway: From Numbers and Letters to Words and Semantics
Room: HSZ - N3
Chair/s:
Jack E Taylor, Janos Pauli
Written script, including numbers, letters, and letter-strings, is a recent cultural invention central to letter- and number-literate societies. In such societies, humans learn early on to recognise glyphs and map them fluently onto specific sounds and concepts. This symposium explores how the brain achieves this objective, using multiple complementary lenses to understand the processing of linguistic and mathematical symbols, the degree to which these representations are distinct, and interactions between visual symbol recognition and abstract processes of language and numerosity.

The first talk introduces a predictive coding-motivated computational model of letter recognition, showing how these principles might explain the recognition of letters in noisy environments. This work suggests that predictive coding accounts of word recognition may also apply to isolated letters. The second talk uses an optimal transport framework to model the space of early visual representations of letter symbols revealed by EEG, exploring how such representations may be altered in dyslexia. This work tests whether this learning disorder in reading also results in weaker neural alignment with computational models of letter representations. The third talk presents an analysis of human fMRI and macaque electrocorticography responses to naturalistic images, suggesting a shared prominent representation of stimuli related to both orthography and numerosity. This finding is discussed in relation to the notion of proto-architecture for mathematical cognition in the higher-level visual cortex of non-human primates. The fourth talk examines interactions between the processing of Arabic digits and language. This study exploits the discrepancy between the base-10 system of Arabic numbers and base-20 system of French number words, finding that native French speakers utilise language during a numerical task, even when language is redundant. The fifth talk explores how the brain processes words with varying degrees of misspelling. Using MEG data, it examines connectivity between lower visual areas and the lvOT, suggesting that lvOT processes real words in a feedforward manner but engages feedback mechanisms for misspelled words and pseudowords.

Combining experimental and computational approaches, this symposium advances our understanding of how the brain maps arbitrary visual forms into meaningful symbolic representations, and how these processes interact with language and numerosity.
SymposiumTalk-01
Janos Pauli, Self-Learnings Systems Lab, Department of Special Education and Rehabilitation, University of Cologne, Germany
SymposiumTalk-02
Jack E. Taylor, Department for Psychology, Goethe University Frankfurt, Germany | COBIC Brain Imaging Center, Goethe University Frankfurt, Germany | School of Psychology and Neuroscience, University of Glasgow, United Kingdom
SymposiumTalk-03
Sander van Bree, Department of Medicine, University of Giessen, Germany | Vision and Computational Cognition Group, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany | Center for Mind, Brain and Behavior (CMBB), Universities of Marburg, Giessen, and Darmstadt, Germany
SymposiumTalk-04
Roman Janssen, LaPsyDÉ (UMR 8040), Paris Cité University, France
SymposiumTalk-05
Jiaxin You, Department of Neuroscience and Biomedical Engineering, Aalto University, Finland