16:30 - 18:00
Parallel sessions 3
16:30 - 18:00
Room: HSZ - N3
Chair/s:
Jack E Taylor, Janos Pauli
Written script, including numbers, letters, and letter-strings, is a recent cultural invention central to letter- and number-literate societies. In such societies, humans learn early on to recognise glyphs and map them fluently onto specific sounds and concepts. This symposium explores how the brain achieves this objective, using multiple complementary lenses to understand the processing of linguistic and mathematical symbols, the degree to which these representations are distinct, and interactions between visual symbol recognition and abstract processes of language and numerosity.

The first talk introduces a predictive coding-motivated computational model of letter recognition, showing how these principles might explain the recognition of letters in noisy environments. This work suggests that predictive coding accounts of word recognition may also apply to isolated letters. The second talk uses an optimal transport framework to model the space of early visual representations of letter symbols revealed by EEG, exploring how such representations may be altered in dyslexia. This work tests whether this learning disorder in reading also results in weaker neural alignment with computational models of letter representations. The third talk presents an analysis of human fMRI and macaque electrocorticography responses to naturalistic images, suggesting a shared prominent representation of stimuli related to both orthography and numerosity. This finding is discussed in relation to the notion of proto-architecture for mathematical cognition in the higher-level visual cortex of non-human primates. The fourth talk examines interactions between the processing of Arabic digits and language. This study exploits the discrepancy between the base-10 system of Arabic numbers and base-20 system of French number words, finding that native French speakers utilise language during a numerical task, even when language is redundant. The fifth talk explores how the brain processes words with varying degrees of misspelling. Using MEG data, it examines connectivity between lower visual areas and the lvOT, suggesting that lvOT processes real words in a feedforward manner but engages feedback mechanisms for misspelled words and pseudowords.

Combining experimental and computational approaches, this symposium advances our understanding of how the brain maps arbitrary visual forms into meaningful symbolic representations, and how these processes interact with language and numerosity.
Submission 99
Cross-Species Decomposition Reveals a Shared Representation for Symbols in Primate IT
SymposiumTalk-03
Presented by: Sander van Bree
Sander van Bree 1, 2, 3, Martin Hebart 1, 2, 3
1 Department of Medicine, University of Giessen, Germany
2 Vision and Computational Cognition Group, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
3 Center for Mind, Brain and Behavior (CMBB), Universities of Marburg, Giessen, and Darmstadt, Germany
In this study, we investigate the functional organization of primate inferotemporal cortex (IT) during vision. We compared macaque intracranial and human fMRI responses to naturalistic images by aligning these data into a common space. This revealed a rich high-dimensional code shared between primates, composed of semantic and visual features. In this talk, we concentrate on one observation about this shared primate space: the prominence of orthographic stimuli such as symbols and icons, as well as numerosity (multiple objects in a scene). We run a host of analyses to evaluate these cross-primate representations, and consider their empirical relevance for the notion that a proto-architecture for mathematical cognition exists in the higher-level visual cortex of non-human primates.