09:00 - 10:30
Parallel sessions 7
09:00 - 10:30
Room: HSZ - N9
Chair/s:
Thomas B Christophel, Rosanne Rademaker
We are capable of retaining a large variety of visual content in working memory, ranging from simple low-level features to complex naturalistic stimuli. Maintenance of visual information in working memory is accompanied by memory-specific activity across the entire cortical sheet from early visual areas to frontal cortex. Interference between memory content and distractors shapes these representations, as does the passage of time. Here, we bring together experts from cognitive psychology and neuroscience trying to understand the cortical and cognitive mechanisms of short-term memory. Using behavioral work, TMS, single-cell recordings, fMRI, and convolutional neural networks, they assess the representational nature of working memory storage and its interaction with the environment.  
First, Pablo Grassi asks whether activity in sensory cortex is necessary for the maintenance of visual information. He will present results from three experiments investigating whether TMS pulses applied over visual cortex interfere with working memory performance for low-level features. Michael Wolff will then show that V1 neurons reverse preference between the processing and short-term maintenance of natural images, evident in both spontaneous and evoked (“pinged”) spiking activity. This suggests that neural adaptation acts like a short-term memory buffer in the early sensory cortex. Next, Anna Zier asks which brain regions represent how low-level visual features (like color and motion) are bound into a more complex object in working memory. Using fMRI decoding, she demonstrates that trial-specific binding information can be identified from memory-related activity in early visual cortex (V1–V4). Then, Anastasia Kiyonaga uses CNN derived similarity measures in natural images to show that low-level and high-level interference uniquely affect working memory performance. Intriguingly, interference effects during working memory are inversely related to long term memory recollection, suggesting competition with immediate memory can strengthen longer-term memory. Finally, Joana Seabra shows that during visual working memory several cortical regions utilize categorical, semantic, and spatial representational formats to maintain simple low-level stimuli in a robust fashion.
Submission 139
Early Visual Cortex Stores Binding Information in Working Memory
SymposiumTalk-03
Presented by: Anna Zier
Anna Zier 1, 2, Philipp Deutsch 1, 2, Jochen Kaiser 1, 2, Christoph Bledowski 1, 2
1 Institute of Medical Psychology, University of Frankfurt, Germany
2 Cooperative Brain Imaging Center - CoBIC, University of Frankfurt, Germany
Previous studies on the neuronal basis of working memory have identified brain regions that temporarily store simple visual features like motion direction or color. In contrast, it remains unknown which brain areas temporarily store information about how those features are bound into an object. Participants (N=20) performed four separate functional magnetic resonance imaging (fMRI) sessions. They memorized two objects composed of two visual features each: color and motion direction. We manipulated the feature bindings within these objects across trials. To collect a sufficient number of binding repetitions per participant, each feature varied only across three exemplar categories (color: blue, yellow and pink; motion direction: leftwards, rightwards and downwards). Our procedure allowed to isolate memorized binding information by comparing delay-related fMRI activity patterns between trials in which participants memorized pairs of objects with exactly the same features but the opposite binding. Additionally, the design enabled a comparison of activity patterns between trials that differed in a single feature, thereby isolating feature-specific information. Participants in our study were required to memorize two colors, two motion directions, and their binding on each trial. Despite this high memory load, we successfully decoded memory-related information about both motion direction and color from the early visual cortex (V1-V4). Crucially, we were also able to decode the trial-specific binding information from the memory-related activity in V1-V4. These novel findings indicate that early visual cortex retains specific information both about individual features and about the way these features are bound together.