16:30 - 18:00
Mon-H4-Talk 3--32
Mon-Talk 3
Room: H4
Chair/s:
Sanjeev Nara
Neural interpolation of dynamic visual information in natural scenes
Mon-H4-Talk 3-3205
Presented by: Lu-Chun Yeh
Lu-Chun Yeh 1, Max Bardelang 1, Daniel Kaiser 1, 2
1 Mathematical Institute, Department of Mathematics and Computer Science, Physics, Geography, Justus Liebig University, 2 Center for Mind, Brain and Behavior (CMBB), Philipps University Marburg and Justus Liebig University Gießen
Adaptive natural vision requires our brain to interpolate missing information about occluded objects in the environment. Previous studies suggest that this process is supported by visual cortex „filling in” occluded parts of scene images. However, we live in a dynamic world, and objects keep moving in and out of occlusion (e.g., when trains move through tunnels). Here, we used multivariate pattern analysis on time-frequency-resolved EEG data to track neural representations during dynamic occlusion. Participants watched 4-second videos of a person walking across a scene (either left-to-right or right-to-left) while performing an unrelated fixation task. The videos featured three conditions: The person walking across a blank background (isolated condition), across the scene without occlusion (visible condition), or across the scene while being dynamically occluded between 1.5 and 3 seconds (occluded condition). We trained classifiers to discriminate rightward- and leftward-walking in the isolated condition and tested them on the visible and occluded conditions. Classifiers trained on responses in the alpha band (8-12Hz) successfully discriminated walking direction in both conditions, including the time window of occlusion. Critically, we introduced an additional condition during which the person stopped in front of a natural obstacle (e.g., a river). We found that alpha dynamics tracked the termination of motion in this condition even when it was hidden by the occluder. Together, our results provide evidence for an interpolation of information during dynamic occlusion. These alpha dynamics may constitute a neural correlate of top-down processes that „fill in“ information based on context.
Keywords: interpolation, neural representations, motion, natural scenes, alpha, MVPA, EEG