Submission 533
Interactions of Modality and Emotion: The Complex Effects of Threat on Attentional Control
Posterwall-17
Presented by: Bahtiyar Yildiz
Attentional control is often challenged by emotionally charged stimuli, especially threats. While most prior research has relied on static images, real-world threats are dynamic and multimodal, our study explored the impact of the more ecologically valid, multi-modal threat distractors (static pictures, muted video, audiovisual video) on the performance of visual search. 48 participants performed a visual search task consisting of a number matrix where they had to find numbers starting from number 1 in an ascending order while ignoring the randomised presentation of task-irrelevant neutral or threatening weather related stimuli. We recorded initial attentional capture (time to find number 1) and sustained executive control (elapsed search time for numbers 1-10). The results showed that finding the first target took longer with a threatening picture distractor compared to a neutral picture, and participants were faster in picture modality compared to both audiovisual and muted video stimuli (regardless of valence). Furthermore, participants completed the task (i.e., found all numbers) faster in the threatening muted video compared to neutral one, however, threatening audiovisual distractors resulted in worse performance compared to neutral audiovisual one. These findings highlight the nuanced interplay between emotional salience and sensory modality, showing that the modality of threat information can either hinder or enhance attentional control.The perceptual load from movement and sound might be able to override or even reverse the typically negative effects associated with threats thereby underscoring the need to focus on non-static imagery to obtain an accurate understanding of attentional processes.