Submission 587
Gaze Reliability Modulates Attentional Orienting and Joint Performance in Human-Agent Collaboration
SymposiumTalk-02
Presented by: Eva Wiese
Effective human-agent interaction relies on the ability to integrate social cues and dynamically allocate attention during joint action. In this study, we investigated how the reliability of a humanoid robot’s gaze affects cognitive processing and cooperative performance in a shared visual search task. Participants collaborated with the NAO robot in a time-constrained, turn-taking paradigm, with the robot’s gaze either consistently aligned with task goals or uninformative. Critically, participants were not informed about this manipulation. Reliable gaze led to significantly faster target selection and more efficient coordination, indicating enhanced attentional alignment between human and robot. Unreliable gaze increased response latencies and disrupted joint performance, revealing the cost of inconsistent social signals. Additionally, post-interaction ratings showed that participants in the reliable condition perceived the robot as more responsive. In contrast, those in the unreliable condition reported decreased confidence in the robot's behavior under changing conditions. Crucially, reaction time differences emerged even though participants reported no awareness of the gaze manipulation, demonstrating that behavioral measures reveal adaptation before it surfaces in explicit evaluation. By integrating continuous metrics with self-report scales, this study shows that reaction times capture millisecond-level behavioral adjustments during interaction. At the same time, questionnaires identify which qualitative dimensions (such as responsiveness or reliability) drive post-hoc attitudes. These findings offer insights into the cognitive mechanisms supporting adaptive human-robot collaboration and highlight the value of multimodal assessment in the design of socially intelligent systems.