Gestures can carry semantic meaning and provide redundant or additional information related to the content of verbal utterances (Arachchige et al., 2021). A recent meta-analysis revealed that bimodal communication indeed moderately improves comprehension (Dargue et al., 2019). Gestures referring to affirmation or rejection are an ideal testing ground for the interplay of speech and gesture. We therefore aimed to investigate whether the compatibility of verbal and gestural information of logical “yes” and “no” affects the performance in a two choice decision task. In each trial, a blue and a green box appeared next to each other on the screen and participants were asked to indicate the location of a ball (“Is the ball in the blue/green box?”). We presented short video clips including a verbal answer of “yes” or “no” and an affirmation (head nod; thumb up) or rejection (head shake; thumb down) gesture. Crucially, verbal and gestural information matched or mismatched and participants were asked to choose the correct box based on the verbal clue in one half of the experiment and based on the gestural clue in the other half of the experiment. We observed that responses were faster in trials with a match (vs. mismatch) of verbal and gestural information when the critical clue was affirmative. This indicates that gesture-speech matches selectively facilitated affirmation. We will discuss possible explanations for this pattern of results, including the idea that the processing of rejection activated inhibitory resources that interfered with the integration of information from the task-irrelevant input channel.