Affective stimuli in our environment indicate threat or reward and have been shown to bias perception and behavior. While studies with visual stimuli found that threatening objects were perceived to be closer or bigger than neutral stimuli, it remains unclear whether similar biases exist in the auditory domain. Therefore, the goal of this study was to investigate how affective sound stimuli influence sound distance perception. Two Virtual Reality experiments were conducted in which affective voices (angry vs. neutral) were presented via loudspeakers at positions unknown to the participants and had to be localized in a virtual environment. In the first experiment (N = 44), participants actively placed a visually presented virtual agent or virtual loudspeaker in an empty room at the perceived sound source location. In the second experiment (N = 32), participants were standing in front of several virtual agents or virtual loudspeakers and had to indicate the sound source by directing their gaze toward the perceived sound location. Results in both preregistered experiments consistently show that participants estimate the location of angry voice stimuli at greater distances than the location of neutral voice stimuli. We discuss that neither emotional nor motivational biases can account for these results. Instead, distance estimates seem to rely on listeners’ representations regarding the relationship between vocal affect and acoustic characteristics.