Constant auditory noise accompanies many cognitive functions throughout the day. Especially from physiological research, we know that this continuous exposure has altogether negative consequences – not only directly for our auditory system but for the whole body. Conversely, less is known about how constant auditory noise affects our cognitive functions. Here, we specifically investigated how constant auditory noise affects our working memory. Working memory is not only a core function that allows us to maintain information actively. It is also the foundation for many higher-order functions. In several experiments, we explored how different types of auditory noise affect working memory performance in a spatial n-back task. Our research revealed a complex interplay that, surprisingly, yields better performance in untrained participants but requires an additional compensatory effort to maintain. These results hint at cognitive costs much more likely to occur under long-term exposure than in short intervals.