The vast majority of studies on musical taste are based on likes or preferences of certain types of music. A series of studies will be presented, in which the complexity and diversity of musical judgments became obvious, showing that musical dislikes are important for conceptualizing musical taste. The rationales for disliked music were first investigated using in-depth interviews revealing relevant categories of social, music-related, and self-related reasons for the dislike of various kinds of music. A following online survey revealed a structure of the rationales, presenting two latent profiles. A ‘highbrow’ profile is centered around the rejection of Too Simple music related to Too Mainstream and Not Authentic, all connected to Social Incongruence. This highbrow thinking leads to a despise of (popular) music, which can result in No Impact, or even in active Displeasure. This displeasure seems to be mediated if not caused by a perceived Social Incongruence. A ‘lowbrow’ profile is centered around Too Niche and Too Complex music, with the first being connected to Displeasure. In another study, bodily reactions to one’s disliked music were investigated with measures of psychophysiology, revealing higher arousal responses and facial muscle activity when listening to disliked music in comparison to 'indifferent' music. Physiological arousal is therefore not only an indicator of pleasure evoked by preferred music but also of disliked music. This series of studies shows that focusing musical taste research exclusively on listeners’ preferences cannot account for the diversity of aesthetic criteria that underlie everyday evaluations of music.