Cognitive psychologists develop and use cognitive paradigms to isolate and investigate cognitive functions. For example, the Stroop task is used to investigate the impact of automatic word reading on color naming to understand how irrelevant information facilitates (in congruent trials) or hinders (in incongruent trials) responding. Often, cognitive paradigms have also been used to assess individual differences. Yet, recently Rouder and colleagues (2019) pointed out that the Stroop task and other conflict tasks are not suitable to measure individual differences. In line with this assumption, Schuch and colleagues (2021) found that the reliability of several measures for cognitive control is moderate (for split-half reliabilities) to poor (for retest reliabilities). This seem to at least partly result from small variability of the respective cognitive measure among participants. Here we suggest that free choice paradigms might be suitable to increase inter-individual variability of the respective cognitive measure. In line with this assumption, we compare inter-individual variability and reliability of cognitive measure in forced and free choice task switching settings.