Submission 519
When and Why Advice-Taking Strategies Differ: A Dual Hurdle-Based Meta-Analysis
SymposiumTalk-02
Presented by: Jessica Helmer
Advice taking experiments often utilize a judge advisor system (JAS), where a judge expresses a prior belief, receives advice, and then is allowed to revise their judgment. The degree to which participants revise their judgement is examined via a continuous metric called Weight of Advice (WOA), which defines the revised judgment as a weighted average of the prior and advice. However, even though WOA is continuous, results consistently demonstrate people frequently make discrete choices between their prior and the advice rather than continuously average. We report the results of a meta-analysis on a dataset of over 100,000 observations from 49 JAS studies that employs a recent modeling framework that explicitly distinguishes between these choosing and averaging strategies. This model separates the decision process into an initial discrete choice between decline (WOA = 0), adopt (WOA = 1), and compromise (0 < WOA < 1) and then a continuous averaging judgment in cases where compromise is chosen. While we do indeed find compromising is the dominant strategy, there is high heterogeneity across both studies and participants. In some studies there is a reversal, and advice is compromised with less often than it is declined. We also find participants tend to fully adopt advice at a relatively low rate. Our approach sheds new light on how different moderators, situational contexts, and even study design choices influence the advice-taking process.